Commit Graph

23026 Commits

Author SHA1 Message Date
jhendersonHDF
8cff88c507
Fix some issues with collective metadata reads for chunked datasets (#3716)
Add functions/callbacks for explicit control over chunk index open/close

Add functions/callbacks to check if chunk index is open or not so
that it can be opened if necessary before temporarily disabling
collective metadata reads in the library

Add functions/callbacks for requesting loading of additional chunk
index metadata beyond the chunk index itself
2023-10-23 19:08:06 -07:00
jhendersonHDF
af49eb5b86
Fix hangs during collective I/O with independent metadata writes (#3693) 2023-10-23 19:06:44 -07:00
Dana Robinson
ceb03358a1
Bump the ros3 VFD cache to 16 MiB (#3759) 2023-10-23 19:06:18 -07:00
Scot Breitenfeld
207d749a28
Added missing DLL for H5PGET_ACTUAL_SELECTION_IO_MODE_F (#3760)
* add missing H5PGET_ACTUAL_SELECTION_IO_MODE_F dll
2023-10-23 19:02:16 -05:00
Allen Byrne
b411852e98
Update fortran action step (#3748) 2023-10-23 13:01:10 -07:00
Scot Breitenfeld
da3b7ff945
Add h5pget_actual_selection_io_mode fortran wrapper (#3746)
* added h5pget_actual_selection_io_mode_f test

* added tests for h5pget_actual_selection_io_mode_f

* fixed int_f type conversion
2023-10-23 14:55:47 -05:00
Dana Robinson
a6d1bda6d2
Update Autotools to correctly configure oneAPI (#3751)
* Update Autotools to correctly configure oneAPI

Splits the Intel config files under the Autotools into 'classic'
Intel and oneAPI versions, fixing 'unsupported option' messages.

Also turns off `-check uninit` (new in 2023) in Fortran, which kills
the H5_buildiface program due to false positives.

* Enable Fortran in oneAPI CI workflow

* Turn on Fortran in CMake, update LD_LIBRARY_PATH

* Go back to disabling Fortran w/ Intel

For some reason there's a linking problem w/ Fortran

error while loading shared libraries: libifport.so.5: cannot open shared object file: No such file or directory
2023-10-23 12:50:15 -07:00
bmribler
744a20fc21
Add helpful text to h5clear (#3754)
Added text to the usage of h5clear to explain that this tool is not
for fixing corrupted files but simply for helping in the inspection
of the damage..

Fixed expected output for testing the modified usage.
2023-10-23 12:46:56 -07:00
Dana Robinson
d76d591555
Add a simple cache to the ros3 VFD (#3753)
Adds a small cache of the first N bytes of a file opened with the
read-only S3 (ros3) VFD, where N is 4kiB or the size of the file,
whichever is smaller. This avoids a lot of small I/O operations
on file open.

Addresses GitHub issue #3381
2023-10-23 12:45:41 -07:00
Allen Byrne
66396cadb1
Fix windows cpack error in WiX package. (#3747) 2023-10-23 12:39:43 -07:00
Scot Breitenfeld
34f4569cdd
update stat arg for apple (#3726)
* update stat arg for apple

* use H5_HAVE_DARWIN for Apple ifdef

* fix typo

* removed duplicate H5_ih_info_t

* added fortran async test to cmake
2023-10-23 12:35:42 -07:00
jhendersonHDF
a4c318de28
Fix buffer overflow in cache debugging code (#3691) 2023-10-23 12:33:37 -07:00
mattjala
5a00539e0d
Add native VOL checks to deprecated functions (#3647)
* Add native VOL checks to deprecated functions

* Remove unneeded native VOL checks

* Move native checks to top level calls
2023-10-23 12:32:54 -07:00
Dana Robinson
e4fb67c84a
Clean Autotools files in parallel tests (#3744)
Adds missing files to `make clean` for parallel, including Fortran.
2023-10-22 18:45:22 -07:00
bmribler
21ec3730c5
Additional update to the library version matrix for H5Pset_libver_bounds() (#3742)
This is the follow-up of PR #3702.
2023-10-21 19:15:12 -05:00
Dana Robinson
4dfde6bac7
Fix file names in tfile.c (#3743)
Some tests in tfile.c use h5_fileaccess to get a VFD-dependent file
name but use the scheme from testhdf5, reusing the FILE1 and FILE8
names. This leads to files like test1.h5.h5 which are unintended
and not cleaned up.

This changes the filename scheme for a few tests to work with h5test,
resulting in more informative names and allowing the files to
be cleaned up at the end of the test. The test files have also
been added to the `make clean` target for the Autotools.
2023-10-21 19:08:12 -05:00
Dana Robinson
4b2d2eccdd
Clean the flushrefresh test dir on Autotools (#3741)
The flushrefresh_test directory was not being cleaned up w/
`make clean` under the Autotools
2023-10-21 11:44:33 -07:00
Dana Robinson
29b27b7761
Clean Java test files on Autotools (#3740)
Removes generated HDF5 and text output files when running `make clean`.
2023-10-21 11:44:16 -07:00
Dana Robinson
7843db55ff
Clean up onion VFD files in tools make clean (#3739)
Cleans up h5dump and h5diff *.onion files in the Autotools when
runing `make clean`.
2023-10-21 11:44:03 -07:00
Dana Robinson
98b5779ea5
Add tools/libtest to Autotools builds (#3735)
This was only added to CMake many years ago and tests the tools
library.
2023-10-20 15:50:57 -05:00
Dana Robinson
e01ea706e2
Add missing test files to distclean target (#3734)
Cleans up new files in Autotools `make distclean` in the test directory
2023-10-20 12:46:26 -07:00
bmribler
709367cb1a
Update the library version matrix for H5Pset_libver_bounds() (#3702)
* Fixed #3524

Added 1.12, 1.14, and 1.16 to the table for libver bounds in the H5Pset_libver_bounds docs.
2023-10-20 14:17:46 -05:00
Glenn Song
2d551c9b57
Add -h and --help as flags in h5cc & h5fc (#3729)
Adds these common help flags in addition to -help
2023-10-20 11:28:10 -07:00
Allen Byrne
b5c63fb3fe
Test scripts now execute in-source with creation of tmp dir (#3723)
Fixes a few issues created in #3580:

* Fixes a problem where committed tools test files were deleted when cleaning after an in-source build
* Fixes issues with test file paths in Autotools tools test scripts
2023-10-20 10:57:09 -07:00
Neil Fortner
630d6e27c9
Add new API function H5Pget_actual_select_io_mode() (#2974)
This function allows the user to determine if the library performed selection I/O, vector I/O, or scalar (legacy) I/O during the last HDF5 operation performed with the provided DXPL. Expanded existing tests to check this functionality.
2023-10-20 10:32:17 -07:00
Dana Robinson
b916ce2419
Suppress cast-qual warning in H5TB Fortran wrapper (#3728)
This interface is fundamentally broken, const-wise.
2023-10-19 21:19:52 -07:00
Allen Byrne
97a6efbf8a
Organize CMake config features like libsettings (#3725) 2023-10-19 15:24:50 -07:00
jhendersonHDF
af56339d3b
Fixes and adjustments to t_filters_parallel (#3714)
Broadcast number of datasets to create in multi-dataset I/O cases
so that interference with random number generation doesn't cause
mismatches between ranks

Set fill time for datasets to "never" by default and adjust on a
per-test basis to avoid writing fill values to chunks when it's
unnecessary

Reduce number of loops run in some tests when performing multi-dataset
I/O

Fix an issue in the "fill time never" test where data verification
could fill if file space reuse causes application buffers to be
filled with chosen fill value when reading from datasets with
uninitialized storage

Skip multi-chunk I/O test configurations for multi-dataset I/O
configurations when the TestExpress level is > 1 since those
tests can be more stressful on the file system

Disable use of persistent file free space management for now
since it occasionally runs into an infinite loop in the library's
free space management code
2023-10-19 15:23:59 -07:00
Allen Byrne
2bb6619528
Develop intel split (#3722)
* Split intel compiler flags into sub-folders
* Update Intel options for warnings
* Mostly CMake, Autotools needs additional work
2023-10-19 15:17:20 -07:00
jhendersonHDF
11f3804c48
Fix CMake VOL passthrough tests by copying files to correct directory (#3721) 2023-10-19 14:59:18 -07:00
Allen Byrne
5844f498b0
Add an option to disable doxygen warn as error (#3708)
Add for both CMake and the Autotools

* HDF5_ENABLE_DOXY_WARNINGS: ON/OFF (Default: ON)
* --enable-doxygen-errors: enable/disable (Default: enable)

The default will fail compile if the doxygen parsing generates warnings.
The option can be disabled if certain versions of doxygen have parsing
issues. i.e. 1.9.5, 1.9.8.

Fixes #3398
2023-10-19 14:58:33 -07:00
Scot Breitenfeld
5672fd8177
Attempt to quiet some warnings with cray compilers. (#3724) 2023-10-19 14:40:08 -07:00
Scot Breitenfeld
8c69566da6
provide an alternative to mapfile for older bash (#3717) 2023-10-19 08:58:20 -07:00
jhendersonHDF
c4a146efc4
Fix issue with unmatched messages in ph5diff (#3719) 2023-10-19 08:14:20 -05:00
Allen Byrne
29c1c02300
Some corrections and fix for plugins (#3712) 2023-10-19 08:01:02 -05:00
jhendersonHDF
ebd3744407
Work around Theta system issue failure in links test (#3710)
When the Subfiling VFD is enabled, the links test may
try to initialize the Subfiling VFD and call MPI_Init_thread.
On Theta, this appears to have an issue that will cause
the links test to fail. Reworked the test to check for
the same conditions in a more roundabout way that doesn't
involved initializing the Subfiling VFD
2023-10-18 14:47:13 -07:00
Allen Byrne
8ff48054f8
Cache variables req FORCE to change (#3706)
* Cache variables req FORCE to change

* Also plugin needs FORCE
2023-10-18 12:46:02 -07:00
Allen Byrne
65e1bd8ce9
Add NVidia compiler support and CI (#3686) 2023-10-18 12:44:42 -07:00
H. Joe Lee
fce7ce1869
Clean up comments. (#3695) 2023-10-18 09:11:02 -07:00
H. Joe Lee
5e310254e2
Correct ld in format strings in cmpd_dset.c (#3697)
Removes clang warnings
2023-10-18 07:59:01 -07:00
jhendersonHDF
9557256819
Sync changes that are only in 1.14 branch (#3704) 2023-10-17 21:54:40 -07:00
jhendersonHDF
fc788559f7
Correct use of set() command with options (#3667) (#3703)
* Correct use of set() command with options

* Force filter off if not found

Co-authored-by: Allen Byrne <50328838+byrnHDF@users.noreply.github.com>
2023-10-17 18:32:31 -07:00
Dana Robinson
2a3b511e96
Restore floating-point suffixes in tests (#3698)
A prior commit removed too many F suffixes. This restores the suffixes
for float variables.
2023-10-17 12:22:27 -07:00
Dana Robinson
08d0909c9c
Fix unused variable warning in H5F_sfile_assert_num (#3700) 2023-10-17 12:22:10 -07:00
Dana Robinson
3523d4ba66
Fix unused variable in tselect.c (#3701) 2023-10-17 12:14:24 -07:00
Dana Robinson
e2d40ef16e
Suppress format string warnings in subfiling test (#3699) 2023-10-17 11:05:20 -07:00
jhendersonHDF
45c4729799
Add test info output to t_filters_parallel (#3696) 2023-10-17 10:40:42 -07:00
jhendersonHDF
a6bc1186c3
Initialize API context MPI types to MPI_BYTE (#3688) 2023-10-17 09:16:48 -07:00
Scot Breitenfeld
74fabd144e
switch to using time function instead of date function (#3690) 2023-10-17 09:12:16 -07:00
Dana Robinson
1b62827204
Add Doxygen for H5Pset_fapl_sec2() (#3685)
*
2023-10-16 12:21:01 -05:00