Commit Graph

2246 Commits

Author SHA1 Message Date
Scot Breitenfeld
da3b7ff945
Add h5pget_actual_selection_io_mode fortran wrapper (#3746)
* added h5pget_actual_selection_io_mode_f test

* added tests for h5pget_actual_selection_io_mode_f

* fixed int_f type conversion
2023-10-23 14:55:47 -05:00
Dana Robinson
a6d1bda6d2
Update Autotools to correctly configure oneAPI (#3751)
* Update Autotools to correctly configure oneAPI

Splits the Intel config files under the Autotools into 'classic'
Intel and oneAPI versions, fixing 'unsupported option' messages.

Also turns off `-check uninit` (new in 2023) in Fortran, which kills
the H5_buildiface program due to false positives.

* Enable Fortran in oneAPI CI workflow

* Turn on Fortran in CMake, update LD_LIBRARY_PATH

* Go back to disabling Fortran w/ Intel

For some reason there's a linking problem w/ Fortran

error while loading shared libraries: libifport.so.5: cannot open shared object file: No such file or directory
2023-10-23 12:50:15 -07:00
Dana Robinson
d76d591555
Add a simple cache to the ros3 VFD (#3753)
Adds a small cache of the first N bytes of a file opened with the
read-only S3 (ros3) VFD, where N is 4kiB or the size of the file,
whichever is smaller. This avoids a lot of small I/O operations
on file open.

Addresses GitHub issue #3381
2023-10-23 12:45:41 -07:00
Neil Fortner
630d6e27c9
Add new API function H5Pget_actual_select_io_mode() (#2974)
This function allows the user to determine if the library performed selection I/O, vector I/O, or scalar (legacy) I/O during the last HDF5 operation performed with the provided DXPL. Expanded existing tests to check this functionality.
2023-10-20 10:32:17 -07:00
Allen Byrne
5844f498b0
Add an option to disable doxygen warn as error (#3708)
Add for both CMake and the Autotools

* HDF5_ENABLE_DOXY_WARNINGS: ON/OFF (Default: ON)
* --enable-doxygen-errors: enable/disable (Default: enable)

The default will fail compile if the doxygen parsing generates warnings.
The option can be disabled if certain versions of doxygen have parsing
issues. i.e. 1.9.5, 1.9.8.

Fixes #3398
2023-10-19 14:58:33 -07:00
jhendersonHDF
c4a146efc4
Fix issue with unmatched messages in ph5diff (#3719) 2023-10-19 08:14:20 -05:00
Allen Byrne
29c1c02300
Some corrections and fix for plugins (#3712) 2023-10-19 08:01:02 -05:00
jhendersonHDF
fc788559f7
Correct use of set() command with options (#3667) (#3703)
* Correct use of set() command with options

* Force filter off if not found

Co-authored-by: Allen Byrne <50328838+byrnHDF@users.noreply.github.com>
2023-10-17 18:32:31 -07:00
Dana Robinson
d5267f096e
Add support for AOCC & Flang w/ the Autotools (#3674)
* Adds a config/clang-fflags options file to support Flang
* Corrects missing "-Wl," from linker options in the libtool wrappers
  when using Flang, the MPI Fortran compiler wrappers, and building
  the shared library. This would often result in unrecognized options
  like -soname.
* Enable -nomp w/ Flang to avoid linking to the OpenMPI library.

CMake can build the parallel, shared library w/ Fortran using AOCC
and Flang, so no changes were needed for that build system.

Fixes GitHub issues #3439, #1588, #366, #280
2023-10-14 22:39:43 -05:00
Scot Breitenfeld
6aaa960d90
Fixes test failure for gfortran -O2 and -O3, -fdefault-real-16 (#3662)
* added cmake ieee flag for nagfor

* fixes gfortran -O2 and -O3, -fdefault-real-16

* fixed sync

* updated release notes
2023-10-13 09:39:06 -07:00
Scot Breitenfeld
85c176247d
Address nagfor exceptions stoppage. (#3658)
* added cmake ieee flag for nagfor

* generalized determining the nag compiler

* fixing some misc. NAG warnings
2023-10-11 15:16:01 -05:00
jhendersonHDF
bfbfaf72e1
Update parallel compression feature to support multi-dataset I/O (#3591) 2023-10-10 10:11:22 -05:00
Allen Byrne
7631015ea4
Use real URLs and updated names for plugins (#3651)
* synchronize TGZ naming convention/usage
2023-10-10 09:30:19 -05:00
Scot Breitenfeld
0ffde9da19
Fixes GH#1027 compilation error (#3654) 2023-10-10 09:18:00 -05:00
Scot Breitenfeld
6edd9a0aab
Drop MPI-2 support (#3643) 2023-10-07 18:16:30 -07:00
H. Joe Lee
a95e4fc236
Improve consistency in past tense usage (#3638) 2023-10-06 10:32:33 -05:00
Allen Byrne
283202bc62
Remove old EXTERNALPROJECT_ADD in favor of FETCH_CONTENT (#3624) 2023-10-04 15:51:01 -05:00
Dana Robinson
447765609b
Disable static + thread-safe on Windows w/ CMake (#3622)
The thread-safety feature on Windows requires a hook in DllMain() and
thus is only available when HDF5 is built as a shared library.

This was previously a warning, but has now been elevated to a fatal
error that cannot be overridden with ALLOW_UNSUPPORTED.

Fixes GitHub #3613
2023-10-03 16:37:44 -07:00
jhendersonHDF
34fcb9c5a4
Fix several spelling/grammar issues (#3621) 2023-10-03 09:01:28 -07:00
Scot Breitenfeld
1e852b94bd
Removed the use of -commons linking option on Darwin (#3581)
Removed the use of -commons linking option on Darwin as COMMON and EQUIVALENCE is no long used
2023-09-25 12:41:48 -07:00
H. Joe Lee
d920a45413
Fix ifx unused variable hdferr warning. (#3568) 2023-09-22 08:45:50 -05:00
Scot Breitenfeld
08e115b7d8
Added new Fortran API wrappers (#3511)
* Added new wrappers for
h5get_free_list_sizes_f
H5Sselect_intersect_block_f
H5Sselect_shape_same_f
h5pget_no_selection_io_cause_f
h5pget_mpio_no_collective_cause_f
H5Lvisit_by_name_f
H5Lvisit_f
H5Fget_info_f
h5dwrite_chunk_f
h5dread_chunk_f

* added h5pget_file_space_page_size_f, h5pset_file_space_page_size_f, h5pget_file_space_strategy_f, h5pset_file_space_strategy_f, h5info tests

* added fortran tests

* Update tH5F.F90
2023-09-07 17:25:07 -05:00
jhendersonHDF
0b24f40b0f
Fix Subfiling VFD IOC assignment bug (#3456) 2023-09-01 09:59:28 -07:00
Neil Fortner
1d79445a1d
Remove extraneous "33" in RELEASE.txt (#3425) 2023-08-24 10:43:36 -07:00
jhendersonHDF
216d2191c7
Skip atomicity tests for OpenMPI major versions < 5 (#3421) 2023-08-24 08:54:13 -07:00
Neil Fortner
b155ec5b10
Add RELEASE.txt entry for compound performance regression fix (#3376) (#3416) 2023-08-23 16:49:51 -05:00
Alex
0b2e11d5c0
Fix Heap-buffer-overflow WRITE in H5MM_memcpy (#3368) 2023-08-23 12:35:06 -07:00
Allen Byrne
e1602a287b
Re-enable SZIP default to ON in CMake (#3414)
The Autotools were handled in a separate commit
2023-08-23 12:32:09 -07:00
Dana Robinson
81fc47cc06
Enable szip by default in Autotools (#3412)
Since libaec is so prevalent and BSD-licensed for both encode and
decode, we build the szip filter by default when the szip or aec
libraries are found.
2023-08-23 08:21:33 -07:00
Dana Robinson
a7c095d5be
Fix for CVE-2016-4332 (#3406)
This CVE issue was previously listed as fixed (via HDFFV-9950) back in
2016, but with no confirmation test. Now that test files exist for
the 2016 Talos CVE issues, we found that CVE-2016-4332 can raise an
assert in debug builds.

This fix replaces the assert with pointer checks that don't raise
errors or asserts. Since the function is in cleanup code, we do our
best to close and free things, even when presented with partially-
initialized structs.

Fixes CVE-2016-4332 and HDFFV-9950 (confirmed via the cve_hdf5 repo)
2023-08-21 22:11:56 -05:00
jhendersonHDF
5df18802d0
Fix serial to parallel chunked dataset file space allocation bug (#3394) 2023-08-21 22:09:04 -05:00
Allen Byrne
ffde055be2
Update presets, examples uncompress, szip cache (#3391) 2023-08-18 16:01:15 -05:00
jhendersonHDF
98b8fa7469
Fix assertion failure during file close on error (#3387) 2023-08-18 15:59:25 -05:00
Neil Fortner
ba2193a270
Add RELEASE.txt notes for recent selection I/O work. (#3374) 2023-08-10 16:15:56 -05:00
jhendersonHDF
14eb8f87f4
Work around a testphdf5 failure on Cray MPICH machines (#3361) 2023-08-08 13:02:19 -05:00
Allen Byrne
37c60bcea8
Add Fortran ES module to deploy list (#3341)
* Add Fortran ES module to deploy list

* Change fortran mod file export to use a list of names
2023-08-04 16:38:20 -05:00
Aleksandar Jelenak
63b0f152e5
Fix a typo in RELEASE.txt 2023-08-03 11:47:09 -04:00
Dana Robinson
86ddedf522
Fix CVE-2018-13867 (#3336) 2023-08-02 17:44:19 -05:00
Dana Robinson
11e28fe8b8
Fix CVE-2018-11202 (#3330)
A malformed file could result in chunk index memory leaks. Under most
conditions (i.e., when the --enable-using-memchecker option is NOT
used), this would result in a small memory leak and and infinite loop
and abort when shutting down the library. The infinite loop would be
due to the "free list" package not being able to clear its resources
so the library couldn't shut down. When the "using a memory checker"
option is used, the free lists are disabled so there is just a memory
leak with no abort on library shutdown.

The chunk index resources are now correctly cleaned up when reading
misparsed files and valgrind confirms no memory leaks.
2023-08-02 13:59:26 -07:00
jhendersonHDF
f5c3963c18
Fix h5repack for variable-length datatyped datasets (#3331) 2023-08-02 13:19:21 -07:00
Allen Byrne
56451503c5
Fix loading plugin fails with missing directory GH issue #3248 (#3315) 2023-08-01 23:16:11 -05:00
jhendersonHDF
a78863a82c
Fix incorrect error check in H5Ofill.c for undefined fill values (#3312) 2023-08-01 23:14:02 -05:00
Allen Byrne
800edda078
Option changed but not all references (#3252)
* Option changed but not all references

* remove quotes from binary var
2023-07-18 17:27:12 -05:00
Allen Byrne
a04fd783cb
Update DEFAULT_API_VERSION documentation for CMake (#3255)
* Update DEFAULT_API_VERSION documentation for CMake

* Fix hint

---------

Co-authored-by: Larry Knox <lrknox@hdfgroup.org>
2023-07-18 17:26:01 -05:00
Mark Kittisopikul
426a7f82f6
Avoid truncating at null byte when copying to std::string (#3083)
---------

Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2023-07-15 23:31:57 -05:00
Jan-Willem Blokland
305ac88865
ROS3: (feature) Temporary security credentials (#3030)
- Implemented support for AWS temporary security credentials.
  For this kind of credentials also a session/security token
  should be included in the request by adding the
  x-amz-security-token header.

Co-authored-by: Larry Knox <lrknox@hdfgroup.org>
Co-authored-by: Jordan Henderson <jhenderson@hdfgroup.org>
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2023-07-14 15:15:11 -05:00
jhendersonHDF
26059fc7ab
Subfiling VFD source cleanup (#3241)
* Subfiling VFD source cleanup

Modularize Subfiling CMake code into separate CMakeLists.txt file

Update Mercury util code to latest version and update Copyright

Generate mercury_util_config.h header file instead of using
pre-generated file

Remove unnecessary Mercury functionality

Fix minor warning in Subfiling VFD code

* Remove Mercury headers from Autotools publicly-distributed header list
2023-07-13 12:19:02 -05:00
jhendersonHDF
f5ca9237a2
Fix assertion failure when attempting to use IOC VFD directly (#3187) 2023-06-27 21:36:12 -07:00
Larry Knox
7e3c100755
Fix #1978 h5vers usage message. (#3162)
Update Platforms Tested in RELEASE.txt.
2023-06-20 16:57:43 -07:00
H. Joe Lee
a37795d8b9
chore: fix grammar (#3150)
* chore: fix grammar
2023-06-16 12:43:26 -07:00