Commit Graph

23358 Commits

Author SHA1 Message Date
jhendersonHDF
4279c351f5
Fix up dsets test for some platforms with different long double format (#4114) 2024-03-11 14:39:13 -05:00
Allen Byrne
8340c4cb1f
long double tests has problems setting precision with offset (#4102)
* long double tests has problems setting precision with offset

* Disable long double until more development fixes issues
2024-03-11 07:58:35 -05:00
Dana Robinson
ac9541100f
Add Doxygen for HDFS VFD (#4106)
* Add Doxygen for HDFS VFD

* Fix Doxygen warning

* Update H5FDhdfs.h
2024-03-10 17:26:14 -07:00
Allen Byrne
50a6522322
Change compression tests reference files to use masking for compression ratios (#4083)
Rework TEST_FILTER tests to handle slightly different compression ratios
2024-03-10 16:43:37 -07:00
Dana Robinson
9bc6c20166
Remove lint comments (#4107) 2024-03-10 16:17:49 -07:00
Dana Robinson
7403f20757
Move common variables out of cache test blocks (#4108)
Fixes a stack size warning w/ XCode
2024-03-10 16:17:37 -07:00
Dana Robinson
700d1a24df
Convert H5B__assert to use error checks (#4109)
Switches assert() calls to HGOTO_ERROR in H5B__assert() so it can be
used in production mode. Also renames it to H5B__verify_structure()
to better reflect what it checks.
2024-03-10 16:16:41 -07:00
Dana Robinson
16b62825b3
Clean up a few things in H5T.c (#4105)
* remove (size_t) noise casts
* replace (hid_t)FAIL with H5I_INVALID_HID
2024-03-10 12:42:29 -07:00
Dana Robinson
f0ba8baa0d
Minimize use of abort() (#4110)
The abort() call is used at several places where it probably shouldn't.
2024-03-10 12:42:16 -07:00
jhendersonHDF
ef401a5f5e
Refactor datatype conversion code to use pointers rather than IDs (#4104)
The datatype conversion code previously used IDs for the source and
destination datatypes rather than pointers to the internal structures
for those datatypes. This was mostly due to the need for an ID for these
datatypes that can be passed to an application-registered datatype
conversion function or datatype conversion exception function. However,
using IDs internally caused a lot of unnecessary ID lookups and hurt
performance of datatype conversions in general. This was especially
problematic for compound datatype conversions, where the ID lookups were
occuring on every member of every compound element of a dataset. The
code has now been refactored to use pointers internally and only create
IDs for datatypes when necessary.

Fixed a test issue in dt_arith where a library datatype conversion
function was being cast to an application conversion function. Since the
two have different prototypes, this started failing after the parameters
for a library conversion function changed from hid_t to H5T_t * and an
extra parameter was added. This appears to have worked coincidentally in
the past since the only different between a library conversion function
and application conversion function was an extra DXPL parameter at the
end of an application conversion function

Fixed an issue where memory wasn't being freed in the h5fc_chk_idx test
program. Even though the program exits quickly after allocating the
memory, it still causes failures when testing with -fsanitize=address
2024-03-09 23:47:31 -08:00
Dana Robinson
28aaeb967c
Change how stats are printed in H5Z (#4097)
H5Z used the soon-to-be-removed HDEBUG macro to decide if stats
would be dumped and to what stream. This is now handled by a
DUMP_DEBUG_STATS_g variable and the output is always sent to
stdout.

This is an internal change, not normally visible to users.
2024-03-09 23:10:58 -08:00
Dana Robinson
6cb4b2f6d7
Remove printf debugging from H5Smpio.c (#4098) 2024-03-09 20:30:34 -08:00
Dana Robinson
08cf031588
Remove H5DEBUG() calls from H5Dmpio.c (#4103)
Just use stdout when a stream is needed.
2024-03-09 20:30:17 -08:00
Dana Robinson
fd7cf2a962
Remove a few H5O printf debugging statements (#4096)
These were in H5Oint.c, were protected by H5O_DEBUG, and only dumped
to stdout if the HDF5_DEBUG environment variable were set to do so.
2024-03-09 20:27:59 -08:00
Ben Boeckel
b1054b4ef3
msvc: don't declare HAVE_TIMEZONE for older MSVC (#3956)
It was introduced in MSVC 15 (Visual Studio 2017).
2024-03-09 10:25:40 -08:00
H. Joe Lee
c29a02d5e6
Remove leading / from relative path. (#4101) 2024-03-09 09:08:26 -08:00
Allen Byrne
cdef27d6ef
Correct missing change of source path for S3 build (#4100) 2024-03-09 09:07:08 -08:00
Dana Robinson
0ea1d7280b
Clean up off_t usage (#4095)
* Add comments to C++ and Fortran API calls that use off_t
* Remove noise casts for small integers
2024-03-09 09:06:10 -08:00
Dana Robinson
d4c84f8d0a
Fix the last C++ stack size warning (#4099) 2024-03-09 09:05:37 -08:00
Dana Robinson
3d09a7d5f6
Remove H5B debug checks (#4089)
The H5B (version 1 B-tree) package would add some computationally
expensive integrity checks when H5B_DEBUG was defined. Due to their
negative effects on performance, this option was rarely turned on,
making the H5B__assert() check function stale, if not dead, code.

This change:

* Builds H5B__assert() when NDEBUG is not defined (the function
  relies on assert()) so it gets compiled more often.
* Removes some printf debugging statements in the B-tree code
* Removes all H5B "extra debug" checks that are leftover from
  past debugging sessions. Maintainers can add H5B__assert()
  selectively to perform integrity checks when debugging.
* Removes the HDF5_ENABLE_DEBUG_H5B CMake option

H5B_DEBUG now has no effect
2024-03-08 23:17:13 -08:00
jhendersonHDF
d8af09dd8f
Expand check for variable-length or reference types when clearing datatype conversion paths (#4085)
When clearing out datatype conversion paths involving variable-length or reference datatypes
on file close, also check for these datatypes inside compound or array datatypes
2024-03-08 21:15:56 -08:00
Sean McBride
16255aa8c3
Fixed -Wdeprecated-copy-dtor warnings by implementing a copy assignment operator (#3306)
Example warning was:

warning: definition of implicit copy assignment operator for 'Group' is deprecated because it has a user-declared destructor [-Wdeprecated-copy-dtor]
2024-03-08 21:09:47 -08:00
Allen Byrne
114d2d0211
virtual creates must use the same datatype as the main file (#4092) 2024-03-08 15:50:31 -08:00
Allen Byrne
84ead492c0
Update long double test with correct values (#4060)
Update long double test with correct values
2024-03-08 14:13:38 -08:00
Allen Byrne
f87725c203
Merge HDF4 release workflow changes to hdf5 (#4093) 2024-03-08 14:13:10 -08:00
H. Joe Lee
1a05563183
Add subfiling for h5dump filedriver option help message (#3878) 2024-03-08 13:39:33 -08:00
Dana Robinson
3ea50208f9
Remove printf debugging in H5I package (#4088) 2024-03-08 12:55:16 -08:00
H. Joe Lee
56ea1b50f0
Remove extra whitespaces from nvhpc-cmake action. (#4091) 2024-03-08 12:55:03 -08:00
Scot Breitenfeld
f22f538ab7
fixes compilation failures due to H5E additions (#4090) 2024-03-08 10:57:05 -08:00
Scot Breitenfeld
7de7c25646
update macOS support statement (#4084) 2024-03-07 19:05:10 -08:00
Dana Robinson
b0af7cf58b
Fixed asserts due to H5Pset_est_link_info() values (#4081)
* Fixed asserts due to H5Pset_est_link_info() values

If large values for est_num_entries and/or est_name_len were passed
to H5Pset_est_link_info(), the library would attempt to create an
object header NIL message to reserve enough space to hold the links in
compact form (i.e., concatenated), which could exceed allowable object
header message size limits and trip asserts in the library.

This bug only occurred when using the HDF5 1.8 file format or later and
required the product of the two values to be ~64k more than the size
of any links written to the group, which would cause the library to
write out a too-large NIL spacer message to reserve the space for the
unwritten links.

The library now inspects the phase change values to see if the dataset
is likely to be compact and checks the size to ensure any NIL spacer
messages won't be larger than the library allows.

Fixes GitHub #1632

* Fix copy-paste comments
2024-03-07 18:36:58 -08:00
Dana Robinson
f24496074f
Remove printf debugging in H5HL code (#4086) 2024-03-07 18:36:44 -08:00
Allen Byrne
871a49feca
Use H5T_STD_I32LE to create datatype in vds examples (#4070)
Fixes issues when VDS examples are tested on BE systems
2024-03-07 13:05:28 -08:00
Dana Robinson
577a32fe83
Fix bin/trace script w/ out params (#4074)
The bin/trace script adds TRACE macros to public API calls in the main
C library. This script had a parsing bug that caused functions that
were annotated with /*out*/, etc. to be labeled as void pointers
instead of typed pointers.

This is mainly a developer feature and not visible to consumers
of the public API.

The bin/trace script now annotates public API calls properly.

Fixes GH #3733
2024-03-07 13:04:14 -08:00
Scot Breitenfeld
bc0c42695f
addressed compilation errors with gfortran 4.8 (#4082) 2024-03-07 10:44:14 -08:00
Allen Byrne
c872acae63
New option for building with static CRT in Windows (#4062) 2024-03-07 09:27:56 -08:00
mattjala
64a0b71c86
Close and reopen file during dset vlen IO API tests (#4050)
- Close/reopen file and file objects to prevent cache from being used instead of actual I/O.
- Moved vlen io test datasets under the dset container group instead of the root group
- Moved the PASSED() invocation to after individual test cleanup in case an error occurs during H5Treclaim
2024-03-07 09:07:05 -08:00
Michael Aivazis
3277064da3
Increased H5FD_ROS3_MAX_SECRET_TOK_LEN to 4096 to accommodate long AWS secret tokens (#4064)
ros3: increased H5FD_ROS3_MAX_SECRET_TOK_LEN to 4096; stratified the debugging statements so there is more control over the output
2024-03-07 08:53:45 -08:00
Dana Robinson
30c34f927d
Add support for the new MSVC preprocessor (#4078)
Microsoft has added a new, standards-conformant preprocessor
to MSVC, which can be enabled with /Zc:preprocessor. This
preprocessor trips over our HDopen() function-like variadic
macro since it uses a hack that only works with the legacy
MSVC preprocessor.

This fix adds ifdefs to use the correct HDopen() macro
depending on the MSVC preprocessor selected.

Fixes #2515
2024-03-07 08:52:32 -08:00
jhendersonHDF
2a2c683dc3
Don't load toolchain file in CMake workflows (#4077) 2024-03-07 08:03:13 -08:00
Scot Breitenfeld
9d8e882496
Added new H5E with tests. (#4049)
Added Fortran H5E APIs:
h5eregister_class_f, h5eunregister_class_f, h5ecreate_msg_f, h5eclose_msg_f
h5eget_msg_f, h5epush_f, h5eget_num_f, h5ewalk_f, h5eget_class_name_f,
h5eappend_stack_f, h5eget_current_stack_f, h5eset_current_stack_f, h5ecreate_stack_f,
h5eclose_stack_f, h5epop_f, h5eprint_f (C h5eprint v2 signature)

Addresses Issue #3987
2024-03-07 03:34:55 -08:00
Allen Byrne
fe5d0d5c53
fix path for S3 build path in CI (#4076) 2024-03-06 07:49:10 -08:00
Dana Robinson
10a35d0ebb
Fix uninitialized bytes in selection I/O test (#4073)
This was due to a complex type fill value being set to -1 instead
of a proper complex value. This was a test problem and not a core
library issue.
2024-03-06 07:48:28 -08:00
Allen Byrne
5fc7111895
Add NEWSLETTER and merge abi reports and add sha256sums (#4055) 2024-03-05 14:50:39 -08:00
Allen Byrne
129d80d208
Update INSTALL files (#4052) 2024-03-05 14:42:08 -08:00
Dana Robinson
e4d9b639d5
Fix uninitialized bytes in cmpd_dset test (#4072)
Compound fill values were set to the integer -1, causing valgrind
to flag 'uninitialized bytes' errors.

This is just a problem with the cmpd_dset test and not a core
library problem.
2024-03-05 14:33:09 -08:00
Dana Robinson
13348ab915
Fix a memory leak in the cmpd_dset test (#4071)
This was due to not freeing a test buffer. It was not a core
library memory leak.
2024-03-05 13:16:17 -08:00
Allen Byrne
0be892585a
Rename incorrectly named option (#4067)
* Rename incorrectly named option

* Restore the correct uses of USING_MEMCHECKER

* Update release note
2024-03-05 09:07:16 -08:00
Allen Byrne
42c7e1d073
Ignore UserPresets and Use only C compiler for sanitizers (#4066)
* Remove user presets file

* Only use C compiler for sanitzers
2024-03-05 09:05:38 -08:00
jhendersonHDF
f5f6975c2f
Fix issue where H5Tset_fields does not account for datatype offsets (#4061)
H5Tset_fields did not account for any offset in a floating-point datatype,
causing it to fail when a datatype's precision is correctly set such that
it doesn't include the offset bits.
2024-03-05 08:23:34 -06:00