mirror/netcdf-c
2
0
Fork 0
mirror of https://github.com/Unidata/netcdf-c.git synced 2024-12-03 08:01:25 +08:00
Code Issues Packages Projects Releases Wiki Activity
9,454 Commits 91 Branches 74 Tags 86 MiB
b87d921509
Commit Graph

9454 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ward Fisher
b87d921509 Merge branch 'fix-cmake-s3-support.wif' of github.com:WardF/netcdf-c into fix-cmake-s3-support.wif 2023-08-30 16:11:53 -06:00
Ward Fisher
468e98f3b4 Making test cases more verbose, turning off s3-based interoperability tests TEMPORARILY. 2023-08-30 16:11:37 -06:00
Ward Fisher
c177ec0626 Add properties to pure awssdk for MSVC builds. 2023-08-30 14:43:25 -06:00
Ward Fisher
af07326a6b Disable 'force internal S3 on Windows' 2023-08-30 10:17:00 -06:00
Ward Fisher
dd1ae95b28 Tweak spacing in pure awssdk test. 2023-08-29 16:38:21 -06:00
Ward Fisher
2e25cfc25a Added checks for -lssl and -lcrypto for cmake-based builds. We can't assume they are available. 2023-08-29 12:15:15 -05:00
Ward Fisher
ac4aade4f2 Add an explicit check for ctype.h to CMake so that S3_INTERNAL=TRUE works. 2023-08-29 10:12:14 -06:00
Ward Fisher
718e4858cc Renamed pure-awssdk test to be more descriptive. 2023-08-28 16:56:16 -06:00
Ward Fisher
2f43247610 Adding a test which can be used to ensure that the AWSSDK which was discovered at configure time is functional. Still need to wire it into autotools. 2023-08-28 16:43:37 -06:00
Ward Fisher
7333d09982 Correct the logic of when and how to link against amazon S3 AWS SDK libraries. 2023-08-24 17:39:49 -05:00
Ward Fisher
d90abc5de4 Modify how the aws-sdk-cpp libraries are detected using autotools. Complicated by the fact that the 'official' method uses cmake. 2023-08-24 16:03:05 -05:00
Ward Fisher
1eca1ad874 Revert an accidental change. 2023-08-24 10:17:29 -06:00
Ward Fisher
363718215c Merge branch 'main' into fix-cmake-s3-support.wif 2023-08-24 10:16:09 -06:00
Ward Fisher
0f7ebad42e Remove diagnostic print statement. 2023-08-23 15:29:42 -06:00
Ward Fisher
dd69bb8d28 Correct some logic so that S3 SDK is linked against if and when it is found. 2023-08-23 15:29:23 -06:00
Ward Fisher
ef94285ac1
Merge pull request #2737 from DennisHeimbigner/cachesizes2.dmh 
Fix major bug in the NCZarr cache management
 2023-08-17 14:23:57 -06:00
Dennis Heimbigner
c5b5a8a17e Update release notes 2023-08-16 23:09:26 -06:00
Dennis Heimbigner
9094d25409 Fix major bug in the NCZarr cache management 
re: PR https://github.com/Unidata/netcdf-c/pull/2734
re: Issue https://github.com/Unidata/netcdf-c/issues/2733

As a result of an investigation by https://github.com/uweschulzweida,
I discovered a significant bug in the NCZarr cache management.
This PR extends the above PR to fix that bug.

## Change Overview
* Insert extra checks for cache overflow.
* Added test cases contingent on the --enable-large-file-tests option.
* The Columbia server is down, so it has been temporarily disabled.
 2023-08-16 23:07:05 -06:00
Ward Fisher
032b910edf
Merge pull request #2726 from DennisHeimbigner/shifterr.dmh 
Fix a number of minor bugs
 2023-08-11 13:32:55 -06:00
Ward Fisher
ccfe62de72 Fix a missing 'fi' 2023-08-11 11:29:30 -06:00
Ward Fisher
939245ca4a
Merge branch 'main' into shifterr.dmh 2023-08-11 11:02:55 -06:00
Ward Fisher
f72e3cbdfe
Merge pull request #2734 from DennisHeimbigner/cachesizes.dmh 
Cleanup the handling of cache parameters.
 2023-08-11 10:26:46 -06:00
Dennis Heimbigner
ad1e16a7ae Update release notes 2023-08-10 17:00:22 -06:00
Dennis Heimbigner
f1a3a64b65 Cleanup the handling of cache parameters. 
re: https://github.com/Unidata/netcdf-c/issues/2733

When addressing the above issue, I noticed that there was a disconnect
in NCZarr between nc_set_chunk_cache and nc_set_var_chunk cache.
Specifically, setting nc_set_chunk_cache had no impact on the per-variable cache parameters when nc_set_var_chunk_cache was not used.

So, modified the NCZarr code so that the per-variable cache parameters are set in this order (#1 is first choice):
1. The values set by nc_set_var_chunk_cache
2. The values set by nc_set_chunk_cache
3. The defaults set by configure.ac
 2023-08-10 16:57:57 -06:00
Ward Fisher
c798bb6405
Merge pull request #2730 from DennisHeimbigner/filtervlen2.dmh 
Explicitly suppress variable length type compression
 2023-08-10 16:50:21 -06:00
Ward Fisher
c374536240
Merge pull request #2732 from DennisHeimbigner/corrupt.dmh 
Fix a crash when accessing a corrupted classic file.
 2023-08-09 15:48:31 -06:00
Dennis Heimbigner
bb8aa25348 ~S3 fix 2023-08-08 16:49:33 -06:00
Dennis Heimbigner
5cee82fd66 reversed conditional 2023-08-08 15:14:04 -06:00
Dennis Heimbigner
15c31b9eb6 Fix a crash when accessing a corrupted classic file. 
re: Issue https://github.com/Unidata/netcdf-c/issues/2731

A corrupted classic file is causing the library to crash.
Fix so that it returns NC_ENOTNC instead.
 2023-08-08 12:51:42 -06:00
Dennis Heimbigner
db772ce34c Explicitly suppress variable length type compression 
re: PR https://github.com/Unidata/netcdf-c/pull/2716).
re: Issue https://github.com/Unidata/netcdf-c/issues/2189

The basic change is to make use of the fact that HDF5 automatically suppresses optional filters when an attempt is made to apply them to variable-length typed arrays.
This means that e.g. ncdump or nccopy will properly see meaningful data.
Note that if a filter is defined as HDF5 mandatory, then the corresponding variable will be suppressed and will be invisible to ncdump and nccopy.
This functionality is also propagated to NCZarr.

This PR makes some minor changes to PR https://github.com/Unidata/netcdf-c/pull/2716 as follows:
* Move the test for filter X variable-length from dfilter.c down into the dispatch table functions.
* Make all filters for HDF5 optional rather than mandatory so that the built-in HDF5 test for filter X variable-length will be invoked.

The test case for this was expanded to verify that the filters are defined, but suppressed.
 2023-08-03 15:47:28 -06:00
Ward Fisher
2cd9d2674a
Merge pull request #2646 from ZhipengXue97/next 
Fix potential null dereference
 2023-08-01 14:00:30 -06:00
Ward Fisher
dc3c45e5b0
Merge branch 'main' into next 2023-07-31 17:33:56 -06:00
Ward Fisher
aee19e263f
Merge pull request #2684 from Dave-Allured/release-notes.minor-fixes 
Release notes:  Minor.  Add historical tag, and spell fix.
 2023-07-31 17:26:23 -06:00
Ward Fisher
6e1895fee8
Merge pull request #2722 from WardF/gh2712-parity.wif 
Enable/Disable some plugins at configure time
 2023-07-26 16:54:40 -06:00
Ward Fisher
4c71b59b52 Update Release Notes 2023-07-26 14:33:48 -06:00
Ward Fisher
18b04b4c9e Merge branch 'main' into gh2712-parity.wif 2023-07-25 15:23:46 -06:00
Ward Fisher
dac29bb15b
Merge pull request #2725 from DennisHeimbigner/plistfix.dmh 
Fix memory leak
 2023-07-25 15:22:56 -06:00
Ward Fisher
8a45d26c78
Merge branch 'main' into plistfix.dmh 2023-07-25 15:22:38 -06:00
Dennis Heimbigner
c4ecdd6403 Fix a number of minor bugs 
1. Fix a shift bug in ncexhash.c (Issue https://github.com/Unidata/netcdf-c/issues/2702)
2. Fix an S3 related error in test_byterange.sh
3. Fix bz2/bzip2 handling in configure.ac
 2023-07-24 16:20:26 -06:00
Ward Fisher
db2519cf89
Merge pull request #2724 from DennisHeimbigner/transientname.dmh 
Modify PR 2655 to ensure transient types have names.
 2023-07-24 11:01:14 -06:00
Ward Fisher
11e589d394 Merge branch 'gh2712-parity.wif' of github.com:WardF/netcdf-c into gh2712-parity.wif 2023-07-24 09:32:42 -06:00
Ward Fisher
b65bba0b79 Additional cmake-based logic. 2023-07-24 09:32:39 -06:00
Dennis Heimbigner
65f866fff6 Fix memory leak 
re: Issue https://github.com/Unidata/netcdf-c/issues/2723

H/T to Roland Ambs for finding a memory leak where an allocated
HDF5 plist is not being reclaimed.
 2023-07-23 17:25:30 -06:00
Dennis Heimbigner
a446ebfc29 Update release notes 2023-07-23 12:44:00 -06:00
Dennis Heimbigner
a37ca49d25 Modify PR https://github.com/Unidata/netcdf-c/pull/2655 to ensure transient types have names. 
re: PR https://github.com/Unidata/netcdf-c/pull/2655

This PR modifies the transient types PR so that all created
transient types are given a created unique name (within a
group). The form of the name is "_Anonymous<Class>NN". The class
is the user-defined type class: Enum, Compound, Opaque, or
Vlen. NN is an integer identifier to ensure uniqueness.
Additionally, this was applied to DAP/4 anonymous dimensions.
This also required some test baseline data changes.

The transient test case is modified to verify that the name exists.
 2023-07-22 20:40:53 -06:00
Ward Fisher
c6b853a860 Logic to ensure libsz is searched for if Zarr is enabled but enable_filter_szip is false. 2023-07-21 14:46:45 -06:00
Ward Fisher
ae28dd36e6 Additional tweaking of search logic. 2023-07-21 14:32:25 -06:00
Ward Fisher
890251c611 String handling in CMakeLists.txt 2023-07-21 14:19:50 -06:00
Ward Fisher
9787de121c Small change in CMakeLists.txt 2023-07-21 14:02:30 -06:00
Ward Fisher
4a61f4771b Add autotools option to disable checking for libzstd. 2023-07-20 16:08:07 -06:00