netcdf-c/libhdf5
Dennis Heimbigner f6e25b695e Fix additional S3 support issues
re: https://github.com/Unidata/netcdf-c/issues/2117
re: https://github.com/Unidata/netcdf-c/issues/2119

* Modify libsrc to allow byte-range reading of netcdf-3 files in private S3 buckets; this required using the aws sdk. Also add a test case.
* The aws sdk can sometimes cause problems if the Awd::ShutdownAPI function is not called. So at optional atexit() support to ensure it is called. This is disabled for Windows.
* Add documentation to nczarr.md on how to build and use the aws sdk under windows. Currently it builds, but testing fails.
* Switch testing from stratus to the Unidata bucket on S3.
* Improve support for the s3: url protocol.
* Add a s3 specific utility code file: ds3util.c
* Modify NC_infermodel to attempt to read the magic number of byte-ranged files in S3.

## Misc.

* Move and rename the core S3 SDK wrapper code (libnczarr/zs3sdk.cpp) to libdispatch since it now used in libsrc as well as libnczarr.
* Add calls to nc_finalize in the utilities in case atexit is disabled.
* Add header only json parser to the distribution rather than as a built source.
2021-10-29 20:06:37 -06:00
..
CMakeLists.txt Ensure MPI header found without wrapper 2021-01-19 09:38:07 -07:00
H5FDhttp.c update merge 2021-10-26 20:53:05 -06:00
H5FDhttp.h Provide byte-range reading of remote datasets 2019-01-01 18:27:36 -07:00
hdf5attr.c Merge branch 'main' into ejh_quantize_2 2021-09-07 10:44:45 -06:00
hdf5create.c Finish argument name refactoring... 2021-08-10 09:03:21 -06:00
hdf5debug.c Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
hdf5debug.h Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
hdf5dim.c Provide a Number of fixes/improvements to NCZarr 2020-11-19 17:01:04 -07:00
hdf5dispatch.c now qunatizing with inq function in dispatch table 2021-08-24 01:53:16 -06:00
hdf5err.h Additional Fixes to NCZarr 2020-12-16 20:48:02 -07:00
hdf5file.c Fix additional S3 support issues 2021-10-29 20:06:37 -06:00
hdf5filter.c Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
hdf5grp.c Provide a Number of fixes/improvements to NCZarr 2020-11-19 17:01:04 -07:00
hdf5internal.c Fix a stack-read-overflow in ncindexlookup() 2021-09-24 11:59:48 +02:00
hdf5open.c Fix additional S3 support issues 2021-10-29 20:06:37 -06:00
hdf5type.c Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
hdf5var.c now nsd of 0 is NC_EINVAL for nc_def_var_quantize() 2021-09-10 06:10:20 -06:00
Makefile.am Additional Fixes to NCZarr 2020-12-16 20:48:02 -07:00
nc4hdf.c Remove duplicate line 2021-10-25 17:09:17 -06:00
nc4info.c Remove need for HDF5-1.6 API being defined 2021-04-28 13:59:24 -06:00
nc4mem.c re: github issues 2018-10-30 20:48:12 -06:00
nc4memcb.c Codify cross-platform file paths 2021-03-04 13:41:31 -07:00