netcdf-c/libnczarr
Dennis Heimbigner f6e25b695e Fix additional S3 support issues
re: https://github.com/Unidata/netcdf-c/issues/2117
re: https://github.com/Unidata/netcdf-c/issues/2119

* Modify libsrc to allow byte-range reading of netcdf-3 files in private S3 buckets; this required using the aws sdk. Also add a test case.
* The aws sdk can sometimes cause problems if the Awd::ShutdownAPI function is not called. So at optional atexit() support to ensure it is called. This is disabled for Windows.
* Add documentation to nczarr.md on how to build and use the aws sdk under windows. Currently it builds, but testing fails.
* Switch testing from stratus to the Unidata bucket on S3.
* Improve support for the s3: url protocol.
* Add a s3 specific utility code file: ds3util.c
* Modify NC_infermodel to attempt to read the magic number of byte-ranged files in S3.

## Misc.

* Move and rename the core S3 SDK wrapper code (libnczarr/zs3sdk.cpp) to libdispatch since it now used in libsrc as well as libnczarr.
* Add calls to nc_finalize in the utilities in case atexit is disabled.
* Add header only json parser to the distribution rather than as a built source.
2021-10-29 20:06:37 -06:00
..
obsolete Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
CMakeLists.txt Fix additional S3 support issues 2021-10-29 20:06:37 -06:00
Makefile.am Fix additional S3 support issues 2021-10-29 20:06:37 -06:00
SimpleBinStream.h
zarr.c Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
zarr.h Fix additional S3 support issues 2021-10-29 20:06:37 -06:00
zattr.c Merge branch 'main' into ejh_quantize_2 2021-09-07 10:44:45 -06:00
zcache.h Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
zchunking.c More NCZarr optimizations 2021-01-06 13:35:59 -07:00
zchunking.h Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
zclose.c Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
zcreate.c Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
zcvt.c Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
zdebug.c Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
zdebug.h Significantly Improve Amazon S3 Cloud Storage Support 2021-09-27 18:36:33 -06:00
zdim.c Provide a Number of fixes/improvements to NCZarr 2020-11-19 17:01:04 -07:00
zdispatch.c Merge branch 'master' into zarrs3.dmh 2021-10-07 15:10:03 -06:00
zdispatch.h Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
zfile.c Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
zfilter.c Significantly Improve Amazon S3 Cloud Storage Support 2021-09-27 18:36:33 -06:00
zfilter.h Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
zgrp.c Provide a Number of fixes/improvements to NCZarr 2020-11-19 17:01:04 -07:00
zincludes.h Move to Version 2 NCZarr Extended Meta-Data 2021-07-17 16:55:30 -06:00
zinternal.c Significantly Improve Amazon S3 Cloud Storage Support 2021-09-27 18:36:33 -06:00
zinternal.h Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
zmap_file.c Significantly Improve Amazon S3 Cloud Storage Support 2021-09-27 18:36:33 -06:00
zmap_s3sdk.c Fix additional S3 support issues 2021-10-29 20:06:37 -06:00
zmap_zip.c Significantly Improve Amazon S3 Cloud Storage Support 2021-09-27 18:36:33 -06:00
zmap.c Significantly Improve Amazon S3 Cloud Storage Support 2021-09-27 18:36:33 -06:00
zmap.h Significantly Improve Amazon S3 Cloud Storage Support 2021-09-27 18:36:33 -06:00
zodom.c More NCZarr optimizations 2021-01-06 13:35:59 -07:00
zodom.h More NCZarr optimizations 2021-01-06 13:35:59 -07:00
zopen.c Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
zprov.c Additional Fixes to NCZarr 2020-12-16 20:48:02 -07:00
zprovenance.h
zs3sdk.cpp Significantly Improve Amazon S3 Cloud Storage Support 2021-09-27 18:36:33 -06:00
zsync.c Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
ztracedispatch.h Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
ztype.c
zutil.c Fix additional S3 support issues 2021-10-29 20:06:37 -06:00
zvar.c Merge branch 'main' into ejh_quantize_2 2021-09-07 10:44:45 -06:00
zwalk.c Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
zxcache.c Add filter support to NCZarr 2021-09-02 17:04:26 -06:00