netcdf-c/nc_test
Dennis Heimbigner 6b69b9c52c Significantly Improve Amazon S3 Cloud Storage Support
## S3 Related Fixes

* Add comprehensive support for specifying AWS profiles to provide access credentials.
* Parse the files "~/.aws/config" and "~/.aws/credentials to provide credentials for the HDF5 ROS3 driver and to locate default region.
* Add a function to obtain the currently active S3 credentials. The search rules are defined in docs/nczarr.md.
* Provide documentation for the new features.
* Modify the struct NCauth (in include/ncauth.h) to replace specific S3 credentials with a profile name.
* Add a unit test to test the operation of profile and credentials management.
* Add support for URLS of the form "s3://<bucket>/<key>"; this requires obtaining a default region.
* Allows the specification of profile and/or region in a URL of the form "#mode=nczarr,...&aws.region=...&aws.profile=..."

## Misc. Fixes

* Move the ezxml code to libdispatch so that it can be used both by DAP4 and nczarr.
* Modify nclist to provide a deep clone operation.
* Modify ncuri to provide a deep clone operation.
* Modify the .rc file format to allow the specification of a path to be tested when looking for an entry in the .rc file.
* Ensure that the NC_rcload function is called.
* Modify nchttp to support setting request headers.
2021-09-27 18:36:33 -06:00
..
bad_cdf5_begin.nc
CMakeLists.txt Codify cross-platform file paths 2021-03-04 13:41:31 -07:00
error.c More copyright stanza updates. 2018-12-06 14:56:42 -07:00
error.h More copyright stanza updates. 2018-12-06 14:56:42 -07:00
f03tst_open_mem.nc
large_files.c More copyright stanza updates. 2018-12-06 14:56:42 -07:00
make_test_file.sh
Makefile.am Codify cross-platform file paths 2021-03-04 13:41:31 -07:00
nc_enddef.cdl
nc_sync.cdl
nc_test.c Turn verbose output on in nc_test. 2021-06-16 16:34:06 -06:00
nc_test.html
quick_large_files.c Spelling fixes 2019-09-18 08:03:01 -06:00
ref_tst_diskless2.cdl
ref_tst_diskless3_create.cdl Fix cmake X mmap 2019-04-19 20:32:26 -06:00
ref_tst_diskless3_open.cdl Fix cmake X mmap 2019-04-19 20:32:26 -06:00
ref_tst_http_nc3.cdl Use the built-in HDF5 byte-range reader, if available. 2020-09-24 14:33:58 -06:00
ref_tst_http_nc4a.cdl Use the built-in HDF5 byte-range reader, if available. 2020-09-24 14:33:58 -06:00
ref_tst_http_nc4b.cdl Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
ref_tst_http_nc4c.cdl Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
run_cdf5.sh
run_diskless2.sh Fix more memory leaks in netcdf-c library 2018-11-15 10:00:38 -07:00
run_diskless5.sh
run_diskless.sh Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
run_inmemory.sh Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
run_mmap.sh Fix cmake X mmap 2019-04-19 20:32:26 -06:00
run_pnetcdf_test.sh Use PnetCDF instead of parallel-netcdf to avoid confusion with 2018-09-17 17:18:48 -05:00
t_nc_p5.c More copyright stanza updates. 2018-12-06 14:56:42 -07:00
t_nc.c More copyright stanza updates. 2018-12-06 14:56:42 -07:00
test_byterange.sh Significantly Improve Amazon S3 Cloud Storage Support 2021-09-27 18:36:33 -06:00
test_get.m4 Eliminate a lot of 'result of operation is undefined or garbage' errors reported by static analysis. These errors appeared to be false positives as there was logic that should prevent their occurance, but it's possible that optimization would result in these error states occuring. 2021-07-12 16:40:27 -06:00
test_put.m4 Fix an accidentally-introduced bug. 2021-07-13 12:07:56 -06:00
test_read.m4 Eliminate a lot of 'result of operation is undefined or garbage' errors reported by static analysis. These errors appeared to be false positives as there was logic that should prevent their occurance, but it's possible that optimization would result in these error states occuring. 2021-07-12 16:40:27 -06:00
test_write.m4 Eliminate a lot of 'result of operation is undefined or garbage' errors reported by static analysis. These errors appeared to be false positives as there was logic that should prevent their occurance, but it's possible that optimization would result in these error states occuring. 2021-07-12 16:40:27 -06:00
testnc3perf.c cleaned up makefile.am, added config.h to some tests 2019-01-02 05:31:15 -07:00
tests.h windows: detect Windows using the correct define name 2019-11-07 07:55:47 -05:00
tst_addvar.c cleaned up makefile.am, added config.h to some tests 2019-01-02 05:31:15 -07:00
tst_atts3.c fixed comment 2020-08-12 07:59:45 -06:00
tst_big_rvar.c Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
tst_big_var2.c Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
tst_big_var6.c Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
tst_big_var.c Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
tst_byterange.c Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
tst_cdf5_begin.c cleaned up makefile.am, added config.h to some tests 2019-01-02 05:31:15 -07:00
tst_cdf5format.c Added int i and j declarations 2019-02-12 15:10:39 +00:00
tst_def_var_fill.c Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
tst_default_format_pnetcdf.c Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
tst_default_format.c Merge remote-tracking branch 'origin/license_update.wif' into pr-aggregation.wif 2018-12-11 17:08:21 -05:00
tst_diskless2.c Fix cmake X mmap 2019-04-19 20:32:26 -06:00
tst_diskless3.c Spelling fixes 2019-09-18 08:03:01 -06:00
tst_diskless4.c More copyright stanza updates. 2018-12-06 14:56:42 -07:00
tst_diskless5.c cleaned up makefile.am, added config.h to some tests 2019-01-02 05:31:15 -07:00
tst_diskless5.cdl
tst_diskless6.c More copyright stanza updates. 2018-12-06 14:56:42 -07:00
tst_diskless.c Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
tst_err_enddef.c Addendum: This PR has been extended to include 2021-04-02 18:39:50 -06:00
tst_formats.c Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
tst_formatx_pnetcdf.c warnings fixes 2019-01-03 07:07:13 -07:00
tst_global_fillval.c Merge remote-tracking branch 'origin/license_update.wif' into pr-aggregation.wif 2018-12-11 17:08:21 -05:00
tst_inmemory.c Remove need for HDF5-1.6 API being defined 2021-04-28 13:59:24 -06:00
tst_inq_type.c merged ejh_test_null_vars_stride this time I mean it! 2019-01-03 06:36:58 -07:00
tst_large_cdf5.c Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
tst_large.c Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
tst_max_var_dims.c cleaned up makefile.am, added config.h to some tests 2019-01-02 05:31:15 -07:00
tst_meta.c cleaned up makefile.am, added config.h to some tests 2019-01-02 05:31:15 -07:00
tst_misc.c Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
tst_names.c Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
tst_nofill2.c More copyright stanza updates. 2018-12-06 14:56:42 -07:00
tst_nofill3.c Spelling fixes 2019-09-18 08:03:01 -06:00
tst_nofill.c More copyright stanza updates. 2018-12-06 14:56:42 -07:00
tst_norm.c More copyright stanza updates. 2018-12-06 14:56:42 -07:00
tst_open_cdf5.c More copyright stanza updates. 2018-12-06 14:56:42 -07:00
tst_open_mem.c Remove need for HDF5-1.6 API being defined 2021-04-28 13:59:24 -06:00
tst_parallel2.c More copyright stanza updates. 2018-12-06 14:56:42 -07:00
tst_pnetcdf.c merged master 2019-01-02 03:52:51 -07:00
tst_small.c Spelling fixes 2019-09-18 08:03:01 -06:00
tst_utf8_phrases.c Spelling fixes 2019-09-18 08:03:01 -06:00
tst_utf8_validate.c Testing a fix for a failure I observed. 2018-12-06 17:46:30 -07:00
util.c merged ejh_test_null_vars_stride this time I mean it! 2019-01-03 06:36:58 -07:00