netcdf-c/unit_test/run_aws.sh
Dennis Heimbigner 6b69b9c52c Significantly Improve Amazon S3 Cloud Storage Support
## S3 Related Fixes

* Add comprehensive support for specifying AWS profiles to provide access credentials.
* Parse the files "~/.aws/config" and "~/.aws/credentials to provide credentials for the HDF5 ROS3 driver and to locate default region.
* Add a function to obtain the currently active S3 credentials. The search rules are defined in docs/nczarr.md.
* Provide documentation for the new features.
* Modify the struct NCauth (in include/ncauth.h) to replace specific S3 credentials with a profile name.
* Add a unit test to test the operation of profile and credentials management.
* Add support for URLS of the form "s3://<bucket>/<key>"; this requires obtaining a default region.
* Allows the specification of profile and/or region in a URL of the form "#mode=nczarr,...&aws.region=...&aws.profile=..."

## Misc. Fixes

* Move the ezxml code to libdispatch so that it can be used both by DAP4 and nczarr.
* Modify nclist to provide a deep clone operation.
* Modify ncuri to provide a deep clone operation.
* Modify the .rc file format to allow the specification of a path to be tested when looking for an entry in the .rc file.
* Ensure that the NC_rcload function is called.
* Modify nchttp to support setting request headers.
2021-09-27 18:36:33 -06:00

28 lines
575 B
Bash
Executable File

#!/bin/sh
if test "x$srcdir" = x ; then srcdir=`pwd`; fi
. ../test_common.sh
set -e
export NC_TEST_AWS_DIR=`pwd`
rm -fr ./.aws
mkdir .aws
cat >.aws/config <<EOF
[default]
aws_access_key_id=ACCESSKEYDEFAULTXXXX
aws_secret_access_key=DEFAULT/ef0ghijklmnopqr/defaultxxxxxxxxx
[ncar]
aws_access_key_id=ACCESSKEYNCARXXXXXXX
aws_secret_access_key=NCAR/ef0ghijklmnopqr/ncarxxxxxxxxxxxxxxx
[unidata]
aws_access_key_id=ACCESSKEYUNIDATAXXXX
aws_secret_access_key=UNIDATA/ef0ghijklmnopqr/unidataxxxxxxxxx
aws_region=us-west-1
EOF
${execdir}/test_aws