Commit Graph

9734 Commits

Author SHA1 Message Date
Ward Fisher
127830e49f Shot in the dark 2023-10-24 11:42:49 -06:00
Ward Fisher
4483760d32 Adjust workflow secrets syntax. 2023-10-24 11:30:56 -06:00
Ward Fisher
ee9c9d91aa Try a different syntax. 2023-10-24 11:25:02 -06:00
Ward Fisher
dcad99082d Remove sensitive info being sent to standard output when using ctest scripts. 2023-10-24 11:13:04 -06:00
Ward Fisher
4615695091 Playing around trying to nail down syntax for accessing secrets in Github Actions. 2023-10-24 11:00:17 -06:00
Ward Fisher
74df474ac7 Adjust github action config file syntax. 2023-10-24 10:55:57 -06:00
Ward Fisher
88ecadfdb0 Adjust syntax. 2023-10-24 10:51:20 -06:00
Ward Fisher
4e7a864c23 Working on automating cdash access on github. 2023-10-24 10:48:51 -06:00
Ward Fisher
794ff5adad Turn off coverage testing in ctest_serial.ctest. 2023-10-24 10:39:44 -06:00
Ward Fisher
7ab20391d2 Add coverage testing to a specific test. 2023-10-24 10:39:11 -06:00
Ward Fisher
7a28aefa52 Reduce cdash/ctest-based script matrix. 2023-10-24 10:32:31 -06:00
Ward Fisher
7d9baced0e Correct issue with test file. 2023-10-24 10:28:51 -06:00
Ward Fisher
b41c33805a Update cdash script file. 2023-10-24 10:18:58 -06:00
Ward Fisher
df5261ce0c Correct issue with file. 2023-10-24 10:17:13 -06:00
Ward Fisher
bce53cae08 Add first script to try to embed cdash scripts into CI. 2023-10-24 10:15:25 -06:00
Peter Hill
523c648e5d
CMake: Don't add uninstall target and CPack config if not top-level
Fixes #2597
2023-10-23 10:20:29 +01:00
Peter Hill
5ee66e87ac
CMake: Export targets so the build directory can be used directly 2023-10-20 17:47:18 +01:00
Ward Fisher
cb61d34185
Merge pull request #2767 from ZedThree/fix-ncvlog-loglevel
Fix bug with displaying log messages
2023-10-19 09:52:15 -06:00
Ward Fisher
3e2971dbfd
Merge branch 'main' into tinyxmlupdate.dmh 2023-10-17 15:35:59 -06:00
Ward Fisher
155ee9319a
Merge pull request #2759 from WardF/fix-s3-try2.wif
Address Windows and MacOS s3 issues
2023-10-16 16:48:13 -06:00
Ward Fisher
54102a3cea Update path in s3sdk shell script unit test. 2023-10-16 14:30:43 -06:00
Ward Fisher
4bd9c2e8b0 Removed leading slash on run_interop in nczarr_test. 2023-10-13 15:02:58 -06:00
Ward Fisher
84af03eaa2 Working on the last few s3 issues currently manifesting using S3_INTERNAL and WITH_S3_TESTING on Windows and MSYS2. 2023-10-13 11:32:27 -06:00
Dennis Heimbigner
0701250bbc Update release notes 2023-10-12 16:25:18 -06:00
Dennis Heimbigner
24e49b818e Update internal tinyxml2 code to the latest version
Periodic update of the internal tinyxml2 code for processing
XML.  This also required some changes to the "tinyxml2" target
in libncxml/Makefile.am to modify the code to compile in the
netcdf-c environment.
2023-10-12 16:22:47 -06:00
Ward Fisher
15d3e03eb0 Merge branch 'main' into fix-s3-try2.wif 2023-10-10 09:41:36 -06:00
Ward Fisher
a01fa386d8
Merge pull request #2769 from WardF/fix_cmake_script_tests.wif
Revert a change made in d3c2cf236 that is proving confounding in MSYS2 bash
2023-10-10 09:40:35 -06:00
Ward Fisher
17a7577701 Revert a change made in d3c2cf236 that is proving confounding in MSYS2-based bash environments. 2023-10-09 10:51:13 -06:00
Ward Fisher
5f5f908a96 Remove vestigial file glob stanza 2023-10-09 10:18:04 -06:00
Peter Hill
fabd3b2b99
Fix bug with displaying log messages
One of the changes in df3636b introduced the ability to filter log
messages by level. This fixes a typo that flipped the intended
filtering, so that `NCLOGOFF` _enabled_ all messages instead of
_disabling_ them.
2023-10-09 10:47:39 +01:00
Dennis Heimbigner
fe3ee02859 Update release notes 2023-10-08 20:40:24 -06:00
Dennis Heimbigner
5fa2defc7e Improve fetch performance of DAP4
Prior to this PR, DAP4 always fetched the whole (constrained) dataset
This PR changes the query processing so
1. It reads data on a per-variable request (equivalent to calling nc_get_var()).
2. It tracks a response for every query.

Most of the changes reflect having to do per-variable requests.
In any case, doing all this significantly reduces the amount of data transmitted and hence speeds up DAP4 requests.
2023-10-08 19:59:28 -06:00
Dennis Heimbigner
23f3c8f55a update release notes 2023-10-08 15:17:45 -06:00
Dennis Heimbigner
948304a79f Fix Proxy problem for DAP2
re: Issue https://github.com/Unidata/netcdf-c/issues/2752

The authorization setup when using a proxy is apparently not
being used, or used incorrectly.

This PR ensures that the relevant curl options, specifically
CURLOPT_VERIFYHOST and CURLOPT_VERIFYPEER, are properly setup.
As part of this, the ability to turn off these options was fixed.
Note that no testing of this PR is currently possible because we
do not have access to a proxy.
2023-10-08 14:38:07 -06:00
Dennis Heimbigner
78d4d80139 Update release notes 2023-10-08 13:47:21 -06:00
Dennis Heimbigner
1552d894a2 Cleanup a number of issues.
re: Issue https://github.com/Unidata/netcdf-c/issues/2748

This PR fixes a number of issues and bugs.

## s3cleanup fixes
* Delete extraneous s3cleanup.sh related files.
* Remove duplicate s3cleanup.uids entries.

## Support the Google S3 API
* Add code to recognize "storage.gooleapis.com"
* Add extra code to track the kind of server being accessed: unknown, Amazon, Google.
* Add a new mode flag "gs3" (analog to "s3") to support this api.
* Modify the S3 URL code to support this case.
* Modify the listobjects result parsing because Google returns some non-standard XML elements.
* Change signature and calls for NC_s3urlrebuild.

## Handle corrupt Zarr files where shape is empty for a variable.
Modify behavior when a variable's "shape" dictionary entry.
Previously it returned an error, but now it suppresses such a variable.
This change makes it possible to read non-corrupt data from the file.
Also added a test case.

## Misc. Other Changes
* Fix the nclog level handling to suppress output by default.
* Fix de-duplicates code in ncuri.c
* Restore testing of iridl.ldeo.columbia.edu.
* Fix bug in define_vars() which did not always do a proper reclaim between variables.
2023-10-08 11:22:52 -06:00
Magnus Ulimoen
ed53598aac Do not run test unless required 2023-10-06 13:48:00 +02:00
Ward Fisher
8b5f1e239c
Merge pull request #2760 from WardF/doc-update2.wif 2023-10-05 19:43:51 -06:00
Ward Fisher
74ecacffb5 Updated static software.html page with reference to met.3d 2023-10-05 16:06:47 -06:00
Ward Fisher
b62da98420
Merge pull request #2757 from ZedThree/cmake-fix-hdf5-zlib-check
CMake: Change header in check for HDF5 zlib/szip support
2023-10-02 16:22:55 -06:00
Ward Fisher
80c746981d
Merge pull request #2758 from ZedThree/cmake-fix-linking-mpi
CMake: Ensure all libraries link against MPI if needed
2023-10-02 16:20:43 -06:00
Ward Fisher
375e5105ff Update Release Notes 2023-10-02 10:14:18 -06:00
Ward Fisher
140cb83695
Merge pull request #2755 from DennisHeimbigner/s3interfere.dmh
Mitigate S3 test interference + Unlimited Dimensions in NCZarr
2023-10-02 10:07:12 -06:00
Peter Hill
d4412df2da
CMake: Ensure MPI dependency is found in installed config 2023-10-02 10:51:02 +01:00
Peter Hill
f71d05988e
CMake: Make plugin target links public 2023-10-02 10:31:24 +01:00
Peter Hill
18c813b20b
CMake: Ensure all libraries link against MPI if needed 2023-10-02 10:31:24 +01:00
Peter Hill
b6cb581cec
CMake: Change header in check for HDF5 zlib/szip support
H5public.h might require MPI headers which we haven't found at this
point

Fixes #2742
2023-10-02 10:13:26 +01:00
Ward Fisher
234df46828 Merge branch 's3interfere.dmh' of github.com:DennisHeimbigner/netcdf-c into s3interfere.dmh 2023-09-29 16:10:20 -06:00
Ward Fisher
8337c64676 Add missing file. 2023-09-29 16:10:08 -06:00
Dennis Heimbigner
055ac8d610 Merge branch 's3interfere.dmh' of https://github.com/DennisHeimbigner/netcdf-c into s3interfere.dmh 2023-09-29 15:57:35 -06:00