Commit Graph

9099 Commits

Author SHA1 Message Date
Dennis Heimbigner
ebf86ac637 update against main 2023-01-28 13:45:35 -07:00
Dennis Heimbigner
d1d2808919 Additional DAP4 fixes
This change-set modifies PR https://github.com/Unidata/netcdf-c/pull/2555
to add the changes listed below. Most of these changes are required
by changes to the Java remotetest.unidata.ucar.edu server.

## DAP4 Related Changes
* Add tests *dap4_test/test_constraints.sh* and *dap4_test/test_hyrax.sh*.
* Provide explicit list of remotetest files to test.
* Cleanup local checksum computing and verification.
* Define a temporary Hyrax hack flag to deal with the way Hyrax handles checksums and add "#hyrax" fragment flag for it.
* Add a hack to get past an LGTM problem with using "http:".
* Improve debug support.

## Other Changes
* Cleanup the recipe in *docs/nczarr.md* for building *aws-sdk-cpp* library.
2023-01-18 19:47:29 -07:00
Dennis Heimbigner
9dfafe6c63 Bring up-to-date with main 2023-01-17 16:28:45 -07:00
Ward Fisher
17c7314a0b
Merge pull request #2560 from Unidata/v4.9.1-wellspring.wif
Merge Wellspring back into development branch
2023-01-10 15:47:35 -08:00
Ward Fisher
2a6c41caab
Merge pull request #2574 from DennisHeimbigner/loop.dmh
Fix infinite loop in file inferencing
2023-01-10 15:14:56 -08:00
Ward Fisher
b67583f0b1 Fix a doxygen warning-treated-as-error 2023-01-10 13:51:34 -08:00
Ward Fisher
00065451fc Merging https://github.com/Unidata/netcdf-c/pull/2583 manually into the v4.9.1 wellspring branch. 2023-01-10 13:42:41 -08:00
Ward Fisher
341a43b5aa Correct lingering merge issue. 2023-01-09 20:27:12 -08:00
Ward Fisher
4c27c59fea Update whitespace. 2023-01-09 20:26:05 -08:00
Ward Fisher
3e35a10aa5 Correct logic for running DAP4 tests when HDF5 is not enabled. 2023-01-09 16:40:51 -08:00
Ward Fisher
394cf6466e Correct version string change that should not have ended up in this branch. 2023-01-09 15:07:46 -08:00
Ward Fisher
bd0341256b Add libiconv-devel to cygwin CI 2023-01-09 14:55:30 -08:00
Ward Fisher
e02f678168 Correct libcurl development package. 2023-01-09 14:45:02 -08:00
Ward Fisher
19a1f9ec29 Add libcurl-dev to cygwin github actions 2023-01-09 14:43:50 -08:00
Ward Fisher
ecd48ae14e Cleaning up NCZARR_S3 summary, turning on byterange by default. 2023-01-09 13:48:54 -08:00
Ward Fisher
9ea273961b Added S3 status to libnetcdf.settings, turned byterange on by default. 2023-01-09 12:11:16 -08:00
Ward Fisher
435f16bcb9 Merge branch 'loop.dmh' of https://github.com/DennisHeimbigner/netcdf-c into v4.9.1-wellspring.wif 2023-01-04 14:07:34 -08:00
Ward Fisher
a71d77bcb9 Merge branch 'restore_old_doc.wif' of https://github.com/WardF/netcdf-c into v4.9.1-wellspring.wif 2022-12-20 10:39:38 -07:00
Ward Fisher
c228426c07 Fix a logic error re: DAP4 tests, when DAP4 is specified, but hdf5/netcdf4 support is disabled. 2022-12-19 16:57:36 -07:00
Ward Fisher
dd99d60294 Added another old static html page in preparation for updating. 2022-12-19 14:55:31 -07:00
Ward Fisher
9226b52ca5 Add an old static file. 2022-12-19 10:23:10 -07:00
Dennis Heimbigner
a03bb5e601 Fix infinite loop in file inferencing
re: Issue https://github.com/Unidata/netcdf-c/issues/2573

The file type inferencer in libdispatch/dinference.c has a simple
forward inference mechanism so that the occurrence of certain mode
values in a URL fragment implies inclusion of additional mode values.
This kind of inference is notorious for leading to cycles if not
careful. Unfortunately, this occurred in the one in dinference.c.

This was fixed by providing a more complicated, but more reliable inference
mechanism.

## Misc. Other Changes
* Found and fixed a couple of memory leaks.
* There is a recent problem in building HDF4 support on github actions. Fixed by using the internal HDF4 xdr capability.
* Some filter-related code was not being properly ifdef'd with ENABLE_NCZARRA_FILTERS.
2022-12-18 13:18:00 -07:00
Dennis Heimbigner
7fd059fc4e conflicts 2022-11-27 16:49:37 -07:00
Dennis Heimbigner
65eca292e6 Merge branch 'dap4tests2.tmp' into dap4tests2.dmh 2022-11-27 14:20:48 -07:00
Dennis Heimbigner
308398627e update 2022-11-27 14:20:06 -07:00
Ward Fisher
573e8924e1 DAP4 is back on for cmake-based builds. 2022-11-21 16:24:16 -07:00
Ward Fisher
74b4aae6c7 Update release date. 2022-11-18 15:08:24 -07:00
Ward Fisher
087d3b6c37 Supported headers for hdf4 are not installed in actions, and there does not appear (currently) to be an easy way to reinstall these. 2022-11-18 11:34:09 -07:00
Ward Fisher
19b8ae47bf Added target release date for RC2. 2022-11-17 14:56:54 -07:00
Ward Fisher
7559b86fbb Restore release date for 4.9.1 RC1 in release notes. 2022-11-17 14:56:03 -07:00
Ward Fisher
0fc2c817b2
Merge pull request #2559 from WardF/gh2132.wif
Add fenceposting for HAVE_DECL_ISINF and HAVE_DECL_ISNAN
2022-11-16 16:42:29 -07:00
Ward Fisher
4d63f03364 Fix mismatched arguments warning in CMakeLists.txt 2022-11-16 15:43:13 -07:00
Ward Fisher
ac7a080df8 Add a check for HAVE_DECL_ISINF and HAVE_DECL_ISNAN in support of https://github.com/Unidata/netcdf-c/issues/2132 2022-11-16 15:41:38 -07:00
Ward Fisher
c99f4f9378
Merge pull request #2557 from DennisHeimbigner/unknown.dmh
Suppress nczarr_test/tst_unknown filter test
2022-11-16 15:20:40 -07:00
Dennis Heimbigner
d06901f7d1 Suppress mistaken LGTM warnings 2022-11-15 20:54:01 -07:00
Dennis Heimbigner
591e6b2f6d Fix DAP4 remotetest server
Warning: This PR is a follow on to PR https://github.com/Unidata/netcdf-c/pull/2555 and should not be merged until that prior PR has been merged. The changeset for this PR is a delta on the PR https://github.com/Unidata/netcdf-c/pull/2555.

This PR re-enables the use of the server *remotetest.unidata.ucar.edu/d4ts*
to test several features:
1. Show that access over the Internet to servers using the DAP4 protocol works.
2. Test that DAP4 support in the [Thredds Data Server](https://github.com/Unidata/tds) is operating correctly.
4. Test that the DAP4 support in the [netcdf-java library](https://github.com/Unidata/netcdf-java) library and the DAP4 support in the netcdf-c library are consistent and are interoperable.

The test inputs (primarily *\*.nc* files) provided in the netcdf-c library
are also used by the DAP4 Test Server (aka d4ts) to present web access to a
collection of data files accessible via the DAP4 protocol and which can be
used for testing Internet access to a working server.

To be precise, this version of d4ts is currently in unmerged branches
of the *netcdf-java* and *tds* Github repositories and so are not actually
in the main repositories *yet*. However, the *d4ts.war* file was created
from that branch and used to populate the *remotetest.unidata.ucar.edu*
server

The two other remote servers that were used in the past are *Hyrax* (OPenDAP.org)
and *thredds-test*. These will continue to remain disabled until
those servers can be fixed.

## Primary Changes

* Rebuild the *baselineremote* directory. This directory contains the validation data needed to test the remote servers.
* Re-enable using remotetest.unidata.ucar.edu as part of the DAP4 testing process.
* Fix the *dap4_test/test_remote.sh* test script to match the current available test data.
* Make some changes to libdap4 to improve the ability to catch malformed data streams [affects a lot of files in libdap4].

## Misc. Unrelated Changes

* Remove a raft of warnings, especially in nc_test4/tst_quantize.c.
* Add some additional explanatory information to the NCZarr documentation.
* Cleanup some Doxygen errors in the docs file and reorder some files.
2022-11-15 20:29:21 -07:00
Dennis Heimbigner
6c7fa04e7a merged 2022-11-15 20:02:42 -07:00
Dennis Heimbigner
6df45e6e3b unpush 2022-11-15 19:59:11 -07:00
Dennis Heimbigner
d0ca17e763 update .yml 2022-11-15 19:57:56 -07:00
Dennis Heimbigner
53a3e9ad86 retry 2022-11-15 18:56:25 -07:00
Dennis Heimbigner
a118edc453 retry1 2022-11-15 16:19:50 -07:00
Dennis Heimbigner
887c22c681 Update Release Notes 2022-11-15 16:17:59 -07:00
Dennis Heimbigner
d37147d0ce Suppress nczarr_test/tst_unknown filter test (and its nczarr_test equivalen)
The test case nc_test4/tst_unknown.sh deletes and then restores
a filter in the plugins directory. The test nczarr_test/run_unknown.sh
also does this.  However if both are running at the same time in a
parallel bit, they apparently can interfere and can cause a race
condition failure.

The solution is to suppress one of them. Since nczarr code
is more unstable, we need to run this test. So suppress the
corresponding test in nc_test4.
2022-11-15 16:15:32 -07:00
Dennis Heimbigner
a9bf5253ba test1 2022-11-15 14:59:48 -07:00
Dennis Heimbigner
1a5f97bcee test1 2022-11-15 13:58:17 -07:00
Dennis Heimbigner
67dbe34f30 warnings 2022-11-14 21:22:57 -07:00
Dennis Heimbigner
fdeae3b0f8 push 2022-11-14 19:53:34 -07:00
Dennis Heimbigner
c1bb174ecd switch 2022-11-14 19:30:28 -07:00
Dennis Heimbigner
5d0f1ca907 debug3 2022-11-14 18:53:30 -07:00
Dennis Heimbigner
a0b05758b6 debug1 2022-11-14 18:37:25 -07:00