Commit Graph

9417 Commits

Author SHA1 Message Date
Dennis Heimbigner
8ee9453043 valg2 2023-04-26 13:20:54 -06:00
Dennis Heimbigner
5dd237246f fault1 2023-04-26 13:03:21 -06:00
Dennis Heimbigner
3eaa4bbb2c valgrind1 2023-04-26 12:38:11 -06:00
Dennis Heimbigner
5058903053 debug2 2023-04-26 12:14:23 -06:00
Dennis Heimbigner
f6f4b89f39 cyg1 2023-04-25 20:27:59 -06:00
Dennis Heimbigner
49737888ca Improve S3 Documentation and Support
## Improvements to S3 Documentation
* Create a new document *quickstart_paths.md* that give a summary of the legal path formats used by netcdf-c. This includes both file paths and URL paths.
* Modify *nczarr.md* to remove most of the S3 related text.
* Move the S3 text from *nczarr.md* to a new document *cloud.md*.
* Add some S3-related text to the *byterange.md* document.

Hopefully, this will make it easier for users to find the information they want.

## Rebuild NCZarr Testing
In order to avoid problems with running make check in parallel, two changes were made:
1. The *nczarr_test* test system was rebuilt. Now, for each test.
any generated files are kept in a test-specific directory, isolated
from all other test executions.
2. Similarly, since the S3 test bucket is shared, any generated S3 objects
are isolated using a test-specific key path.

## Other S3 Related Changes
* Add code to ensure that files created on S3 are reclaimed at end of testing.
* Used the bash "trap" command to ensure S3 cleanup even if the test fails.
* Cleanup the S3 related configure.ac flag set since S3 is used in several places. So now one should use the option *--enable-s3* instead of *--enable-nczarr-s3*, although the latter is still kept as a deprecated alias for the former.
* Get some of the github actions yml to work with S3; required fixing various test scripts adding a secret to access the Unidata S3 bucket.
* Cleanup S3 portion of libnetcdf.settings.in and netcdf_meta.h.in and test_common.in.
* Merge partial S3 support into dhttp.c.
* Create an experimental s3 access library especially for use with Windows. It is enabled by using the options *--enable-s3-internal* (automake) or *-DENABLE_S3_INTERNAL=ON* (CMake). Also add a unit-test for it.
* Move some definitions from ncrc.h to ncs3sdk.h

## Other Changes
* Provide a default implementation of strlcpy and move this and similar defaults into *dmissing.c*.
2023-04-25 17:15:06 -06:00
Dennis Heimbigner
7df6118e02 Update WRT main 2023-04-25 15:00:17 -06:00
Peter Hill
120c4c5320
Merge branch 'main' into hdf5-transient-types
* main: (56 commits)
  Fix a mismatched if,endif block label.
  Update issue with make distcheck
  Update dap4_test for systems without getopt
  Missed unit_test
  Update release notes
  Fix bug in szip handling.
  Update release notes
  "Simplify" XGetopt usage
  added fortran
  documenting logging
  documenting logging
  documenting logging
  Fix issue #2674
  Update to latest main
  ubuntufix1
  ub1"
  bad file reference
  oops
  Maintainer mode should only be turned on prior to minting a release.
  Fix run_jsonconvention.sh to be resilient against irrelevant changes to _NCProperties.
  ...
2023-04-18 09:20:09 +01:00
Dennis Heimbigner
8ade49c772 merged 2023-04-17 14:59:30 -06:00
Dennis Heimbigner
2bed69ab25 Merge remote-tracking branch 'Unidata/main' 2023-04-13 12:30:06 -06:00
Dennis Heimbigner
e9ddb16474 Update release notes 2023-04-12 22:21:18 -06:00
Ward Fisher
b30b4e87cf
Merge pull request #2658 from DennisHeimbigner/znotnc.dmh
Check at nc_open if file appears to be in NCZarr/Zarr format.
2023-04-12 21:44:53 -06:00
Dennis Heimbigner
a6b0348e9d Fix some race conditions between some ncdump tests.
There are apparently some dependency conditions between ncdump/tst_nccopy4.sh and ncdump/tst_netcdf4.sh.
Fixed by creating a per-test directory into which all created intermediates are stored. Also created a test_ncdump.sh file to hold common code.

## Other Changes
* Remove some uses of strlcat from plugin-related code because strlcat is not always defined on some platforms and the plugin code generally should not rely on accessing libnetcdf.
* Cleanup the handling of test plugins.
2023-04-12 20:37:03 -06:00
Dennis Heimbigner
8fac3b479d Merge remote-tracking branch 'Unidata/main' 2023-04-12 19:43:46 -06:00
Ward Fisher
1e5d82c8c0 Fix a mismatched if,endif block label. 2023-04-12 16:07:57 -06:00
Ward Fisher
dc6e392c9d
Merge branch 'main' into znotnc.dmh 2023-04-12 16:02:34 -06:00
Ward Fisher
f8904d5a1d
Merge pull request #2675 from uweschulzweida/issue_#2674
Fix issue #2674
2023-04-12 15:48:10 -06:00
Ward Fisher
3b18188499
Merge pull request #2681 from WardF/DAP4_remotetest_server.wif
Combine DAP4 test server fixes, resolve a couple conflicts.
2023-04-12 15:40:29 -06:00
Ward Fisher
090f4507b0 Update issue with make distcheck 2023-04-12 14:14:38 -06:00
Ward Fisher
7c48b58a46 Update dap4_test for systems without getopt 2023-04-12 14:05:38 -06:00
Dennis Heimbigner
33297862d4 update to current main 2023-04-12 12:14:01 -06:00
Ward Fisher
c8b3b37b1a Merge branch 'dap4tests2.dmh' of https://github.com/DennisHeimbigner/netcdf-c 2023-04-11 16:42:32 -06:00
Ward Fisher
9459f92f1f
Merge branch 'main' into dap4tests1.dmh 2023-04-11 16:23:48 -06:00
Ward Fisher
91591d37a0
Merge pull request #2660 from Unidata/v4.9.2-wellspring.wif
v4.9.2 Wellspring branch
2023-04-11 15:32:26 -06:00
Ward Fisher
aa2bec7df0
Merge pull request #2677 from edwardhartnett/ejh_logging_docs
Add documentation for logging
2023-04-11 15:30:31 -06:00
Ward Fisher
de71e2ea3b
Merge pull request #2679 from DennisHeimbigner/noszip.dmh
Fix bug in szip handling.
2023-04-11 14:31:46 -06:00
Ward Fisher
a42a218d5b
Merge pull request #2678 from DennisHeimbigner/xgetopt.dmh
"Simplify" XGetopt usage
2023-04-11 14:31:07 -06:00
Dennis Heimbigner
f80cbc2959 Missed unit_test 2023-04-10 16:07:34 -06:00
Dennis Heimbigner
1d8684a42b Update release notes 2023-04-09 15:53:24 -06:00
Dennis Heimbigner
822998ab7f Remove obsolete code
re: https://github.com/Unidata/netcdf-c/pull/2179

The above PR cleaned up reclaiming of complex type instances.
As a temporary measure, the old code was left in place demarcated
by ````#ifdef SEPDATA````.

Since it appears that this change was successful, this PR removes
that old SEPDATA marked code.
2023-04-09 15:28:36 -06:00
Dennis Heimbigner
10828c5fda undo 2023-04-09 13:52:34 -06:00
Dennis Heimbigner
75bfaba966 Update release notes 2023-04-09 13:30:42 -06:00
Dennis Heimbigner
49ade9eb0b Fix bug in szip handling.
The list of filters in libnetcdf.settings was not properly
including szip because of an incorrect tag.
2023-04-09 13:28:14 -06:00
Dennis Heimbigner
6c7a718e24 Update release notes 2023-04-09 13:21:57 -06:00
Dennis Heimbigner
3765d86e46 "Simplify" XGetopt usage
When "getopt()" is not available, various of the netcdf-c utilities
use XGetopt instead. This occurs primarily when building under Window,
so the build changes are restricted to CMake.

This PR tries to isolate XGetopt.c to the libdispatch directory
and then builds the various utilities using this cliche:
````
IF(USE_X_GETOPT)
  SET(XGETOPTSRC "${CMAKE_CURRENT_SOURCE_DIR}/../libdispatch/XGetopt.c")
ENDIF()
````

This avoids the need to copy XGetopt.c to all the directories that
use it.
2023-04-09 13:10:41 -06:00
Edward Hartnett
0c20199272 added fortran 2023-04-06 10:04:12 -06:00
Edward Hartnett
ad292eb06a documenting logging 2023-04-06 09:10:15 -06:00
Edward Hartnett
397912bbde documenting logging 2023-04-06 09:05:19 -06:00
Edward Hartnett
ea8d8dd05b documenting logging 2023-04-06 08:04:57 -06:00
uweschulzweida
b0d6fc70b4
Fix issue #2674 2023-04-05 18:05:53 +02:00
Dennis Heimbigner
5b42e382b0 Update to latest main 2023-04-04 18:37:20 -06:00
Dennis Heimbigner
2aee428ee4 ubuntufix1 2023-04-04 14:28:32 -06:00
Dennis Heimbigner
0ca921f721 ub1" 2023-04-04 13:15:27 -06:00
Conrad Poelman
532137d94f
CMakeLists.txt use ON vs YES, indent
In CMake logically ON, YES, TRUE, 1 are equivalent. But many CMake editors won't syntax highlight a lower-case "yes", and CMake-gui will change them to ON, creating unnecessary changes to CMakeCache.txt. Also indent a WIN32 if/then block.
2023-03-19 21:02:58 -04:00
Dennis Heimbigner
d7d216a3f5 Merge branch 'master' into dap4tests2.dmh 2023-03-16 14:03:29 -06:00
Dennis Heimbigner
2971d9731d Merge branch 'master' into dap4tests1.dmh 2023-03-16 14:02:49 -06:00
Dennis Heimbigner
17218d788a bad file reference 2023-03-14 20:25:36 -06:00
Dennis Heimbigner
250604582a oops 2023-03-14 14:48:30 -06:00
Ward Fisher
5ea154da96 Maintainer mode should only be turned on prior to minting a release. 2023-03-14 14:29:56 -06:00
Dennis Heimbigner
d738e03f5b Update 2023-03-14 14:14:44 -06:00