Commit Graph

7815 Commits

Author SHA1 Message Date
Dennis Heimbigner
e1c470683c Fix merge error from PR https://github.com/Unidata/netcdf-c/pull/1892/files 2020-12-01 20:10:48 -07:00
Ward Fisher
c96722e001
Merge pull request #1890 from gsjaardema/patch-46
Fix undefined struct member access
2020-12-01 14:41:27 -07:00
Ward Fisher
9aef2dd70c Merge branch 'master' into add-github-actions.wif 2020-11-30 11:52:04 -07:00
Ward Fisher
3953fc2d8d
Merge pull request #1892 from DennisHeimbigner/httpfield.dmh
Enforce that !ENABLE_BYTERANGE => !ENABLE_HDF5_ROS3
2020-11-30 11:48:28 -07:00
Ward Fisher
1bc580d737
Merge pull request #1891 from DennisHeimbigner/revertbm.dmh
Remove some file references in nczarr_test/Makefile.am
2020-11-30 11:48:18 -07:00
Ward Fisher
1ba45b9e9a Adding github actions to netcdf-c for CI purposes. 2020-11-30 11:21:51 -07:00
Dennis Heimbigner
68bcd1122a Enforce that !ENABLE_BYTERANGE => !ENABLE_HDF5_ROS3
This is a follow on to PR https://github.com/Unidata/netcdf-c/pull/1890

Modify configure.ac to enforce that
!ENABLE_BYTERANGE => !ENABLE_HDF5_ROS3
2020-11-28 13:00:06 -07:00
Dennis Heimbigner
553f519176 remove actions file 2020-11-27 14:09:08 -07:00
Dennis Heimbigner
ed590d4076 remove actions file 2020-11-27 14:08:16 -07:00
Dennis Heimbigner
33154873e6 Remove some file references in nczarr_test/Makefile.am
Some file references in nczarr_test/Makefile.am
were included accidentally. So revert by removing those references.
2020-11-27 13:59:39 -07:00
Dennis Heimbigner
2be30b120e revert 2020-11-27 13:55:53 -07:00
Dennis Heimbigner
0135aa6318 remove nczarr_test/bm* 2020-11-27 13:33:19 -07:00
Dennis Heimbigner
6a6ff29059 remove bm_chunks3 2020-11-27 13:12:08 -07:00
Dennis Heimbigner
5550aea120 actions1 2020-11-26 13:48:22 -07:00
Dennis Heimbigner
c5d72067d7
Create c-cpp.yml 2020-11-26 13:37:00 -07:00
Greg Sjaardema
db0b84252c
Fix undefined struct member access
The `http` field of the hdf5 info struct is not defined unless `ENABLE_HDF5_ROS3` or `ENABLE_BYTERANGE` or `ENABLE_S3_SDK` is defined.  Based on a quick look at the code, I think that the `ENABLE_HDF5_ROS3` define is the relavant one here.  Maybe a better fix is to check if any of them are defined...
2020-11-24 08:25:29 -07:00
Ward Fisher
32b85d210b
Merge pull request #1887 from DennisHeimbigner/nczarr_cache.dmh
Provide a Number of fixes/improvements to NCZarr
2020-11-20 15:29:32 -07:00
Dennis Heimbigner
be6cefc708 missing ifdef 2020-11-20 13:11:34 -07:00
Dennis Heimbigner
c25ebd7787 Fix a number of CMake problems 2020-11-19 22:24:13 -07:00
Dennis Heimbigner
a6e3a2b629 Force re-check 2020-11-19 20:31:29 -07:00
Dennis Heimbigner
02b958f02c Update RELEASENOTES 2020-11-19 17:03:54 -07:00
Dennis Heimbigner
eb3d9eb0c9 Provide a Number of fixes/improvements to NCZarr
Primary changes:
* Add an improved cache system to speed up performance.
* Fix NCZarr to properly handle scalar variables.

Misc. Related Changes:
* Added unit tests for extendible hash and for the generic cache.
* Add config parameter to set size of the NCZarr cache.
* Add initial performance tests but leave them unused.
* Add CRC64 support.
* Move location of ncdumpchunks utility from /ncgen to /ncdump.
* Refactor auth support.

Misc. Unrelated Changes:
* More cleanup of the S3 support
* Add support for S3 authentication in .rc files: HTTP.S3.ACCESSID and HTTP.S3.SECRETKEY.
* Remove the hashkey from the struct OBJHDR since it is never used.
2020-11-19 17:01:04 -07:00
Ward Fisher
8279a078b0
Merge pull request #1885 from DennisHeimbigner/provenancefmt.dmh
Remove trailing comma from _NCProperties attribute value.
2020-11-17 10:58:13 -07:00
Dennis Heimbigner
d631656966 Remove trailing comma from _NCProperties attribute value.
If NCPROPERTIES_EXTRA (see configure.ac) is defined
but is null or empty, then an extra comma is being generated
at the end of _NCProperties global attribute.

Soln: check for null/empty NCPROPERTIES_EXTRA value.
2020-11-14 15:07:08 -07:00
Ward Fisher
2409ab4e5d
Merge pull request #1884 from DennisHeimbigner/encodeparam.dmh
Provide ability to control URL encoding for DAP2
2020-11-12 17:17:10 -07:00
Dennis Heimbigner
6d3546b8a0 Add encode= tests 2020-11-12 16:06:01 -07:00
Dennis Heimbigner
32f0bc2846 Merge branch 'encodeparam4.dmh' into encodeparam.dmh 2020-11-12 15:32:34 -07:00
Ward Fisher
1c37c573ba
Merge pull request #1882 from Unidata/restore_travis.wif
Restore .travis.yml file, but not dependency.
2020-11-12 08:38:53 -07:00
Ward Fisher
5b71b30c9a Restoring .travis.yml file for convienence until Github Actions are integrated, but not restoring the requirement that they pass (due to throttled Travis runs) for PR's to be merged. 2020-11-12 08:36:49 -07:00
Ward Fisher
fc8fb29bf4
Merge pull request #1881 from Unidata/remove_travis.wif
Removed travis file in preparation for migration away from travis-ci …
2020-11-11 16:45:25 -07:00
Ward Fisher
bbe4c538e3 Removed travis file in preparation for migration away from travis-ci and towards GitHub Actions. 2020-11-11 16:44:28 -07:00
Ward Fisher
5ff7553cf8
Merge pull request #1879 from Unidata/nctest_mem_fix.wif
Compilation failure in plugins/ when sanitizing memory
2020-11-11 14:49:24 -07:00
Ward Fisher
b590216005 Modified plugins/Makefile.am to add -no-undefined as required on cygwin. 2020-11-11 10:51:24 -07:00
Ward Fisher
1135b5af22 Remove --no-undefined which is causing problems when compiling with -fsanitize=address -fno-omit-frame-pointer in support of https://github.com/Unidata/netcdf-c/issues/1878 2020-11-10 11:14:28 -07:00
Dennis Heimbigner
793ecc8e60 Yet another fix for DAP2 double URL encoding.
re:  https://github.com/Unidata/netcdf-c/issues/1876
and: https://github.com/Unidata/netcdf-c/pull/1835
and: https://github.com/Unidata/netcdf4-python/issues/1041

The change in PR 1835 was correct with respect to using %20 instead of '+'
for encoding blanks. However, it was a mistake to assume everything was
unencoded and then to do encoding ourselves. The problem is that
different servers do different things, with Columbia being an outlier.

So, I have added a set of client controls that can at least give
the caller some control over this. The caller can append
the following fragment to his URL to control what gets encoded before
sending it to the server. The syntax is as follows:
````
https://<host>/<path>/<query>#encode=path|query|all|none
````

The possible values:
* path  -- URL encode (i.e. %xx encode) as needed in the path part of the URL.
* query -- URL encode as needed in the query part of the URL.
* all   -- equivalent to ````#encode=path,query````.
* none  -- do not url encode any part of the URL sent to the server; not strictly necessary, so mostly for completeness.

Note that if "encode=" is used, then before it is processed, all encoding
is turned of so that ````#encode=path```` will only encode the path
and not the query.

The default is ````#encode=query````, so the path is left untouched,
but the query is always encoded.

Internally, this required changes to pass the encode flags down into
the OC2 library.

Misc. Unrelated Changes:
* Shut up those irritating warning from putget.m4
2020-11-05 11:04:56 -07:00
Ward Fisher
c8a3c51c12
Merge pull request #1873 from Unidata/gh1870.wif
Removed duplicated release note.
2020-10-20 14:57:34 -06:00
Ward Fisher
9cbadb9462 Removed duplicated release note in support of https://github.com/Unidata/netcdf-c/pull/1870 2020-10-20 13:43:48 -06:00
Ward Fisher
c8915cff42
Merge pull request #1870 from Dave-Allured/gh1868.allured
More informative release note for time zone bug fix, Github #1866.
2020-10-20 09:34:13 -06:00
Ward Fisher
499087f7c5
Merge branch 'master' into gh1868.allured 2020-10-19 16:55:47 -06:00
Ward Fisher
75eb197dda
Merge pull request #1869 from DennisHeimbigner/s3build.dmh
Improve the building of NCZARR S3 support in CMake and Autoconf
2020-10-19 16:55:22 -06:00
Ward Fisher
66e42f09ad
Merge branch 'master' into gh1868.allured 2020-10-19 16:13:53 -06:00
Ward Fisher
174b0dafca
Merge branch 'master' into s3build.dmh 2020-10-19 16:10:33 -06:00
Ward Fisher
a00d333ae6
Merge pull request #1872 from Unidata/gh-d4align.wif
d4align fix + release notes
2020-10-19 15:36:55 -06:00
Ward Fisher
1affe00682 Updated release notes with reference to https://github.com/Unidata/netcdf-c/pull/1871 2020-10-19 14:22:23 -06:00
Dennis Heimbigner
044a4b2832 Suppress notused warnings 2020-10-19 13:32:09 -06:00
Dennis Heimbigner
26bf8186f3 Revise the arm test per https://github.com/Unidata/netcdf-c/issues/1854#issuecomment-711983794 2020-10-19 11:01:52 -06:00
Dennis Heimbigner
73c195e107 Support aligned access for selected Arm processors.
re: https://github.com/Unidata/netcdf-c/issues/1854

Apparently some older Arm processors will fail if asked to
read a 64 bit value from memory if not on an 8 byte boundary.
The primary problem is in reading counter values in the dap4 stream.
So if the Arm processor is detected, then memcpy the value
to an aligned 64 bit value before using it.
2020-10-17 15:19:37 -06:00
Dennis Heimbigner
f1248ce458 Update Release Notes 2020-10-16 21:23:27 -06:00
Dave Allured
cd5a9e1122
Update RELEASE_NOTES.md
More informative release note for time zone bug fix, Github #1866.
2020-10-16 19:14:18 -06:00
Dave Allured
d4109b249c
Merge pull request #1 from Unidata/master
Resync with master, 2020 Oct 16
2020-10-16 19:04:48 -06:00