Commit Graph

1159 Commits

Author SHA1 Message Date
Ward Fisher
62583f1371
Merge pull request #2969 from mannreis/awsconfig
[S3] Parse AWS configuration with support for profile section
2024-08-20 14:59:51 -06:00
Ed
bf18f34916 added documentation for start/count/stride mandating same size arrays as data variable 2024-08-16 06:04:46 -06:00
Shaway
503aeb7d58
fix ncuriparse error 2024-08-11 09:14:06 +08:00
Shaway
bfdef0eecb
fix ncuriparse error,Correctly remove leading and trailing whitespace 2024-08-10 14:38:16 +08:00
Manuel Reis
b05e95ec50 Parse AWS configuration with support for profile section 2024-08-07 17:55:49 +02:00
Dennis Heimbigner
78f259ab48 Provide Documentation for the .rc File Mechanism and API
re: Issue https://github.com/Unidata/netcdf-c/issues/2952

The documentation -- such as it is -- is lost inside
docs/auth.md. So, create docs/quickstart_env.md to describe how
.rc file mechanism is used, and include the netcdf-c API.  Also
add list of environment variables used by the netcdf-c library.
2024-07-30 13:51:32 -06:00
Ward Fisher
848e85171a Mitigate extreme slowdown on systems without xattr.h or getfattr. Standard output was being spammed, resulting in a test that currently runs in around a minute to balloon out to almost 20. 2024-07-16 12:19:16 -06:00
Ward Fisher
e5973deda1 Merge in updated version of the file from Dennis. 2024-07-16 09:59:03 -06:00
Ward Fisher
41f802d1a4 Merge branch 'main' of https://github.com/Unidata/netcdf-c into DAOS_sync 2024-07-15 17:31:01 -06:00
Manuel Reis
e6a26a28b3 Allow region and bucket inference with NCS3UNK S3 server type 2024-07-09 13:45:40 +02:00
Dennis Heimbigner
06d2fe5b13 # Addendum
As suggested by Ward, I ensured that this PR supports
read backward compatibility with old key format.
This addition also adds a test case for this.

## Misc. Other Changes
* Remove some unused code
* Cleanup json error handling
* Fix some more unsigned/signed conversions warning
2024-06-25 17:13:02 -06:00
Ward Fisher
787ea1f438 Merge remote-tracking branch 'upstream/main' into DAOS_sync 2024-06-25 15:24:04 -06:00
Dennis Heimbigner
076da97aa4 Convert NCzarr meta-data to use only Zarr attributes
As discussed in a netcdf meeting, convert NCZarr V2 to store all netcdf-4 specific info as attributes. This improves interoperability with other Zarr implementations by no longer using non-standard keys.

## Other Changes
* Remove support for older NCZarr formats.
* Update anonymous dimension naming
* Begin the process of fixing the -Wconversion and -Wsign-compare warnings in libnczarr, nczarr_test, and v3_nczarr_test.
* Update docs/nczarr.md
* Rebuild using the .y and .l files
2024-06-19 18:09:29 -06:00
Ward Fisher
2add09a0d7
Merge branch 'main' into DAOS_sync 2024-05-21 11:58:36 -06:00
Dennis Heimbigner
9a478edb06 Fix duplicate definition when using aws-sdk-cpp.
re: Issue https://github.com/Unidata/netcdf-c/issues/2927

The NC_s3sdkinitialize NC_s3sdkfinalize functions were
misplaced. They should have been moved from ds3util.c to
ncs3sdk_h5.c.  When using ncs3sdl_aws.cpp, this resulted in a
duplicate definition.

Also, found and fixed a memory leak in the NCZarr S3 code.
2024-05-20 19:15:19 -06:00
Dennis Heimbigner
f0f0f39950 Cleanup various Zarr-related build issues
# Description
Remove various obsolete build options. Also do some code movement.

## Specific Changes

* The remotetest server is sometimes unstable, so provide a mechanism
  to force disabling calls to remotetest.unidata.ucar.edu.
  This is enabled by adding a repository variable named
  REMOTETESTDOWN with the value "yes".
* Fix CMakeLists.txt to use the uname command as an alternate
  to using the hostname command (which does not work under cygwin).
* Remove the JNA stuff as obsolete
* Remove the ENABLE_CLIENTSIDE_FILTERS options since it has been
  disabled for a while.
* Fix bad option flag in some github action .yml files: change --disable-xml2 to --disable-libxml2
* Collect globalstate definitions into nc4internal.h
* Remove ENABLE_NCZARR_FILTERS_TESTING option as obsolete and replace
  with ENABLE_NCZARR_FILTERS
* Move some dispatcher independent functions from libsrc4/nc4internal.c to libdispatch/ddispatch.c
* As a long term goal, and because it is now the case that --enable-nczarr
    => USE_NETCDF4, make the external options --enable-netcdf-4 and
    --enable-netcdf4 obsolete in favor of --enable-hdf5
    We will do the following for one more release cycle.
        1. Make --enable-netcdf-4 be an alias for --enable-netcdf4.
        2. Make --enable-netcdf4 an alias for --enable-hdf5.
        3. Internally, convert most uses of USE_NETCDF_4 ad USE_NETCDF4 to USE_HDF5
    After the next release, --enable-netcdf-4 and --enable-netcdf4 will
    be removed.
2024-05-15 18:46:25 -06:00
Dennis Heimbigner
69ed78e7d7 Convert the ENABLE_XXX options to NETCDF_ENABLE_XXX options
# Primary Change
In order to conform to the cmake overhaul, occurrences of
ENABLE_XXX options in the nczarr code have been changed to
NETCDF_ENABLE_XXX.

# Misc. Other changes
* Fix use of rand_s in libdispatch/ncrandom.c
* Fix some bugs in the mingw gitub action.
* Fix signature bug in libncpoco/cp_win32.c
* Make some NCZarr fixes to config.h.cmake.in
2024-05-11 16:23:40 -06:00
Ward Fisher
7d111a75d9 Merge remote-tracking branch 'upstream/main' into silence-libdispatch-warnings 2024-04-17 15:41:56 -06:00
Ward Fisher
cdfe909a1a Add CI for a Windows Runner on Github Actions. 2024-04-17 13:29:18 -05:00
Georg Semmler
4693556520
Rename the vendored strlcat symbol
Fixes #927
2024-04-08 13:13:08 +02:00
Peter Hill
c72511404e
Fix conversion warnings in libdispatch 2024-04-08 11:31:13 +01:00
Ward Fisher
9639ba445d
Merge pull request #2875 from seanm/clang-tidy-fixes
Misc clang-tidy fixes, and added a .clang-tidy config file
2024-04-05 14:45:22 -06:00
Ward Fisher
38d3831319
Merge branch 'main' into clang-tidy-fixes 2024-04-02 15:30:47 -06:00
Peter Hill
1cf1522436
Skip checking for duplicates if only one element in list 2024-03-25 14:25:38 +00:00
Peter Hill
3c6bd83330
Change format of backwards-loops
Enables using correct `size_t` type for loop counter, usually fixing
some conversion warnings
2024-03-25 14:25:38 +00:00
Kyle Shores
a82659b0e9 Replace ENABLE_TESTS with NETCDF_ENABLE_TESTS 2024-03-18 15:54:48 -05:00
Kyle Shores
8fd6dcb979 Replace ENABLE_S3 with NETCDF_ENABLE_S3 2024-03-18 15:54:15 -05:00
Kyle Shores
dba34ac5c2 Replace ENABLE_PNETCDF with NETCDF_ENABLE_PNETCDF 2024-03-18 15:54:02 -05:00
Kyle Shores
d1334f7b88 Replace ENABLE_NCZARR with NETCDF_ENABLE_NCZARR 2024-03-18 15:52:19 -05:00
Kyle Shores
ece5a776cb Replace ENABLE_DLL with NETCDF_ENABLE_DLL 2024-03-18 15:51:21 -05:00
Kyle Shores
d270aa8e93 Replace ENABLE_DAP with NETCDF_ENABLE_DAP 2024-03-18 15:51:14 -05:00
Kyle Shores
2bce1e6776 Replace ENABLE_CDF5 with NETCDF_ENABLE_CDF5 2024-03-18 15:51:04 -05:00
Kyle Shores
b4eb8bf019 Replace ENABLE_BYTERANGE with NETCDF_ENABLE_BYTERANGE 2024-03-18 15:50:57 -05:00
Ward Fisher
443195973a
Merge branch 'main' into find_pnetcdf 2024-03-11 16:02:54 -06:00
Ward Fisher
5973f3d683
Merge pull request #2847 from K20shores/packaging
Use cmake netCDF with target_* for many options
2024-03-11 15:55:36 -06:00
Ward Fisher
cc1494d988
Merge branch 'main' into awsdfalt.dmh 2024-03-05 12:50:08 -07:00
Sean McBride
e1f22bc4ed Manually fixed readability-suspicious-call-argument warnings 2024-03-01 20:46:58 -05:00
Sean McBride
42d0b48e8d Auto fixed clang-tidy readability-avoid-const-params-in-decls warnings 2024-03-01 20:46:58 -05:00
Sean McBride
029389efcb Auto fixed clang-tidy readability-redundant-declaration warnings 2024-03-01 20:46:58 -05:00
Sean McBride
dededdf2ee Manually fixed some bugprone-unsafe-functions warnings 2024-03-01 20:46:58 -05:00
Sean McBride
4188db2817 Auto fixed clang-tidy readability-redundant-control-flow warnings 2024-03-01 20:46:58 -05:00
Sean McBride
0d82e3cd28 Auto fixed clang-tidy bugprone-suspicious-string-compare warnings 2024-03-01 20:46:58 -05:00
Kyle Shores
c29db073eb setting dll export on each target 2024-02-29 11:36:47 -06:00
Kyle Shores
dda2c2de69 merging main 2024-02-22 09:59:05 -06:00
Peter Hill
907e5cc43f
CMake: Use target_link_libraries with HDF5::HDF5 target 2024-02-16 10:51:20 +00:00
Ward Fisher
fb537e61eb Correct previous fix to remove inclusion of internal header. 2024-02-07 10:18:37 -07:00
Kyle Shores
7c2c955450 correcting target_sources 2024-02-07 10:06:46 -06:00
Kyle Shores
f9e3247164 merging main, addressing some PR comments 2024-02-07 09:53:45 -06:00
Ward Fisher
f557108b16 Make changes in support of https://github.com/Unidata/netcdf-c/issues/2859 2024-02-06 10:35:46 -07:00
Peter Hill
a051cb2928
Update bundled utf8proc to 2.9.0
Commit 1fe43f5a6d9c628f717c5ec8aeaeae4a9adfd167

Closes #2804
2024-02-02 16:31:20 +00:00