mirror/netcdf-c
2
0
Fork 0
mirror of https://github.com/Unidata/netcdf-c.git synced 2025-01-30 16:10:44 +08:00
Code Issues Packages Projects Releases Wiki Activity
8,086 Commits 90 Branches 75 Tags 90 MiB
229e101569
Commit Graph

1013 Commits

Author SHA1 Message Date
Greg Sjaardema
404b0a3ed7
Add missing ERR macro on tests 
A few of the tests were missing a call to the ERR macro.
 2020-03-04 13:31:47 -07:00
Edward Hartnett
502336c2c7 now return NC_EINVAL on attempt to set chunking on scalar var 2020-03-03 11:57:16 -07:00
Edward Hartnett
c484f8f3d0 fixed tst_mode to not attempt to set filters on scalars 2020-03-03 07:44:37 -07:00
Edward Hartnett
836a8fb55d fixed szip test error in tst_parallel5.c 2020-03-02 16:31:56 -07:00
Dennis Heimbigner
73537603e2 Make scalar X filter return an error instead of ignoring it 2020-03-02 15:10:54 -07:00
Dennis Heimbigner
8a5ae84dc6 fix memory leak 2020-02-27 14:29:28 -07:00
Dennis Heimbigner
b488c272d5 Fix conflicts with master 2020-02-27 14:06:45 -07:00
Edward Hartnett
5a1bbf07e4 resolved conflict in tst_h_vars2.c 2020-02-27 05:25:31 -07:00
Edward Hartnett
6f95f655dd
Merge branch 'master' into ejh_dispatch 2020-02-26 16:12:57 -07:00
Edward Hartnett
418e428a05 fixed problem with scalar compact 2020-02-26 09:13:12 -07:00
Edward Hartnett
b31aedcc8e all tests passing but compact storage for scalars not being properly written in file yet 2020-02-26 08:14:06 -07:00
Edward Hartnett
3241aca93a include storage in rec_print_metadata() output 2020-02-25 16:12:50 -07:00
Edward Hartnett
6241a6e7a0 more tests for storage, changed var names to reflect stortage 2020-02-25 15:55:34 -07:00
Edward Hartnett
2ff24bd6fe more tests for compact storage 2020-02-25 13:30:38 -07:00
Edward Hartnett
8952c9b9f1 whitespace cleanup of tst_h_vars2.c 2020-02-25 06:44:40 -07:00
Edward Hartnett
5b893d8e0a adding more test for compact var 2020-02-25 05:46:09 -07:00
Edward Hartnett
4b163b65e1 added some testing for compact vars 2020-02-24 14:34:27 -07:00
M. Scot Breitenfeld
9f9b125028 Updated H5Oget_info* and H5Oinfo_t to be compatible with HDF5 1.12.0. 
Issue: build netcdf with hdf5-1.12.0 beta release fails in h5_test directory #1628
 2020-02-20 17:24:29 -06:00
Dennis Heimbigner
44d0dcaad2 Add support for multiple filters per variable. 
re: https://github.com/Unidata/netcdf-c/issues/1584

Support has been added for multiple filters per variable.  This
affects a number of components in netcdf. The new APIs are
documented in NUG/filters.md.

The primary changes are:
* A set of new functions are provided (see __include/netcdf_filter.h__).
    - Obtain a list of the filters associated with a variable
    - Obtain the parameters for a specific filter.
* The existing __nc_inq_var_filter__ function now returns info
  about the first defined filter.
* The utilities (ncgen, ncdump, and nccopy) now support
  an extended format for specifying a sequence of filters.
  The general form is __<filter>|<filter>..._.
* The ncdump **_Filter** attribute now dumps a list of all the
  filters associated with a variable using the above new format.
* Filter specifications can now use a filter name instead of number
  for filters known to the netcdf library, which in turn is taken
  from the HDF5 filter registration page.
* New errors are defined: NC_EFILTER and NC_ENOFILTER. The latter
  is returned if an attempt is made to access an unknown filter.
* Internally, the dispatch table has been extended to add a function
  to handle all of the filter functions.
* New, filter-related, tests were added to nc_test4.
* A new plugin was added to the plugins directory to help with testing.

Notes:
1. The shuffle and fletcher32 filters are not part of the multifilter system.

Misc. changes:
1. A debug module was added to libhdf5 to help catch error locations.
 2020-02-16 12:59:33 -07:00
Edward Hartnett
07ce91a137
Merge branch 'master' into ejh_h5_par 2020-02-15 09:09:35 -07:00
Edward Hartnett
a8684c730c fixed merge conflict in RELEASE_NOTES 2020-02-15 06:42:49 -07:00
Edward Hartnett
8b9298c58d more checking in 3D test 2020-02-12 08:21:52 -07:00
Edward Hartnett
fe70e818e8 checking 3D file again after close 2020-02-12 08:18:41 -07:00
Edward Hartnett
6e316f44a6 switched to vara functions in 3D test 2020-02-12 08:17:35 -07:00
Edward Hartnett
fe96b6a3e5 checking 2nd var data in 3D test 2020-02-12 08:14:13 -07:00
Edward Hartnett
77ae2cfecc improving 3d test 2020-02-12 08:11:37 -07:00
Edward Hartnett
2addd91215 added another var to 2D test 2020-02-12 08:10:16 -07:00
Edward Hartnett
550b8fa188 better 3d unlimited testing 2020-02-12 08:06:04 -07:00
Edward Hartnett
d922af9820 adding 3d test 2020-02-12 08:04:32 -07:00
Edward Hartnett
93ef9b1bdc adding 3d test 2020-02-12 07:49:04 -07:00
Edward Hartnett
4ea78cc985 testing two unlimited dims 2020-02-12 07:45:59 -07:00
Edward Hartnett
168850c373 testing two unlimited dims 2020-02-12 07:45:29 -07:00
Edward Hartnett
4683a4da3b testing two unlimited dims 2020-02-12 07:44:54 -07:00
Edward Hartnett
2f9856b2e6 testing two unlimited dims 2020-02-12 07:30:00 -07:00
Edward Hartnett
bf87013c6b adding test 2020-02-12 07:27:51 -07:00
Edward Hartnett
fe31d48a01 adding test 2020-02-12 07:25:02 -07:00
Edward Hartnett
4c9f1d91e4 making room for new tests 2020-02-12 07:21:22 -07:00
Edward Hartnett
1cd37f1e57 whitespace cleanup 2020-02-12 07:16:12 -07:00
Edward Hartnett
03c7e61b20 merged changes from master 2020-02-11 17:20:22 -07:00
Edward Hartnett
15059a18b7 merged changes from master 2020-02-11 17:19:25 -07:00
Edward Hartnett
1487a921ba now test that bad version number in dispatch table causes rejection 2020-02-09 13:23:22 -07:00
Edward Hartnett
e957ebccfa now test that bad version number in dispatch table causes rejection 2020-02-09 13:22:35 -07:00
Edward Hartnett
e25174a29f whitespace cleanup of tst_udf.c 2020-02-09 13:19:10 -07:00
Edward Hartnett
a0839a2a7a added version to dispatch table 2020-02-09 13:07:58 -07:00
Edward Hartnett
834adfe3b1 cleanup of nc_test4/run_par_test.sh.in 2020-02-08 06:36:29 -07:00
Edward Hartnett
558988bb18 fixed docs, removed unneeded defines in test 2020-02-07 07:54:12 -07:00
Edward Hartnett
a5079585a0 test more values for szip 2020-02-07 07:05:29 -07:00
Edward Hartnett
b9aa2e76db test more values for szip 2020-02-07 07:04:48 -07:00
Edward Hartnett
c4d3937099 now check number of elements in chunk against pixels_per_block for szip compression 2020-02-07 07:03:40 -07:00
Edward Hartnett
ff7280512e checking for some bad pixels_per_block values for szip 2020-02-07 06:53:52 -07:00
Edward Hartnett
81a079997e test development for different szip option mask settings 2020-02-07 06:02:02 -07:00
Edward Hartnett
67a562393b adding test of different szip option mask settings 2020-02-07 05:58:59 -07:00
Edward Hartnett
6ae81a17c7 starting to add test for szip param values 2020-02-07 05:16:21 -07:00
Edward Hartnett
6d2d751e4e disallow zlib if szip already in use 2020-02-07 05:01:06 -07:00
Edward Hartnett
78cd7f7512 removed unneeded var 2020-02-07 04:37:04 -07:00
Edward Hartnett
3d169c432b removed redundant test 2020-02-07 04:32:57 -07:00
Edward Hartnett
04624c7be3 fix error in makefile building tst_parallel_compress.c 2020-02-06 09:17:49 -07:00
Edward Hartnett
fb2a1048bb documentation improvements for nc_inq_var_szip() 2020-02-06 07:42:53 -07:00
Edward Hartnett
6d50ba67e8 turned on some previously failing tests for nc_inq_var_szip() 2020-02-06 07:39:01 -07:00
Edward Hartnett
ca5c0234d4 renamed var for clarity 2020-02-06 07:36:10 -07:00
Edward Hartnett
d5859e91b7 not return 0 for parameters to nc_inq_var_szip if szip is not turned on for var 2020-02-06 07:35:07 -07:00
Edward Hartnett
cf74f49fdb moved tst_parallel_zlib2 to tst_parallel_compress 2020-02-05 17:40:31 -07:00
Edward Hartnett
4a2ac1a338 now parallel szip test working in tst_parallel_zlib2.c 2020-02-05 15:08:30 -07:00
Edward Hartnett
6c39c1dc23 more of szip test in tst_parallel_zlib2.c 2020-02-05 15:01:31 -07:00
Edward Hartnett
3247061dc0 adding szip test to tst_parallel_zlib2.c 2020-02-05 14:56:06 -07:00
Edward Hartnett
b09446b0da test nc_inq_var_szip after call to nc_def_var_szip, but before enddef 2020-02-04 08:47:18 -07:00
Edward Hartnett
a6fbc3eea2 fix problem with pre-enddef call to nc_inq_var_szip() 2020-02-04 07:11:44 -07:00
Edward Hartnett
bf3407ce67 more tests 2020-02-04 05:38:15 -07:00
Edward Hartnett
e363bd59c7 testing nc_def_var_szip when szip has not been built into HDF5 2020-02-04 05:33:52 -07:00
Edward Hartnett
21a204c4e8 start using par filters in HDF5-1.10.3 2020-01-17 14:01:07 -07:00
Edward Hartnett
b9823d2658 fixed shell test for par filters 2020-01-17 12:13:45 -07:00
Edward Hartnett
3da6304f6a fixing running of parallel filter tests only when parallel filters are present 2020-01-17 11:33:58 -07:00
Edward Hartnett
86a9835f12 checking sziped data in parallel I/O test 2020-01-06 10:23:59 -07:00
Edward Hartnett
58abb5adee parallel szip test 2020-01-06 10:23:07 -07:00
Edward Hartnett
c8135722ac parallel szip test 2020-01-06 10:22:45 -07:00
Edward Hartnett
a8a523f1aa parallel szip test 2020-01-06 10:21:00 -07:00
Edward Hartnett
a0396a862b parallel szip test 2020-01-06 10:17:28 -07:00
Edward Hartnett
bb7ffe69d9 starting to add parallel tests 2020-01-06 09:08:27 -07:00
Edward Hartnett
7e332690d2 more szip testing 2020-01-06 08:04:27 -07:00
Edward Hartnett
9c8719bd00 more szip tests 2020-01-06 08:01:28 -07:00
Edward Hartnett
65e5897533 whitespace clean up 2020-01-06 07:58:11 -07:00
Edward Hartnett
8a341372ea clean up 2020-01-06 07:57:50 -07:00
Edward Hartnett
1c3edc503d now checking for proper error from nc_def_var_szip() when szip is not present 2020-01-06 07:53:31 -07:00
Edward Hartnett
c47b404531 added test for when szip is missing from HDF5 2020-01-06 07:50:02 -07:00
Edward Hartnett
808a0e2be9 merged ejh_parallel_zlib 2020-01-02 14:25:31 -07:00
Ward Fisher
8f2be58d95
Merge pull request #1566 from NetCDF-World-Domination-Council/ejh_unlim_dims 
Fix problems with read past end of dataset but within dimension length for vars with multiple unlimited dimensions
 2019-12-23 15:08:56 -07:00
Edward Hartnett
af0b28ffd5 removed unneeded delete 2019-12-20 14:05:57 -07:00
Edward Hartnett
c4a8671a0d fixed comments 2019-12-20 14:04:57 -07:00
Edward Hartnett
61477db387 fixed comments 2019-12-20 14:03:48 -07:00
Edward Hartnett
9ded9b1dfd restored tst_mode tests 2019-12-20 14:00:59 -07:00
Edward Hartnett
680e44f628 changed name of macro 2019-12-20 13:58:01 -07:00
Edward Hartnett
c16e7ef3ce more test development 2019-12-20 12:52:38 -07:00
Edward Hartnett
522705423d more test development 2019-12-20 12:51:36 -07:00
Edward Hartnett
909212454a more testing 2019-12-20 12:43:52 -07:00
Edward Hartnett
8e660e14fa more tests 2019-12-20 11:48:40 -07:00
Edward Hartnett
e6ded1a8ec more testing 2019-12-20 11:42:54 -07:00
Edward Hartnett
995cfdad96 merged master 2019-12-20 11:16:11 -07:00
Edward Hartnett
8681b0d241 more documentaiton 2019-12-20 07:10:13 -07:00
Edward Hartnett
4b7f839666 swtich to collective access when filters are applied 2019-12-20 07:00:12 -07:00
Edward Hartnett
f980743be1 now also can set fletcher32 in parallel I/O writes 2019-12-20 06:48:31 -07:00
Edward Hartnett
0c6641eb98 adjusted tst_parallel_zlib2 to HDF5 version flag 2019-12-20 06:46:13 -07:00
Edward Hartnett
663540b3a7 adjusted tst_parallel_zlib to HDF5 version flag 2019-12-20 06:44:14 -07:00
Edward Hartnett
6d2d92ddec added new tests to cmake, also additional test development 2019-12-20 06:30:23 -07:00
Edward Hartnett
d534b1298a adding another zlib parallel I/O test 2019-12-20 05:28:20 -07:00
Edward Hartnett
2a415dba7c stop running tst_mode test 2019-12-20 05:22:53 -07:00
Ward Fisher
6c75e97764
Merge pull request #1570 from NOAA-GSD/ejh_compact 
enable compact storage for netcdf-4 vars
 2019-12-19 16:47:05 -07:00
Edward Hartnett
cde58d23c1 allowing parallel write of gzipped data, plus added test 2019-12-19 09:20:20 -07:00
Edward Hartnett
3e00967879 allow parallel writes to use zlib 2019-12-19 09:19:23 -07:00
Edward Hartnett
fb4a209f2a more testing for compact vars 2019-12-16 09:44:31 -07:00
Edward Hartnett
e75c248478 more testing for compact vars 2019-12-16 09:42:54 -07:00
Edward Hartnett
66a2b4c05e more testing for compact vars 2019-12-16 09:37:54 -07:00
Edward Hartnett
90324dfd10 further test development for compact storage 2019-12-16 09:31:11 -07:00
Edward Hartnett
89b8981c86 got compact storage test working 2019-12-04 09:12:53 -07:00
Edward Hartnett
06896f432d got compact storage test working 2019-12-04 08:49:37 -07:00
Edward Hartnett
85994847b2 more test development 2019-12-04 08:06:55 -07:00
Edward Hartnett
1a1f537c26 more test development 2019-12-04 08:05:30 -07:00
Edward Hartnett
1a665b6d80 adding test for compact storage 2019-12-04 08:01:56 -07:00
Edward Hartnett
bb1f5e1637 whitespace cleanup of test 2019-12-04 07:55:54 -07:00
Edward Hartnett
645b8566cd more tests 2019-12-01 15:05:43 -07:00
Edward Hartnett
e52a74520e tests and fix for multiple unlimited dim bug 2019-12-01 15:05:09 -07:00
Edward Hartnett
c1756e949e merged ejh_remove_unrelax 2019-12-01 14:30:37 -07:00
Edward Hartnett
c0a6da7757 changed test filename to one that will be cleaned 2019-12-01 08:47:46 -07:00
Edward Hartnett
ddf986665b comment to explain 2019-12-01 07:35:41 -07:00
Edward Hartnett
f86ca19ee3 added test for opening HDF5 file without creation ordering 2019-12-01 07:30:32 -07:00
edwardhartnett
8f4d5e6a5b turned off cmake build in travis 2019-11-17 15:41:24 -07:00
Ward Fisher
af8f9ad2cf
Merge pull request #1523 from NetCDF-World-Domination-Council/ejh_udf 
User-defined formats must come first in NC_infermodel, plus test
 2019-11-15 16:40:07 -07:00
Ward Fisher
923d4ccbff
Merge pull request #1530 from NetCDF-World-Domination-Council/ejh_endianness 
now testing that endianness can only be set on atomic ints and floats
 2019-11-15 15:27:35 -07:00
edwardhartnett
965da1de01 now testing that endianness can only be set on atomic ints and floats 2019-11-15 11:10:10 -07:00
edwardhartnett
b844f8f8f6 more testing 2019-11-15 09:26:37 -07:00
edwardhartnett
35e210ac29 test cleanup 2019-11-15 09:21:54 -07:00
edwardhartnett
0017f3e069 test cleanup 2019-11-15 09:21:11 -07:00
edwardhartnett
7f41db9cb3 test cleanup 2019-11-15 09:20:26 -07:00
edwardhartnett
8083b3596e fixed problem of unlim dim and var sharing the same name but not being related 2019-11-15 09:18:42 -07:00
Ward Fisher
1a6351dab2
Merge pull request #1521 from ckhroulev/netcdf4-repeated-attribute-modification 
Improve the fix for #350 included in #1119
 2019-11-14 17:01:09 -07:00
Ward Fisher
2462cda15e
Merge pull request #1525 from NetCDF-World-Domination-Council/ejh_anon_dims 
If HDF5 dataset has multiple anonymous dimensions of the same size, assume they are different dimensions
 2019-11-14 16:58:24 -07:00
edwardhartnett
d0b069cf70 cleaned up test handling of strings 2019-11-14 09:39:10 -07:00
edwardhartnett
3e45fa1497 another test for two anon dimensions of same size used in same HDF5 var 2019-11-14 07:23:09 -07:00
edwardhartnett
d73611de73 now handle two anon dimensions of same size used in same HDF5 var 2019-11-14 06:54:22 -07:00
edwardhartnett
cebe84157b adding test for anonymous dims in HDF5 file 2019-11-13 12:51:34 -07:00
edwardhartnett
b9f57b2b5f now UDF mode flags take priority over NC_NETCDF4 2019-11-13 12:13:33 -07:00
Constantine Khrulev
bb45db457e Add regression tests modifying attributes 2^16 times 
This commit adds three new tests:

- a test documenting the limitation originally reported in #350 (in
  general modifying an attribute about 2^16 times makes it impossible
  to modify this file in ways requiring nc_redef() and nc_enddef() calls).
- a test ensuring that a scalar attribute can be modified 2^16 times
  as long as its type and size remain the same
- a test ensuring that a text attribute can be modified 2^16 times as
  long as its size remains the same

This version uses the nc_redef(), nc_put_att_...(), nc_enddef()
sequence. One could also use nc_open(), nc_put_att_...(), nc_close()
but that would make these tests significantly slower.
 2019-11-13 10:08:31 -09:00
edwardhartnett
0bbe91e438 udf must take priority in NC_infermodel 2019-11-13 12:07:33 -07:00
Dennis Heimbigner
30cfd348e6 Remove debug output 2019-11-06 09:33:14 -07:00
Dennis Heimbigner
9e016b85aa Add test cases 2019-11-03 12:03:13 -07:00
Dennis Heimbigner
f1506d552e Change (again), and hopefully simplify, the file model inference algorithm. 
* For URL paths, the new approach essentially centralizes all information
  in the URL into the "#mode=" fragment key and uses that value
  to determine the dispatcher for (most) URLs.

* The new approach has the following steps:

  1. canonicalize the path if it is a URL.
  2. use the mode= fragment key to determine the dispatcher
  3. if dispatcher still not determined, then use the mode flags
     argument to nc_open/nc_create to determine the dispatcher.
  4. if the path points to something readable, attempt to read the
     magic number at the front, and use that to determine the dispatcher.
     this case may override all previous cases.

* Misc changes.

  1. Update documentation
  2. Moved some unit tests from libdispatch to unit_test directory.
  3. Fixed use of wrong #ifdef macro in test_filter_reg.c
     [I think this may fix an previously reported esupport query].
 2019-09-29 12:59:28 -06:00
Greg Sjaardema
56c0d5cf8a Spelling fixes 2019-09-18 08:03:01 -06:00
Ward Fisher
9a92201c94 Wiring unit test directory into cmake-based builds. 2019-08-21 14:50:09 -06:00
edwardhartnett
2077729abc removed base_pe functions from dispatch table 2019-08-15 06:51:06 -06:00
edwardhartnett
0b00f4b5eb more work on tst_parallel5.c 2019-08-14 08:50:09 -06:00
edwardhartnett
c042ea5d23 added parallel I/O test for NC_BYTE scalar 2019-08-14 08:22:35 -06:00