Commit Graph

7373 Commits

Author SHA1 Message Date
Edward Hartnett
d5aba68cec updated docs for nc_def_var_chunking WRT scalars 2020-03-02 16:41:01 -07:00
Edward Hartnett
ba0491bb40 documentation improvements for nc_var_par_access() 2020-03-02 16:36:56 -07:00
Edward Hartnett
836a8fb55d fixed szip test error in tst_parallel5.c 2020-03-02 16:31:56 -07:00
Edward Hartnett
7402fa21d1 fixed warning 2020-03-02 16:29:52 -07:00
Edward Hartnett
ad77f42a90 fixed large file build issue 2020-03-02 16:28:56 -07:00
Ward Fisher
8a799c7711
Merge pull request #1654 from DennisHeimbigner/utilcompact.dmh
Make utilities support NC_COMPACT
2020-03-02 16:17:42 -07:00
Dennis Heimbigner
73537603e2 Make scalar X filter return an error instead of ignoring it 2020-03-02 15:10:54 -07:00
Dennis Heimbigner
e82d33a9bb fix error in tst_h_vars.c 2020-03-02 11:58:22 -07:00
Dennis Heimbigner
420fdf4625 fix memory allocation failure in hdf5var.c 2020-03-02 11:45:41 -07:00
Dennis Heimbigner
7d1ca9ac85 fix references to var->deflate' 2020-03-02 11:12:30 -07:00
Dennis Heimbigner
e66c727c28 Fix Filters x compact 2020-02-29 15:33:27 -07:00
Dennis Heimbigner
7ff42a2848 Fix typo 2020-02-29 13:02:49 -07:00
Dennis Heimbigner
f376c23329 Make utilities support NC_COMPACT
re: https://github.com/Unidata/netcdf-c/issues/1642

Modify ncdump, nccopy, and ncgen to support the NC_COMPACT storage option.
Added test cases and added description to the man pages for the utilities.

1. ncdump: For compact storage variable, print special attribute __Storage_ as
````
    <var>: _Storage = "compact";
````

2. ncgen: parse and implement
````
    <var>: _Storage = "compact";
````
in a .cdl file

3. nccopy: Extend the chunk specification (-c flag) to support
   compact using the forms
````
nccopy ... -c <var>:compact
and
nccopy ... -c <var>:contiguous
````

Misc. other changes
1. cleanup the copy_chunking function in ncdump/nccopy.c
2020-02-29 12:06:21 -07:00
Ward Fisher
0014db92e9
Merge pull request #1639 from DennisHeimbigner/multifilter.dmh
Add support for multiple filters per variable.
2020-02-28 16:25:55 -07:00
Dennis Heimbigner
10d227fc1b fix parallel filter error discovered by Hartnett 2020-02-28 11:36:58 -07:00
Dennis Heimbigner
a3a3e15cb1 fix bad edit 2020-02-27 15:33:39 -07:00
Dennis Heimbigner
afe5a2998c
Merge branch 'master' into multifilter.dmh 2020-02-27 15:02:27 -07:00
Dennis Heimbigner
030969c8db force rebuild 2020-02-27 14:48:35 -07:00
Dennis Heimbigner
8a5ae84dc6 fix memory leak 2020-02-27 14:29:28 -07:00
Dennis Heimbigner
b488c272d5 Fix conflicts with master 2020-02-27 14:06:45 -07:00
Edward Hartnett
5a1bbf07e4 resolved conflict in tst_h_vars2.c 2020-02-27 05:25:31 -07:00
Ward Fisher
50c3c37d9b
Merge pull request #1635 from NOAA-GSD/ejh_dispatch
added version number to dispatch table, and check it in nc_def_user_format()
2020-02-26 16:50:57 -07:00
Edward Hartnett
6f95f655dd
Merge branch 'master' into ejh_dispatch 2020-02-26 16:12:57 -07:00
Ward Fisher
15715945ba
Merge pull request #1645 from NOAA-GSD/ejh_more_compact_tests
more compact tests, fix for scalar compact vars, better documentation, and change of parameter name for code clarity...
2020-02-26 15:57:23 -07:00
Edward Hartnett
6fe489c8d5 updated docs on nc_def_var_chunking to describe behavior of scalars 2020-02-26 09:16:30 -07:00
Edward Hartnett
418e428a05 fixed problem with scalar compact 2020-02-26 09:13:12 -07:00
Edward Hartnett
52e3b4659f changed metadata logging to reflect unknown storage if var metadata has not yet be read 2020-02-26 08:59:17 -07:00
Edward Hartnett
b31aedcc8e all tests passing but compact storage for scalars not being properly written in file yet 2020-02-26 08:14:06 -07:00
Edward Hartnett
58d78a7e4c more HDF5 testing of scalar compact variable 2020-02-26 07:34:56 -07:00
Edward Hartnett
3241aca93a include storage in rec_print_metadata() output 2020-02-25 16:12:50 -07:00
Edward Hartnett
6241a6e7a0 more tests for storage, changed var names to reflect stortage 2020-02-25 15:55:34 -07:00
Edward Hartnett
2ff24bd6fe more tests for compact storage 2020-02-25 13:30:38 -07:00
Edward Hartnett
beb47aeb42 test demonstrating HDF5 use of compact scalar dataset 2020-02-25 07:23:27 -07:00
Edward Hartnett
bb266baef5 fixed comments 2020-02-25 07:10:43 -07:00
Edward Hartnett
10eada9c52 fixed warnings 2020-02-25 07:09:00 -07:00
Edward Hartnett
810f9cdb54 refurbishing old test that was commented out 2020-02-25 07:07:58 -07:00
Edward Hartnett
8952c9b9f1 whitespace cleanup of tst_h_vars2.c 2020-02-25 06:44:40 -07:00
Edward Hartnett
5b893d8e0a adding more test for compact var 2020-02-25 05:46:09 -07:00
Edward Hartnett
d2cf7d717d updated documentation of nc_inq_var_chunking() 2020-02-24 14:39:19 -07:00
Edward Hartnett
4b163b65e1 added some testing for compact vars 2020-02-24 14:34:27 -07:00
Ward Fisher
867caa288d
Merge pull request #1632 from NOAA-GSD/ejh_h5_par
fix setting of MPI launcher in h5_test/run_par_tests.sh
2020-02-21 12:55:18 -07:00
M. Scot Breitenfeld
9f9b125028 Updated H5Oget_info* and H5Oinfo_t to be compatible with HDF5 1.12.0.
Issue: build netcdf with hdf5-1.12.0 beta release fails in h5_test directory #1628
2020-02-20 17:24:29 -06:00
Dennis Heimbigner
44d0dcaad2 Add support for multiple filters per variable.
re: https://github.com/Unidata/netcdf-c/issues/1584

Support has been added for multiple filters per variable.  This
affects a number of components in netcdf. The new APIs are
documented in NUG/filters.md.

The primary changes are:
* A set of new functions are provided (see __include/netcdf_filter.h__).
    - Obtain a list of the filters associated with a variable
    - Obtain the parameters for a specific filter.
* The existing __nc_inq_var_filter__ function now returns info
  about the first defined filter.
* The utilities (ncgen, ncdump, and nccopy) now support
  an extended format for specifying a sequence of filters.
  The general form is __<filter>|<filter>..._.
* The ncdump **_Filter** attribute now dumps a list of all the
  filters associated with a variable using the above new format.
* Filter specifications can now use a filter name instead of number
  for filters known to the netcdf library, which in turn is taken
  from the HDF5 filter registration page.
* New errors are defined: NC_EFILTER and NC_ENOFILTER. The latter
  is returned if an attempt is made to access an unknown filter.
* Internally, the dispatch table has been extended to add a function
  to handle all of the filter functions.
* New, filter-related, tests were added to nc_test4.
* A new plugin was added to the plugins directory to help with testing.

Notes:
1. The shuffle and fletcher32 filters are not part of the multifilter system.

Misc. changes:
1. A debug module was added to libhdf5 to help catch error locations.
2020-02-16 12:59:33 -07:00
Edward Hartnett
07ce91a137
Merge branch 'master' into ejh_h5_par 2020-02-15 09:09:35 -07:00
Edward Hartnett
a8684c730c fixed merge conflict in RELEASE_NOTES 2020-02-15 06:42:49 -07:00
Ward Fisher
3bcdb5fbf1
Merge pull request #1634 from NOAA-GSD/ejh_mem_fix
fix leak of HDF5 typeids
2020-02-13 17:07:42 -07:00
Ward Fisher
e5161c8c9e
Merge pull request #1637 from NOAA-GSD/ejh_more_unlim_tests
more tests for variables that share multiple unlimited dimensions
2020-02-12 16:59:02 -07:00
Edward Hartnett
8b9298c58d more checking in 3D test 2020-02-12 08:21:52 -07:00
Edward Hartnett
fe70e818e8 checking 3D file again after close 2020-02-12 08:18:41 -07:00
Edward Hartnett
6e316f44a6 switched to vara functions in 3D test 2020-02-12 08:17:35 -07:00