mirror/netcdf-c
2
0
Fork 0
mirror of https://github.com/Unidata/netcdf-c.git synced 2024-11-27 07:30:33 +08:00
Code Issues Packages Projects Releases Wiki Activity
74afd13f44
netcdf-c/ncdump/chunkspec.h

50 lines
1.5 KiB
C
Raw Normal View History

Added ability to customize output chunking to nccopy.
2011-01-07 06:09:14 +08:00
/*********************************************************************
ncdump, other directories updated with copyright stanza.
2018-12-07 06:36:53 +08:00
* Copyright 2018, UCAR/Unidata
Added ability to customize output chunking to nccopy.
2011-01-07 06:09:14 +08:00
* See netcdf/COPYRIGHT file for copying and redistribution conditions.
* $Id $
*********************************************************************/
#ifndef _CHUNKSPEC_H_
#define _CHUNKSPEC_H_
Fix nccopy chunking and rechunking functionality when copying classic files with custom chunking specified for netCDF-4 output.
2011-01-10 05:41:07 +08:00
/* Parse chunkspec string and convert into internal data structure,
* associating dimids from open file or group specified by ncid with
* corresponding chunk sizes */
Added ability to customize output chunking to nccopy.
2011-01-07 06:09:14 +08:00
extern int
chunkspec_parse(int ncid, const char *spec);
Fix nccopy chunking and rechunking functionality when copying classic files with custom chunking specified for netCDF-4 output.
2011-01-10 05:41:07 +08:00
/* Return chunk size in chunkspec string specified for dimension
* corresponding to dimid, 0 if not found */
Added ability to customize output chunking to nccopy.
2011-01-07 06:09:14 +08:00
extern size_t
This PR primarily addresses Issue https://github.com/Unidata/netcdf-c/issues/725. After a long discussion, I implemented the rules at the end of that issue. They are documented in nccopy.1. Additionally, I added a new, per-variable, -c flag that allows for the direct setting of the chunking parameters for a variable. The form is -c var:c1,c2,...ck where var is the name of the variable (possibly a fully qualified name) and the ci are the chunksizes for that variable. It must be the case that the rank of the variable is k. If the new form is used as well as the old form, then the new form overrides the old form for the specified variable. Note that multiple occurrences of the new form -c flag may be specified. Misc. Other fixes 1. Added -M <size> option to nccopy to specify the minimum allowable chunksize. 2. Removed the unused variables from bigmeta.c (Issue https://github.com/Unidata/netcdf-c/issues/1079) 3. Fixed failure of nc_test4/tst_filter.sh by using the new -M flag (#1) to allow filter test on a small chunk size.
2018-07-27 10:16:02 +08:00
dimchunkspec_size(int dimid);
Added ability to customize output chunking to nccopy.
2011-01-07 06:09:14 +08:00
Make utilities support NC_COMPACT re: https://github.com/Unidata/netcdf-c/issues/1642 Modify ncdump, nccopy, and ncgen to support the NC_COMPACT storage option. Added test cases and added description to the man pages for the utilities. 1. ncdump: For compact storage variable, print special attribute __Storage_ as ```` <var>: _Storage = "compact"; ```` 2. ncgen: parse and implement ```` <var>: _Storage = "compact"; ```` in a .cdl file 3. nccopy: Extend the chunk specification (-c flag) to support compact using the forms ```` nccopy ... -c <var>:compact and nccopy ... -c <var>:contiguous ```` Misc. other changes 1. cleanup the copy_chunking function in ncdump/nccopy.c
2020-03-01 03:06:21 +08:00
/* Return 1 if a dimension spec is defined
* corresponding to dimid, 0 if not found */
extern bool_t
dimchunkspec_exists(int indimid);
Fix nccopy chunking and rechunking functionality when copying classic files with custom chunking specified for netCDF-4 output.
2011-01-10 05:41:07 +08:00
/* Return number of dimensions for which chunking was specified in
* chunkspec string on command line, 0 if no chunkspec string was
* specified. */
extern int
This PR primarily addresses Issue https://github.com/Unidata/netcdf-c/issues/725. After a long discussion, I implemented the rules at the end of that issue. They are documented in nccopy.1. Additionally, I added a new, per-variable, -c flag that allows for the direct setting of the chunking parameters for a variable. The form is -c var:c1,c2,...ck where var is the name of the variable (possibly a fully qualified name) and the ci are the chunksizes for that variable. It must be the case that the rank of the variable is k. If the new form is used as well as the old form, then the new form overrides the old form for the specified variable. Note that multiple occurrences of the new form -c flag may be specified. Misc. Other fixes 1. Added -M <size> option to nccopy to specify the minimum allowable chunksize. 2. Removed the unused variables from bigmeta.c (Issue https://github.com/Unidata/netcdf-c/issues/1079) 3. Fixed failure of nc_test4/tst_filter.sh by using the new -M flag (#1) to allow filter test on a small chunk size.
2018-07-27 10:16:02 +08:00
dimchunkspec_ndims(void);
Fix nccopy chunking and rechunking functionality when copying classic files with custom chunking specified for netCDF-4 output.
2011-01-10 05:41:07 +08:00
Fix -d0 option to not do unwanted chunking or associated shuffle. Add -c '/' option to specify changing layout for all variables from chunked to contiguous. Fix logic for chunking and compression depending on input and output formats.
2014-03-22 02:34:19 +08:00
/* Return whether chunking should be omitted, due to explicit
* command-line specification. */
extern bool_t
This PR primarily addresses Issue https://github.com/Unidata/netcdf-c/issues/725. After a long discussion, I implemented the rules at the end of that issue. They are documented in nccopy.1. Additionally, I added a new, per-variable, -c flag that allows for the direct setting of the chunking parameters for a variable. The form is -c var:c1,c2,...ck where var is the name of the variable (possibly a fully qualified name) and the ci are the chunksizes for that variable. It must be the case that the rank of the variable is k. If the new form is used as well as the old form, then the new form overrides the old form for the specified variable. Note that multiple occurrences of the new form -c flag may be specified. Misc. Other fixes 1. Added -M <size> option to nccopy to specify the minimum allowable chunksize. 2. Removed the unused variables from bigmeta.c (Issue https://github.com/Unidata/netcdf-c/issues/1079) 3. Fixed failure of nc_test4/tst_filter.sh by using the new -M flag (#1) to allow filter test on a small chunk size.
2018-07-27 10:16:02 +08:00
dimchunkspec_omit(void);
extern bool_t varchunkspec_omit(int grpid, int varid);
extern size_t* varchunkspec_chunksizes(int grpid, int varid);
extern size_t varchunkspec_ndims(int grpid, int varid);
extern bool_t varchunkspec_exists(int grpid, int varid);
Make utilities support NC_COMPACT re: https://github.com/Unidata/netcdf-c/issues/1642 Modify ncdump, nccopy, and ncgen to support the NC_COMPACT storage option. Added test cases and added description to the man pages for the utilities. 1. ncdump: For compact storage variable, print special attribute __Storage_ as ```` <var>: _Storage = "compact"; ```` 2. ncgen: parse and implement ```` <var>: _Storage = "compact"; ```` in a .cdl file 3. nccopy: Extend the chunk specification (-c flag) to support compact using the forms ```` nccopy ... -c <var>:compact and nccopy ... -c <var>:contiguous ```` Misc. other changes 1. cleanup the copy_chunking function in ncdump/nccopy.c
2020-03-01 03:06:21 +08:00
extern int varchunkspec_kind(int grpid, int varid);
This PR primarily addresses Issue https://github.com/Unidata/netcdf-c/issues/725. After a long discussion, I implemented the rules at the end of that issue. They are documented in nccopy.1. Additionally, I added a new, per-variable, -c flag that allows for the direct setting of the chunking parameters for a variable. The form is -c var:c1,c2,...ck where var is the name of the variable (possibly a fully qualified name) and the ci are the chunksizes for that variable. It must be the case that the rank of the variable is k. If the new form is used as well as the old form, then the new form overrides the old form for the specified variable. Note that multiple occurrences of the new form -c flag may be specified. Misc. Other fixes 1. Added -M <size> option to nccopy to specify the minimum allowable chunksize. 2. Removed the unused variables from bigmeta.c (Issue https://github.com/Unidata/netcdf-c/issues/1079) 3. Fixed failure of nc_test4/tst_filter.sh by using the new -M flag (#1) to allow filter test on a small chunk size.
2018-07-27 10:16:02 +08:00
extern void chunkspecinit(void);
Fix -d0 option to not do unwanted chunking or associated shuffle. Add -c '/' option to specify changing layout for all variables from chunked to contiguous. Fix logic for chunking and compression depending on input and output formats.
2014-03-22 02:34:19 +08:00
Added ability to customize output chunking to nccopy.
2011-01-07 06:09:14 +08:00
#endif /* _CHUNKSPEC_H_ */
Reference in New Issue Copy Permalink