netcdf-c/ncgen
Dennis Heimbigner 2afbdbd18f Add support for the XArray Zarr _ARRAY_DIMENSIONS attribute
The XArray implementation that uses Zarr for storage
provides a mechanism to simulate named dimensions.
It does this by adding a per-variable attribute called
_ARRAY_DIMENSIONS. This attribute contains a list of names
to be matched against the shape values of the variable.
In effect a named dimension is created with the name
_ARRAY_DIMENSIONS(i) and length shape(i) for all i
in range 0..rank(variable).
Both read and write support is provided.

This XArray support is only invoked if the mode value
of "xarray" is defined. So for example, as in this URL.
````
https://s3.us-west-1.amazonaws.com/bucket/dataset#mode=nczarr,xarray,s3
````
Note that the "xarray" mode flag also implies mode flag "zarr", so the above
is equivalent to this URL.
````
https://s3.us-west-1.amazonaws.com/bucket/dataset#mode=nczarr,zarr,xarray,s3
````

The primary change to implement this was to unify the handling
of dimension references in libnczarr/zsync.

A test for this and other pure-zarr features was added as
nczarr_test/run_purezarr.sh

Other changes:
* Make sure distcheck leaves no files around.
* Change the special attribute flag DIMSCALEFLAG to HIDDENATTRFLAG
  to support the xarray attribute.
* Annotate the zmap implementations with feature flags such as
  WRITEONCE (for zip files).
2021-02-24 13:46:11 -07:00
..
bindata.c This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
bytebuffer.c ncgen directory updated 2018-12-06 15:40:43 -07:00
bytebuffer.h ncgen directory updated 2018-12-06 15:40:43 -07:00
c0_4.cdl
c0.cdl
c5.cdl
cdata.c This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
cdfdata.c ncgen directory updated 2018-12-06 15:40:43 -07:00
CMakeLists.txt Provide a Number of fixes/improvements to NCZarr 2020-11-19 17:01:04 -07:00
cmldata.c ncgen directory updated 2018-12-06 15:40:43 -07:00
compound_datasize_test2.cdl
compound_datasize_test.cdl
ctests.sh
cvt.c Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
data.c This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
data.h This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
debug.c ncgen directory updated 2018-12-06 15:40:43 -07:00
debug.h Fix ncgen handling of big data sections 2020-05-14 11:20:46 -06:00
depend
dump.c This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
dump.h ncgen directory updated 2018-12-06 15:40:43 -07:00
env
escapes.c ncgen directory updated 2018-12-06 15:40:43 -07:00
f77data.c This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
foo.cdl
ftests.sh
genbin.c Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
genc.c Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
genchar.c Merge branch 'ncgenchunks.dmh' of https://github.com/DennisHeimbigner/netcdf-c into master 2020-09-09 10:24:33 -06:00
gencml.c ncgen directory updated 2018-12-06 15:40:43 -07:00
generate.c Merge branch 'ncgenchunks.dmh' of https://github.com/DennisHeimbigner/netcdf-c into master 2020-09-09 10:24:33 -06:00
generate.h This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
generr.c This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
generr.h This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
genf77.c This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
genj.c This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
genjjni.c ncgen directory updated 2018-12-06 15:40:43 -07:00
genjstd.c ncgen directory updated 2018-12-06 15:40:43 -07:00
genlib.c This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
genlib.h This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
getfill.c This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
includes.h This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
internals.html Spelling fixes 2019-09-18 08:03:01 -06:00
jdata.c This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
jdatajni.c ncgen directory updated 2018-12-06 15:40:43 -07:00
jdatastd.c ncgen directory updated 2018-12-06 15:40:43 -07:00
jtests.sh
lfs-tests
list.c ncgen directory updated 2018-12-06 15:40:43 -07:00
list.h ncgen directory updated 2018-12-06 15:40:43 -07:00
main_cpp.cpp This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
main.c Prepare for the path management code 2020-10-13 19:12:15 -06:00
Makefile.am Provide a Number of fixes/improvements to NCZarr 2020-11-19 17:01:04 -07:00
makeparser.sh
ncf199.cdl
ncf345.cdl
ncgen.1 This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
ncgen.h Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
ncgen.l Merge branch 'ncgenkw.dmh' of https://github.com/DennisHeimbigner/netcdf-c into gh1753.wif 2020-12-07 11:29:12 -07:00
ncgen.y Merge branch 'ncgenkw.dmh' of https://github.com/DennisHeimbigner/netcdf-c into gh1753.wif 2020-12-07 11:29:12 -07:00
ncgenl.c Add support for the XArray Zarr _ARRAY_DIMENSIONS attribute 2021-02-24 13:46:11 -07:00
ncgeny.c Add support for the XArray Zarr _ARRAY_DIMENSIONS attribute 2021-02-24 13:46:11 -07:00
ncgeny.h Add support for the XArray Zarr _ARRAY_DIMENSIONS attribute 2021-02-24 13:46:11 -07:00
odom.c ncgen directory updated 2018-12-06 15:40:43 -07:00
odom.h ncgen directory updated 2018-12-06 15:40:43 -07:00
ref_camrun.cdl Spelling fixes 2019-09-18 08:03:01 -06:00
run_tests2.sh
semantics.c This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
tst_gattenum.cdl
tst_usuffix.cdl
util.c Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
util.h This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00