netcdf-c/nczarr_test
Dennis Heimbigner 9b7202bf06 Explicitly disallow variable length type compression
re: https://github.com/Unidata/netcdf-c/issues/2189

Compression of a variable whose type is variable length
fails for all current filters. This is because at some point,
the compression buffer will contain pointers to data instead
of the actual data. Compression of pointers of course is meaningless.

The PR changes the behavior of nc_def_var_filter so that it will
fail with error NC_EFILTER if an attempt is made to add a filter
to a variable whose type is variable-length.

A variable is variable-length if it is of type string or VLEN
or transitively (via a compound type) contains a string or VLEN.

Also added a test case for this.

## Misc Changes
1. Turn off a number of debugging statements
2022-02-19 16:47:31 -07:00
..
refs This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
bm_chunks3.c Additional Fixes to NCZarr 2020-12-16 20:48:02 -07:00
bm_timer.h Add missing files so --enable-benchmarks works again. 2021-08-07 21:19:40 -06:00
bm_utils.c Add missing files so --enable-benchmarks works again. 2021-08-07 21:19:40 -06:00
bm_utils.h Add missing files so --enable-benchmarks works again. 2021-08-07 21:19:40 -06:00
CMakeLists.txt Add complete bitgroom support to NCZarr 2022-01-24 15:22:24 -07:00
Makefile.am Cleaning up make dist, it's generating tarballs that don't work with cmake. 2022-02-01 11:40:01 -07:00
ncdumpchunks.c Merge branch 'master' into eliminate_need_for_hdf5-1.6-API 2021-05-28 07:11:13 -06:00
ref_any.cdl Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
ref_avail1.cdl More NCZarr optimizations 2021-01-06 13:35:59 -07:00
ref_avail1.dmp More NCZarr optimizations 2021-01-06 13:35:59 -07:00
ref_avail1.txt More NCZarr optimizations 2021-01-06 13:35:59 -07:00
ref_blosc_zmap.txt Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
ref_byte_fill_value_null.cdl Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
ref_byte_fill_value_null.zarr.zip Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
ref_byte.cdl Explicitly disallow variable length type compression 2022-02-19 16:47:31 -07:00
ref_byte.zarr.zip Add test cases 2021-08-10 14:15:24 -06:00
ref_bzip2.cdl Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
ref_fillonly.cdl Fix error where not converting fill data 2020-09-12 14:49:59 -06:00
ref_filtered.cdl Add complete bitgroom support to NCZarr 2022-01-24 15:22:24 -07:00
ref_groups_regular.cdl Explicitly disallow variable length type compression 2022-02-19 16:47:31 -07:00
ref_groups.h5 Add test cases 2021-08-10 14:15:24 -06:00
ref_misc1.cdl Fix some additional edges cases for mapping slices to chunks 2020-12-19 21:17:46 -07:00
ref_misc1.dmp More NCZarr optimizations 2021-01-06 13:35:59 -07:00
ref_misc2.cdl Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
ref_multi.cdl Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
ref_nczarr2zarr.cdl Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
ref_ndims.cdl Fix some additional edges cases for mapping slices to chunks 2020-12-19 21:17:46 -07:00
ref_ndims.dmp More NCZarr optimizations 2021-01-06 13:35:59 -07:00
ref_newformatpure.cdl Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
ref_oldformat.cdl Move to Version 2 NCZarr Extended Meta-Data 2021-07-17 16:55:30 -06:00
ref_oldformat.zip Fix bad chunkpath calculation 2021-07-18 16:20:22 -06:00
ref_perdimspecs.cdl Provide a Number of fixes/improvements to NCZarr 2020-11-19 17:01:04 -07:00
ref_power_901_constants.cdl Fix JSON quoted string processing in libnczarr 2021-05-06 16:39:44 -06:00
ref_power_901_constants.zip Fix JSON quoted string processing in libnczarr 2021-05-06 16:39:44 -06:00
ref_purezarr_base.cdl Add support for the XArray Zarr _ARRAY_DIMENSIONS attribute 2021-02-24 13:46:11 -07:00
ref_purezarr.cdl Add complete bitgroom support to NCZarr 2022-01-24 15:22:24 -07:00
ref_quotes.cdl Fix JSON quoted string processing in libnczarr 2021-05-06 16:39:44 -06:00
ref_quotes.zip Fix JSON quoted string processing in libnczarr 2021-05-06 16:39:44 -06:00
ref_rem.cdl Fix some additional edges cases for mapping slices to chunks 2020-12-19 21:17:46 -07:00
ref_rem.dmp More NCZarr optimizations 2021-01-06 13:35:59 -07:00
ref_skip.cdl Additional Fixes to NCZarr 2020-12-16 20:48:02 -07:00
ref_skip.txt More NCZarr optimizations 2021-01-06 13:35:59 -07:00
ref_skipw.cdl Fix some additional edges cases for mapping slices to chunks 2020-12-19 21:17:46 -07:00
ref_t_meta_dim1.cdl This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
ref_t_meta_var1.cdl This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
ref_ut_json_build.txt This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
ref_ut_json_parse.txt This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
ref_ut_map_create.cdl Add zip file support 2021-01-28 20:11:01 -07:00
ref_ut_map_readdata_nz4.txt This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
ref_ut_map_readmeta2.txt Add support for the XArray Zarr _ARRAY_DIMENSIONS attribute 2021-02-24 13:46:11 -07:00
ref_ut_map_readmeta_nz4.txt This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
ref_ut_map_readmeta_nzf.txt This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
ref_ut_map_readmeta.txt Add zip file support 2021-01-28 20:11:01 -07:00
ref_ut_map_search_nz4.txt Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
ref_ut_map_search_nzf.txt Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
ref_ut_map_search.txt Add support for the XArray Zarr _ARRAY_DIMENSIONS attribute 2021-02-24 13:46:11 -07:00
ref_ut_map_writedata.cdl Add support for the XArray Zarr _ARRAY_DIMENSIONS attribute 2021-02-24 13:46:11 -07:00
ref_ut_map_writemeta2.cdl Add support for the XArray Zarr _ARRAY_DIMENSIONS attribute 2021-02-24 13:46:11 -07:00
ref_ut_map_writemeta.cdl Add zip file support 2021-01-28 20:11:01 -07:00
ref_ut_mapapi_create.cdl Add zip file support 2021-01-28 20:11:01 -07:00
ref_ut_mapapi_data.cdl Add zip file support 2021-01-28 20:11:01 -07:00
ref_ut_mapapi_meta.cdl Add zip file support 2021-01-28 20:11:01 -07:00
ref_ut_mapapi_search_nz4.txt Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
ref_ut_mapapi_search_nzf.txt Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
ref_ut_mapapi_search_s3.txt This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
ref_ut_mapapi_search.txt Add zip file support 2021-01-28 20:11:01 -07:00
ref_ut_proj.txt More NCZarr optimizations 2021-01-06 13:35:59 -07:00
ref_ut_testmap_create.cdl Add zip file support 2021-01-28 20:11:01 -07:00
ref_whole.cdl More NCZarr optimizations 2021-01-06 13:35:59 -07:00
ref_whole.txt More NCZarr optimizations 2021-01-06 13:35:59 -07:00
ref_xarray.cdl Add complete bitgroom support to NCZarr 2022-01-24 15:22:24 -07:00
run_chunkcases.sh Upgrade the nczarr code to match Zarr V2 2021-04-24 19:48:15 -06:00
run_fillonlyz.sh Add zip file support 2021-01-28 20:11:01 -07:00
run_filter.sh Support MSYS2/Mingw platform 2021-12-23 22:18:56 -07:00
run_interop.sh Fix conflicts with main 2022-01-28 13:12:03 -07:00
run_it_chunks1.sh Add zip file support 2021-01-28 20:11:01 -07:00
run_misc.sh Add test cases 2021-08-10 14:15:24 -06:00
run_nccopyz.sh More modification in support of #1940 2021-03-09 10:49:30 -07:00
run_ncgen4.sh Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
run_nczarr_fill.sh Explicitly disallow variable length type compression 2022-02-19 16:47:31 -07:00
run_newformat.sh Move to Version 2 NCZarr Extended Meta-Data 2021-07-17 16:55:30 -06:00
run_perf_chunks1.sh Add zip file support 2021-01-28 20:11:01 -07:00
run_purezarr.sh Significantly Improve Amazon S3 Cloud Storage Support 2021-09-27 18:36:33 -06:00
run_quantize.sh Add complete bitgroom support to NCZarr 2022-01-24 15:22:24 -07:00
run_s3_cleanup.sh Add zip file support 2021-01-28 20:11:01 -07:00
run_specific_filters.sh Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
run_ut_chunk.sh Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
run_ut_map.sh Add zip file support 2021-01-28 20:11:01 -07:00
run_ut_mapapi.sh Fix additional S3 support issues 2021-10-29 20:06:37 -06:00
run_ut_misc.sh Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
s3util.c Explicitly disallow variable length type compression 2022-02-19 16:47:31 -07:00
test_nczarr_utils.h More tweaks. 2022-01-24 15:21:29 -07:00
test_nczarr.sh Support MSYS2/Mingw platform 2021-12-23 22:18:56 -07:00
testfilter_misc.c Fix a few memory leaks and erroneous logic in nczarr_test/testfilter_misc 2022-01-09 14:41:35 -05:00
testfilter_multi.c Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
testfilter_order.c Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
testfilter_repeat.c Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
testfilter.c Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
tst_chunkcases.c Add zip file support 2021-01-28 20:11:01 -07:00
tst_fillonlyz.c Add zip file support 2021-01-28 20:11:01 -07:00
tst_nczfilter.c Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
tst_utils.c Merge branch 'master' into eliminate_need_for_hdf5-1.6-API 2021-05-28 07:11:13 -06:00
tst_utils.h Add zip file support 2021-01-28 20:11:01 -07:00
tst_zchunks2.c Additional Fixes to NCZarr 2020-12-16 20:48:02 -07:00
tst_zchunks3.c Explicitly disallow variable length type compression 2022-02-19 16:47:31 -07:00
tst_zchunks.c Remove stray character. 2022-01-24 15:30:01 -07:00
ut_chunking.c Fix additional S3 support issues 2021-10-29 20:06:37 -06:00
ut_includes.h Fix bad chunkpath calculation 2021-07-18 16:20:22 -06:00
ut_json.c Explicitly disallow variable length type compression 2022-02-19 16:47:31 -07:00
ut_map.c Support MSYS2/Mingw platform 2021-12-23 22:18:56 -07:00
ut_mapapi.c Fix additional S3 support issues 2021-10-29 20:06:37 -06:00
ut_projections.c Fix additional S3 support issues 2021-10-29 20:06:37 -06:00
ut_projtest.h This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
ut_test.c Fix additional S3 support issues 2021-10-29 20:06:37 -06:00
ut_test.h Fix additional S3 support issues 2021-10-29 20:06:37 -06:00
ut_util.c Add zip file support 2021-01-28 20:11:01 -07:00
ut_util.h Fix some additional edges cases for mapping slices to chunks 2020-12-19 21:17:46 -07:00
z4dump.c This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
zhex.c Add zip file support 2021-01-28 20:11:01 -07:00
zisjson.c Move to Version 2 NCZarr Extended Meta-Data 2021-07-17 16:55:30 -06:00
zmapio.c Fix additional S3 support issues 2021-10-29 20:06:37 -06:00
zs3parse.c Fix Mingw versus XGetopt (again) 2021-05-26 14:27:27 -06:00