mirror/netcdf-c
2
0
Fork 0
mirror of https://github.com/Unidata/netcdf-c.git synced 2024-11-27 07:30:33 +08:00
Code Issues Packages Projects Releases Wiki Activity
126b3f9423
netcdf-c/nczarr_test
History
Dennis Heimbigner 126b3f9423 Support installation of filters into user-specified location 
re: https://github.com/Unidata/netcdf-c/issues/2294

Ed Hartnett suggested that the netcdf library installation process
be extended to install the standard filters into a user specified
location. The user can then set HDF5_PLUGIN_PATH to that location.

This PR provides that capability using:
````
configure option: --with-plugin-dir=<absolute directory path>
cmake option: -DPLUGIN_INSTALL_DIR=<absolute directory path>
````

Currently, the following plugins are always installed, if
available: bzip2, zstd, blosc.
If NCZarr is enabled, then additional plugins are installed:
fletcher32, shuffle, deflate, szip.

Additionally, the necessary codec support is installed
for each of the above filters that is installed.

## Changes:
1. Cleanup handling of built-in bzip2.
2. Add documentation to docs/filters.md
3. Re-factor the NCZarr codec libraries
4. Add a test, although it can only be exercised after
   the library is installed, so it cannot be used during
   normal testing.
5. Cleanup use of HDF5_PLUGIN_PATH in the filter test cases.
2022-04-29 14:31:55 -06:00
..
refs This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
bm_chunks3.c Add support for setting HDF5 alignment property when creating a file 2022-01-29 15:27:52 -07:00
bm_timer.h Add missing files so --enable-benchmarks works again. 2021-08-07 21:19:40 -06:00
bm_utils.c Add missing files so --enable-benchmarks works again. 2021-08-07 21:19:40 -06:00
bm_utils.h Add support for setting HDF5 alignment property when creating a file 2022-01-29 15:27:52 -07:00
CMakeLists.txt Enhance/Fix filter support 2022-03-14 12:39:37 -06:00
Makefile.am Support installation of filters into user-specified location 2022-04-29 14:31:55 -06:00
ncdumpchunks.c Enhance/Fix filter support 2022-03-14 12:39:37 -06:00
ref_any.cdl Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
ref_avail1.cdl More NCZarr optimizations 2021-01-06 13:35:59 -07:00
ref_avail1.dmp More NCZarr optimizations 2021-01-06 13:35:59 -07:00
ref_avail1.txt More NCZarr optimizations 2021-01-06 13:35:59 -07:00
ref_blosc_zmap.txt Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
ref_byte_fill_value_null.cdl Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
ref_byte_fill_value_null.zarr.zip Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
ref_byte.cdl Explicitly disallow variable length type compression 2022-02-19 16:47:31 -07:00
ref_byte.zarr.zip Add test cases 2021-08-10 14:15:24 -06:00
ref_bzip2.cdl Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
ref_fillonly.cdl Fix error where not converting fill data 2020-09-12 14:49:59 -06:00
ref_filtered.cdl Add complete bitgroom support to NCZarr 2022-01-24 15:22:24 -07:00
ref_groups_regular.cdl Explicitly disallow variable length type compression 2022-02-19 16:47:31 -07:00
ref_groups.h5 Add test cases 2021-08-10 14:15:24 -06:00
ref_misc1.cdl Fix some additional edges cases for mapping slices to chunks 2020-12-19 21:17:46 -07:00
ref_misc1.dmp More NCZarr optimizations 2021-01-06 13:35:59 -07:00
ref_misc2.cdl Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
ref_multi.cdl Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
ref_nczarr2zarr.cdl Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
ref_ndims.cdl Fix some additional edges cases for mapping slices to chunks 2020-12-19 21:17:46 -07:00
ref_ndims.dmp More NCZarr optimizations 2021-01-06 13:35:59 -07:00
ref_newformatpure.cdl Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
ref_oldformat.cdl Move to Version 2 NCZarr Extended Meta-Data 2021-07-17 16:55:30 -06:00
ref_oldformat.zip Fix bad chunkpath calculation 2021-07-18 16:20:22 -06:00
ref_perdimspecs.cdl Provide a Number of fixes/improvements to NCZarr 2020-11-19 17:01:04 -07:00
ref_power_901_constants.cdl Fix JSON quoted string processing in libnczarr 2021-05-06 16:39:44 -06:00
ref_power_901_constants.zip Fix JSON quoted string processing in libnczarr 2021-05-06 16:39:44 -06:00
ref_purezarr_base.cdl Add support for the XArray Zarr _ARRAY_DIMENSIONS attribute 2021-02-24 13:46:11 -07:00
ref_purezarr.cdl Add complete bitgroom support to NCZarr 2022-01-24 15:22:24 -07:00
ref_quotes.cdl Fix JSON quoted string processing in libnczarr 2021-05-06 16:39:44 -06:00
ref_quotes.zip Fix JSON quoted string processing in libnczarr 2021-05-06 16:39:44 -06:00
ref_rem.cdl Fix some additional edges cases for mapping slices to chunks 2020-12-19 21:17:46 -07:00
ref_rem.dmp More NCZarr optimizations 2021-01-06 13:35:59 -07:00
ref_skip.cdl Additional Fixes to NCZarr 2020-12-16 20:48:02 -07:00
ref_skip.txt More NCZarr optimizations 2021-01-06 13:35:59 -07:00
ref_skipw.cdl Fix some additional edges cases for mapping slices to chunks 2020-12-19 21:17:46 -07:00
ref_t_meta_dim1.cdl This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
ref_t_meta_var1.cdl This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
ref_ut_json_build.txt This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
ref_ut_json_parse.txt This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
ref_ut_map_create.cdl Add zip file support 2021-01-28 20:11:01 -07:00
ref_ut_map_readdata_nz4.txt This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
ref_ut_map_readmeta2.txt Add support for the XArray Zarr _ARRAY_DIMENSIONS attribute 2021-02-24 13:46:11 -07:00
ref_ut_map_readmeta_nz4.txt This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
ref_ut_map_readmeta_nzf.txt This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
ref_ut_map_readmeta.txt Add zip file support 2021-01-28 20:11:01 -07:00
ref_ut_map_search_nz4.txt Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
ref_ut_map_search_nzf.txt Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
ref_ut_map_search.txt Add support for the XArray Zarr _ARRAY_DIMENSIONS attribute 2021-02-24 13:46:11 -07:00
ref_ut_map_writedata.cdl Add support for the XArray Zarr _ARRAY_DIMENSIONS attribute 2021-02-24 13:46:11 -07:00
ref_ut_map_writemeta2.cdl Add support for the XArray Zarr _ARRAY_DIMENSIONS attribute 2021-02-24 13:46:11 -07:00
ref_ut_map_writemeta.cdl Add zip file support 2021-01-28 20:11:01 -07:00
ref_ut_mapapi_create.cdl Add zip file support 2021-01-28 20:11:01 -07:00
ref_ut_mapapi_data.cdl Add zip file support 2021-01-28 20:11:01 -07:00
ref_ut_mapapi_meta.cdl Add zip file support 2021-01-28 20:11:01 -07:00
ref_ut_mapapi_search_nz4.txt Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
ref_ut_mapapi_search_nzf.txt Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
ref_ut_mapapi_search_s3.txt This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
ref_ut_mapapi_search.txt Add zip file support 2021-01-28 20:11:01 -07:00
ref_ut_proj.txt More NCZarr optimizations 2021-01-06 13:35:59 -07:00
ref_ut_testmap_create.cdl Add zip file support 2021-01-28 20:11:01 -07:00
ref_whole.cdl More NCZarr optimizations 2021-01-06 13:35:59 -07:00
ref_whole.txt More NCZarr optimizations 2021-01-06 13:35:59 -07:00
ref_xarray.cdl Add complete bitgroom support to NCZarr 2022-01-24 15:22:24 -07:00
ref_zarr_test_data.cdl.gz Improve UTF8 Support On Windows 2022-02-08 20:53:30 -07:00
run_chunkcases.sh Upgrade the nczarr code to match Zarr V2 2021-04-24 19:48:15 -06:00
run_fillonlyz.sh Add zip file support 2021-01-28 20:11:01 -07:00
run_filter.sh Support installation of filters into user-specified location 2022-04-29 14:31:55 -06:00
run_interop.sh Improve UTF8 Support On Windows 2022-02-08 20:53:30 -07:00
run_it_chunks1.sh Add zip file support 2021-01-28 20:11:01 -07:00
run_misc.sh Add test cases 2021-08-10 14:15:24 -06:00
run_nccopyz.sh More modification in support of #1940 2021-03-09 10:49:30 -07:00
run_ncgen4.sh Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
run_nczarr_fill.sh Explicitly disallow variable length type compression 2022-02-19 16:47:31 -07:00
run_nczfilter.sh Enhance/Fix filter support 2022-03-14 12:39:37 -06:00
run_newformat.sh Move to Version 2 NCZarr Extended Meta-Data 2021-07-17 16:55:30 -06:00
run_perf_chunks1.sh Add zip file support 2021-01-28 20:11:01 -07:00
run_purezarr.sh Significantly Improve Amazon S3 Cloud Storage Support 2021-09-27 18:36:33 -06:00
run_quantize.sh Enhance/Fix filter support 2022-03-14 12:39:37 -06:00
run_s3_cleanup.sh Add zip file support 2021-01-28 20:11:01 -07:00
run_ut_chunk.sh Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
run_ut_map.sh Add zip file support 2021-01-28 20:11:01 -07:00
run_ut_mapapi.sh Fix additional S3 support issues 2021-10-29 20:06:37 -06:00
run_ut_misc.sh Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
s3util.c Explicitly disallow variable length type compression 2022-02-19 16:47:31 -07:00
test_nczarr_utils.h More tweaks. 2022-01-24 15:21:29 -07:00
test_nczarr.sh Support installation of filters into user-specified location 2022-04-29 14:31:55 -06:00
testfilter_misc.c Fix a few memory leaks and erroneous logic in nczarr_test/testfilter_misc 2022-01-09 14:41:35 -05:00
testfilter_multi.c Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
testfilter_order.c Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
testfilter_repeat.c Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
testfilter.c Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
tst_chunkcases.c Add zip file support 2021-01-28 20:11:01 -07:00
tst_fillonlyz.c Add zip file support 2021-01-28 20:11:01 -07:00
tst_nczfilter.c Enhance/Fix filter support 2022-03-14 12:39:37 -06:00
tst_utils.c Merge branch 'master' into eliminate_need_for_hdf5-1.6-API 2021-05-28 07:11:13 -06:00
tst_utils.h Add zip file support 2021-01-28 20:11:01 -07:00
tst_zchunks2.c Additional Fixes to NCZarr 2020-12-16 20:48:02 -07:00
tst_zchunks3.c Explicitly disallow variable length type compression 2022-02-19 16:47:31 -07:00
tst_zchunks.c Remove stray character. 2022-01-24 15:30:01 -07:00
ut_chunking.c Fix additional S3 support issues 2021-10-29 20:06:37 -06:00
ut_includes.h Fix bad chunkpath calculation 2021-07-18 16:20:22 -06:00
ut_json.c Explicitly disallow variable length type compression 2022-02-19 16:47:31 -07:00
ut_map.c Support MSYS2/Mingw platform 2021-12-23 22:18:56 -07:00
ut_mapapi.c Fix additional S3 support issues 2021-10-29 20:06:37 -06:00
ut_projections.c Fix additional S3 support issues 2021-10-29 20:06:37 -06:00
ut_projtest.h This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
ut_test.c Fix additional S3 support issues 2021-10-29 20:06:37 -06:00
ut_test.h Fix additional S3 support issues 2021-10-29 20:06:37 -06:00
ut_util.c Add zip file support 2021-01-28 20:11:01 -07:00
ut_util.h Fix some additional edges cases for mapping slices to chunks 2020-12-19 21:17:46 -07:00
z4dump.c This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
zhex.c Improve UTF8 Support On Windows 2022-02-08 20:53:30 -07:00
zisjson.c Move to Version 2 NCZarr Extended Meta-Data 2021-07-17 16:55:30 -06:00
zmapio.c Improve UTF8 Support On Windows 2022-02-08 20:53:30 -07:00
zs3parse.c Improve UTF8 Support On Windows 2022-02-08 20:53:30 -07:00