mirror/netcdf-c
2
0
Fork 0
mirror of https://github.com/Unidata/netcdf-c.git synced 2024-12-09 08:11:38 +08:00
Code Issues Packages Projects Releases Wiki Activity
e3da84c835
netcdf-c/nc_test4/Makefile.am

119 lines
4.4 KiB
Makefile
Raw Normal View History

adding nc_perf directory
2019-03-17 22:03:27 +08:00
# This is part of the netCDF package. Copyright 2005-2019 University
further cleanup for benchmark builds
2018-08-25 02:48:42 +08:00
# Corporation for Atmospheric Research/Unidata See COPYRIGHT file for
# conditions of use.
#
# This directory holds tests for netCDF-4. It is skipped if netCDF-4
# is not enabled.
Incorporated endian test for [NCF-331] into autotools.
2015-05-13 03:00:22 +08:00
#
Making tst_hdf4_read_var.sh dependent on tst_interops2.
2017-12-07 06:07:54 +08:00
# Ed Hartnett, Ward Fisher
moving to trunk subdir
2010-06-03 21:24:43 +08:00
minor refactor of the build system to work better for cross-compiling
2011-03-15 18:19:08 +08:00
# Put together AM_CPPFLAGS and AM_LDFLAGS.
include $(top_srcdir)/lib_flags.am
moving to trunk subdir
2010-06-03 21:24:43 +08:00
1. Keep up to date by merging master 2. Fixed plugin building (nc_test4/hdf5plugins) to be done properly by cmake and automake. 4. Duplicated part of the nc_test4 filter test code in examples/C An incomplete and untested set of hooks exist for OS-X in nc_test4/findplugins.in. They need testing.
2018-01-17 02:00:09 +08:00
# Un comment to use a more verbose test driver
Fix cmake X mmap supercede PR: https://github.com/Unidata/netcdf-c/pull/1384 Since we have an mmap user, undeprecate it and make sure it works. Other changes: * fix test cases to work with make -j * fix exposed ncgen error.
2019-04-20 10:32:26 +08:00
#SH_LOG_DRIVER = $(SHELL) $(top_srcdir)/test-driver-verbose
Add test cases
2019-11-04 03:03:13 +08:00
#sh_LOG_DRIVER = $(SHELL) $(top_srcdir)/test-driver-verbose
Fix cmake X mmap supercede PR: https://github.com/Unidata/netcdf-c/pull/1384 Since we have an mmap user, undeprecate it and make sure it works. Other changes: * fix test cases to work with make -j * fix exposed ncgen error.
2019-04-20 10:32:26 +08:00
#LOG_DRIVER = $(SHELL) $(top_srcdir)/test-driver-verbose
Add test cases
2019-11-04 03:03:13 +08:00
#TESTS_ENVIRONMENT = export SETX=1;
1. Keep up to date by merging master 2. Fixed plugin building (nc_test4/hdf5plugins) to be done properly by cmake and automake. 4. Duplicated part of the nc_test4 filter test code in examples/C An incomplete and untested set of hooks exist for OS-X in nc_test4/findplugins.in. They need testing.
2018-01-17 02:00:09 +08:00
cleaned up makefile.am, added config.h to some tests
2019-01-02 20:31:15 +08:00
TEST_EXTENSIONS = .sh
got knmi benchmark test working with parallel builds
2018-08-23 20:32:04 +08:00
minor refactor of the build system to work better for cross-compiling
2011-03-15 18:19:08 +08:00
# Link to our assembled library.
bring in changes from lazy vars branch
2018-08-07 00:57:19 +08:00
LDADD = ${top_builddir}/liblib/libnetcdf.la
moving to trunk subdir
2010-06-03 21:24:43 +08:00
now run tst_large2, also cleaned up some more warnings
2017-11-25 01:50:07 +08:00
# These are netCDF-4 C test programs which are built and run.
cleaned up makefile.am, added config.h to some tests
2019-01-02 20:31:15 +08:00
NC4_TESTS = tst_dims tst_dims2 tst_dims3 tst_files tst_files4 \
moved tests from tst_h_atts2 into tst_xplatform2
2017-10-26 18:49:57 +08:00
tst_vars tst_varms tst_unlim_vars tst_converts tst_converts2 tst_grps \
tst_grps2 tst_compounds tst_compounds2 tst_compounds3 tst_opaques \
tst_strings tst_strings2 tst_interops tst_interops4 tst_interops5 \
adding test for anonymous dims in HDF5 file
2019-11-14 03:51:34 +08:00
tst_interops6 tst_interops_dims tst_enums tst_coords tst_coords2 \
tst_coords3 tst_vars3 tst_vars4 tst_chunks tst_chunks2 tst_utf8 \
tst_fills tst_fills2 tst_fillbug tst_xplatform tst_xplatform2 \
tst_endian_fill tst_atts t_type cdm_sea_soundings tst_camrun tst_vl \
tst_atts1 tst_atts2 tst_vars2 tst_files5 tst_files6 tst_sync \
tst_h_scalar tst_rename tst_rename2 tst_rename3 tst_h5_endians \
tst_atts_string_rewrite tst_hdf5_file_compat tst_fill_attr_vanish \
tst_rehash tst_filterparser tst_bug324 tst_types tst_atts3 \
tst_put_vars tst_elatefill tst_udf tst_put_vars_two_unlim_dim \
tst_bug1442
finished breaking up netcdf.m4 into c files.
2010-06-22 21:25:14 +08:00
only run some benchmark tests if utilities have been built
2019-03-12 23:23:49 +08:00
# Temporary I hoped, but hoped in vain.
Updated cleanfiles list on Makefile.am
2017-06-01 05:01:02 +08:00
if !ISCYGWIN
Fix pull request https://github.com/Unidata/netcdf-c/pull/374 (dap4.dmh) 1. When running under windows (as opposed to cygwin) we need to make sure to not user /cygdrive/ file paths. This was ocurring in libdap4/d4read.c, but may occur elsewhere. 2. Shell scripts in the git repo are not being checked-out with the executable mode set. Had core.filemode set to false. Was a major hassle to fix.
2017-04-04 11:39:44 +08:00
NC4_TESTS += tst_h_strbug tst_h_refs
endif
now run tst_large2, also cleaned up some more warnings
2017-11-25 01:50:07 +08:00
# Build test programs plus programs used in test scripts.
fixed mistake in Makefile.am
2019-01-02 21:21:11 +08:00
check_PROGRAMS = $(NC4_TESTS) tst_empty_vlen_unlim
TESTS = $(NC4_TESTS) run_empty_vlen_test.sh
moved some tests which used v2 API from libsrc4 to nc_test4, to allow the library to be built before the tests
2010-06-15 23:24:28 +08:00
minor refactor of the build system to work better for cross-compiling
2011-03-15 18:19:08 +08:00
# Add these if large file tests are turned on.
if LARGE_FILE_TESTS
check_PROGRAMS += tst_large tst_large2
now run tst_large2, also cleaned up some more warnings
2017-11-25 01:50:07 +08:00
TESTS += tst_large tst_large2
minor refactor of the build system to work better for cross-compiling
2011-03-15 18:19:08 +08:00
endif
# If the v2 API was built, add its test program.
finished breaking up netcdf.m4 into c files.
2010-06-22 21:25:14 +08:00
if BUILD_V2
Incorporated endian test for [NCF-331] into autotools.
2015-05-13 03:00:22 +08:00
check_PROGRAMS += tst_v2
finished breaking up netcdf.m4 into c files.
2010-06-22 21:25:14 +08:00
TESTS += tst_v2
endif # BUILD_V2
moving to trunk subdir
2010-06-03 21:24:43 +08:00
cleanup Makefile.am
2019-03-19 01:09:44 +08:00
# The rest of the tests require ncgen/ncdump.
if BUILD_UTILITIES
check_PROGRAMS += renamegroup
TESTS += run_grp_rename.sh tst_misc.sh
moving to trunk subdir
2010-06-03 21:24:43 +08:00
Fix error where not converting fill data re: Github Issue https://github.com/Unidata/netcdf-c/issues/1826 It turns out that the common get code (NC4_get_vars) in libhdf5 (and libnczarr) has an optimization where it does not attempt to read from the file if the file is all fill values. Rather it just fills the output buffer with the fill value. The problem is that -- in that case -- it forgets that conversion might still be needed. So the conversion never occurs and the raw bits of the fill data are stored directly into the memory space. Solution: move some code around to properly do the conversion no matter how the data was obtained. Added a test cases nc_test4/test_fillonly.sh and nczarr_test/test_fillonlyz.sh
2020-09-13 04:49:59 +08:00
check_PROGRAMS += tst_fillonly
TESTS += test_fillonly.sh
add known szip file against which to test
2017-09-05 08:37:13 +08:00
# Szip Tests (requires ncdump)
Get szip working under cmake
2017-08-28 10:38:37 +08:00
if USE_SZIP
Add a general szip test script
2017-08-29 08:11:24 +08:00
check_PROGRAMS += test_szip h5testszip
Add more comprehensive tests
2017-08-29 04:56:01 +08:00
TESTS += tst_szip.sh
Get szip working under cmake
2017-08-28 10:38:37 +08:00
endif
1. Keep up to date by merging master 2. Fixed plugin building (nc_test4/hdf5plugins) to be done properly by cmake and automake. 4. Duplicated part of the nc_test4 filter test code in examples/C An incomplete and untested set of hooks exist for OS-X in nc_test4/findplugins.in. They need testing.
2018-01-17 02:00:09 +08:00
# Filter Tests (requires ncdump and ncgen)
if ENABLE_FILTER_TESTING
cleaned up makefile.am, added config.h to some tests
2019-01-02 20:31:15 +08:00
extradir =
Allow redefinition of variable filters re: Github issue https://github.com/Unidata/netcdf-c/issues/1713 If nc_def_var_filter or nc_def_var_deflate or nc_def_var_szip is called multiple times with the same filter id, but possibly with different sets of parameters, then the first invocation is sticky and later invocations are ignored. The desired behavior is to have the last invocation be used. This PR implements that desired behavior, with some special cases. If you call nc_def_var_deflate multiple times, then the last invocation rule applies with respect to deflate. However, the shuffle filter, if enabled, is always applied just before applying deflate. Misc unrelated changes: 1. Make client-side filters be disabled by default 2. Fix the definition of uintptr_t and use in oc2 and libdap4 3. Add some test cases 4. modify filter order tests to use plugin filters rather than client-side filters
2020-05-11 23:42:31 +08:00
check_PROGRAMS += test_filter test_filter_misc test_filter_order test_filter_repeat
Add support for multiple filters per variable. re: https://github.com/Unidata/netcdf-c/issues/1584 Support has been added for multiple filters per variable. This affects a number of components in netcdf. The new APIs are documented in NUG/filters.md. The primary changes are: * A set of new functions are provided (see __include/netcdf_filter.h__). - Obtain a list of the filters associated with a variable - Obtain the parameters for a specific filter. * The existing __nc_inq_var_filter__ function now returns info about the first defined filter. * The utilities (ncgen, ncdump, and nccopy) now support an extended format for specifying a sequence of filters. The general form is __<filter>|<filter>..._. * The ncdump **_Filter** attribute now dumps a list of all the filters associated with a variable using the above new format. * Filter specifications can now use a filter name instead of number for filters known to the netcdf library, which in turn is taken from the HDF5 filter registration page. * New errors are defined: NC_EFILTER and NC_ENOFILTER. The latter is returned if an attempt is made to access an unknown filter. * Internally, the dispatch table has been extended to add a function to handle all of the filter functions. * New, filter-related, tests were added to nc_test4. * A new plugin was added to the plugins directory to help with testing. Notes: 1. The shuffle and fletcher32 filters are not part of the multifilter system. Misc. changes: 1. A debug module was added to libhdf5 to help catch error locations.
2020-02-17 03:59:33 +08:00
check_PROGRAMS += tst_multifilter
Allow redefinition of variable filters re: Github issue https://github.com/Unidata/netcdf-c/issues/1713 If nc_def_var_filter or nc_def_var_deflate or nc_def_var_szip is called multiple times with the same filter id, but possibly with different sets of parameters, then the first invocation is sticky and later invocations are ignored. The desired behavior is to have the last invocation be used. This PR implements that desired behavior, with some special cases. If you call nc_def_var_deflate multiple times, then the last invocation rule applies with respect to deflate. However, the shuffle filter, if enabled, is always applied just before applying deflate. Misc unrelated changes: 1. Make client-side filters be disabled by default 2. Fix the definition of uintptr_t and use in oc2 and libdap4 3. Add some test cases 4. modify filter order tests to use plugin filters rather than client-side filters
2020-05-11 23:42:31 +08:00
TESTS += tst_filter.sh
1. Keep up to date by merging master 2. Fixed plugin building (nc_test4/hdf5plugins) to be done properly by cmake and automake. 4. Duplicated part of the nc_test4 filter test code in examples/C An incomplete and untested set of hooks exist for OS-X in nc_test4/findplugins.in. They need testing.
2018-01-17 02:00:09 +08:00
endif
cleanup Makefile.am
2019-03-19 01:09:44 +08:00
endif # BUILD_UTILITIES
1. Keep up to date by merging master 2. Fixed plugin building (nc_test4/hdf5plugins) to be done properly by cmake and automake. 4. Duplicated part of the nc_test4 filter test code in examples/C An incomplete and untested set of hooks exist for OS-X in nc_test4/findplugins.in. They need testing.
2018-01-17 02:00:09 +08:00
moving to trunk subdir
2010-06-03 21:24:43 +08:00
# This are extra tests that will only be run if netcdf-4 is configured
# with --enable-parallel-tests.
merge-squash
2015-08-16 06:26:35 +08:00
if TEST_PARALLEL4
cleanup makefile, develop test
2018-05-14 22:11:32 +08:00
check_PROGRAMS += tst_mpi_parallel tst_parallel tst_parallel3 \
changed literal in netcdf.h
2018-08-18 19:22:07 +08:00
tst_parallel4 tst_parallel5 tst_nc4perf tst_mode tst_simplerw_coll_r \
fix error in makefile building tst_parallel_compress.c
2020-02-07 00:17:49 +08:00
tst_mode tst_parallel_zlib tst_parallel_compress
moving to trunk subdir
2010-06-03 21:24:43 +08:00
TESTS += run_par_test.sh
moved tst_parallel_zlib2 to tst_parallel_compress
2020-02-06 08:40:31 +08:00
endif # TEST_PARALLEL4
moving to trunk subdir
2010-06-03 21:24:43 +08:00
got distcheck target working
2019-03-19 00:15:18 +08:00
EXTRA_DIST = run_par_test.sh.in ref_tst_compounds.nc \
ref_tst_xplatform2_1.nc ref_tst_xplatform2_2.nc ref_tst_dims.nc \
ref_tst_interops4.nc CMakeLists.txt run_grp_rename.sh \
further cleanup for benchmark builds
2018-08-25 02:48:42 +08:00
run_empty_vlen_test.sh ref_hdf5_compat1.nc ref_hdf5_compat2.nc \
ref_hdf5_compat3.nc tst_misc.sh tdset.h5 tst_szip.sh ref_szip.h5 \
fixing distcheck issues
2019-03-18 01:17:29 +08:00
ref_szip.cdl tst_filter.sh bzip2.cdl ref_filtered.cdl \
moving metadata performance tests to nc_perf
2019-03-18 22:30:14 +08:00
ref_unfiltered.cdl ref_bzip2.c findplugin.in ref_unfilteredvv.cdl \
Allow redefinition of variable filters re: Github issue https://github.com/Unidata/netcdf-c/issues/1713 If nc_def_var_filter or nc_def_var_deflate or nc_def_var_szip is called multiple times with the same filter id, but possibly with different sets of parameters, then the first invocation is sticky and later invocations are ignored. The desired behavior is to have the last invocation be used. This PR implements that desired behavior, with some special cases. If you call nc_def_var_deflate multiple times, then the last invocation rule applies with respect to deflate. However, the shuffle filter, if enabled, is always applied just before applying deflate. Misc unrelated changes: 1. Make client-side filters be disabled by default 2. Fix the definition of uintptr_t and use in oc2 and libdap4 3. Add some test cases 4. modify filter order tests to use plugin filters rather than client-side filters
2020-05-11 23:42:31 +08:00
ref_filteredvv.cdl ref_multi.cdl \
ref_ncgenF.cdl ref_nccopyF.cdl \
Fix error where not converting fill data re: Github Issue https://github.com/Unidata/netcdf-c/issues/1826 It turns out that the common get code (NC4_get_vars) in libhdf5 (and libnczarr) has an optimization where it does not attempt to read from the file if the file is all fill values. Rather it just fills the output buffer with the fill value. The problem is that -- in that case -- it forgets that conversion might still be needed. So the conversion never occurs and the raw bits of the fill data are stored directly into the memory space. Solution: move some code around to properly do the conversion no matter how the data was obtained. Added a test cases nc_test4/test_fillonly.sh and nczarr_test/test_fillonlyz.sh
2020-09-13 04:49:59 +08:00
ref_filter_order.txt ref_filter_repeat.txt \
ref_fillonly.cdl test_fillonly.sh
moved test from ncdump to nc_test4
2017-11-17 02:30:35 +08:00
fixed many benchmark warnings
2018-08-23 22:21:55 +08:00
CLEANFILES = tst_mpi_parallel.bin cdm_sea_soundings.nc bm_chunking.nc \
getting parallel benchmarks to work, cleanup of benchmark scripts
2018-08-24 22:59:58 +08:00
tst_floats_1D.cdl floats_1D_3.nc floats_1D.cdl tst_*.nc \
tst_floats2_*.cdl tst_ints2_*.cdl tst_shorts2_*.cdl tst_elena_*.cdl \
tst_simple*.cdl tst_chunks.cdl pr_A1.* tauu_A1.* usi_01.* thetau_01.* \
tst_*.h5 tst_grp_rename.cdl tst_grp_rename.dmp ref_grp_rename.cdl \
foo1.nc tst_*.h4 test.nc testszip.nc test.h5 szip_dump.cdl \
Allow in-line definition of filters Priority: Low re: issue https://github.com/Unidata/netcdf-c/issues/1329 HDF5 has the ability to programmatically define new filters, as opposed to using HDF5_PLUGIN_PATH env variable. This PR adds support for that feature. Not clear how useful this is, though. See docs/filters.md for details.
2019-03-22 01:33:27 +08:00
perftest.txt bigmeta.nc bigvars.nc *.gz MSGCPP_*.nc \
floats*.nc floats*.cdl shorts*.nc shorts*.cdl ints*.nc ints*.cdl \
Fix error where not converting fill data re: Github Issue https://github.com/Unidata/netcdf-c/issues/1826 It turns out that the common get code (NC4_get_vars) in libhdf5 (and libnczarr) has an optimization where it does not attempt to read from the file if the file is all fill values. Rather it just fills the output buffer with the fill value. The problem is that -- in that case -- it forgets that conversion might still be needed. So the conversion never occurs and the raw bits of the fill data are stored directly into the memory space. Solution: move some code around to properly do the conversion no matter how the data was obtained. Added a test cases nc_test4/test_fillonly.sh and nczarr_test/test_fillonlyz.sh
2020-09-13 04:49:59 +08:00
testfilter_reg.nc filterorder.txt filterrepeat.txt tmp_fillonly.nc
fixed build problems for libcf/gridspec, pnetcdf, and hdf4
2010-06-11 01:18:48 +08:00
Corrected issue in support of https://github.com/Unidata/netcdf-c/issues/1310
2019-02-08 03:43:07 +08:00
DISTCLEANFILES = findplugin.sh run_par_test.sh
1. Keep up to date by merging master 2. Fixed plugin building (nc_test4/hdf5plugins) to be done properly by cmake and automake. 4. Duplicated part of the nc_test4 filter test code in examples/C An incomplete and untested set of hooks exist for OS-X in nc_test4/findplugins.in. They need testing.
2018-01-17 02:00:09 +08:00
new method of using valgrind
2018-03-29 03:54:05 +08:00
# If valgrind is present, add valgrind targets.
@VALGRIND_CHECK_RULES@
Reference in New Issue Copy Permalink