mirror/netcdf-c
2
0
Fork 0
mirror of https://github.com/Unidata/netcdf-c.git synced 2025-01-12 15:45:21 +08:00
Code Issues Packages Projects Releases Wiki Activity
9cc8831fc8
netcdf-c/ncdap_test/CMakeLists.txt

89 lines
2.7 KiB
CMake
Raw Normal View History

ncdump, other directories updated with copyright stanza.
2018-12-07 06:36:53 +08:00
# Copyright 1993, 1994, 1995, 1996, 1997, 1998, 1999, 2000, 2001, 2002,
# 2003, 2004, 2005, 2006, 2007, 2008, 2009, 2010, 2011, 2012, 2013, 2014,
# 2015, 2016, 2017, 2018
# University Corporation for Atmospheric Research/Unidata.
# See netcdf-c/COPYRIGHT file for more info.
Reverted changes to C files. Can't change them as that messes with the other configuration paths. Tweaked CMakeLists.txt to set the TOPSRCDIR to the netcdf root.
2019-11-08 06:46:50 +08:00
add_definitions(-D"TOPSRCDIR=${CMAKE_CURRENT_SOURCE_DIR}/../")
add_definitions(-D"TOPBINDIR=${CMAKE_CURRENT_BINARY_DIR}/../")
Added new tests, CMake functionality.
2012-08-22 04:08:53 +08:00
remove_definitions(-DDLL_EXPORT)
Changes to make it possible to nest this project inside of another CMake project.
2019-11-07 00:43:49 +08:00
# add_definitions(-D"TOPSRCDIR=${CMAKE_CURRENT_SOURCE_DIR}")
Modified tests to determine location dynamically instead of from an environmental variable.
2012-08-22 06:52:40 +08:00
Add filter support to NCZarr Filter support has three goals: 1. Use the existing HDF5 filter implementations, 2. Allow filter metadata to be stored in the NumCodecs metadata format used by Zarr, 3. Allow filters to be used even when HDF5 is disabled Detailed usage directions are define in docs/filters.md. For now, the existing filter API is left in place. So filters are defined using ''nc_def_var_filter'' using the HDF5 style where the id and parameters are unsigned integers. This is a big change since filters affect many parts of the code. In the following, the terms "compressor" and "filter" and "codec" are generally used synonomously. ### Filter-Related Changes: * In order to support dynamic loading of shared filter libraries, a new library was added in the libncpoco directory; it helps to isolate dynamic loading across multiple platforms. * Provide a json parsing library for use by plugins; this is created by merging libdispatch/ncjson.c with include/ncjson.h. * Add a new _Codecs attribute to allow clients to see what codecs are being used; let ncdump -s print it out. * Provide special headers to help support compilation of HDF5 filters when HDF5 is not enabled: netcdf_filter_hdf5_build.h and netcdf_filter_build.h. * Add a number of new test to test the new nczarr filters. * Let ncgen parse _Codecs attribute, although it is ignored. ### Plugin directory changes: * Add support for the Blosc compressor; this is essential because it is the most common compressor used in Zarr datasets. This also necessitated adding a CMake FindBlosc.cmake file * Add NCZarr support for the big-four filters provided by HDF5: shuffle, fletcher32, deflate (zlib), and szip * Add a Codec defaulter (see docs/filters.md) for the big four filters. * Make plugins work with windows by properly adding __declspec declaration. ### Misc. Non-Filter Changes * Replace most uses of USE_NETCDF4 (deprecated) with USE_HDF5. * Improve support for caching * More fixes for path conversion code * Fix misc. memory leaks * Add new utility -- ncdump/ncpathcvt -- that does more or less the same thing as cygpath. * Add a number of new test to test the non-filter fixes. * Update the parsers * Convert most instances of '#ifdef _MSC_VER' to '#ifdef _WIN32'
2021-09-03 07:04:26 +08:00
FILE(GLOB COPY_FILES ${CMAKE_CURRENT_SOURCE_DIR}/*.sh)
disabled a remote test that is currently hanging.
2015-05-16 06:08:48 +08:00
FILE(COPY ${COPY_FILES} DESTINATION ${CMAKE_CURRENT_BINARY_DIR}/ FILE_PERMISSIONS OWNER_WRITE OWNER_READ OWNER_EXECUTE)
Added new tests, CMake functionality.
2012-08-22 04:08:53 +08:00
Re-enable DAP2 authorization tests The thredds-test server now has some password protected datasets that can be used to test DAP2 authorization support. The general location is ```` https://thredds.ucar.edu/thredds/tdscapabilities/authTest.html ```` and specifically: ```` https://thredds.ucar.edu/thredds/dodsC/test3/testData.nc.html ```` This PR replaces old testcases with ncdap_test/testauth.sh. This testcase allows us to test use of the .dodsrc file and .netrc file and embedded user+pwd. As part of this, I had to create a program (ncdap_test/pathcvt.c) that is essentially the equivalent to cygpath. Given a path in windows, unix, msys or cygwin format, it converts it to the equivalent format in one of those four cases. So it can be used to convert a cygwin path to a windows path, for example. This is needed in testpathcvt and testauth to make sure that the paths in .daprc (e.g. the reference to .netrc) are of the proper format. Misc. Other Changes: 1. Fix some memory leaks in libdap2 2. Setting the env variable CURLOPT_VERBOSE allows tracking of curl operations. 3. Make tst_charvlenbug be conditional on NC_VLEN_NOTEST.
2021-05-30 11:30:33 +08:00
IF(ENABLE_TESTS)
IF(ENABLE_DAP_REMOTE_TESTS)
Fix additional big-endian machine error in dap4. Follow on to PR: https://github.com/Unidata/netcdf-c/pull/1302
2019-02-16 02:36:29 +08:00
BUILD_BIN_TEST(findtestserver)
Avoid spurious test failures when servers fail. re: https://github.com/Unidata/netcdf-c/issues/1451 The situation with the various DAP (and other) remote test servers is currently in a state of flux. For example, Unidata admin is planning to forcibly shift the remote test server to remotetest.unidata.ucar.edu soon. In addition, the server test.opendap.org has shown some recent instability. The result is that various DAP (and byterange) tests can fail unexpectedly. This is an irritant to users and reveals nothing about test sucess or failure. Solve by modifying tests to report server inaccessibility and otherwise pretend to succeed. This puts an onus on Unidata to detect such server failures, but will not cause users to see spurious failures. [Note. Do similar fix for netcdf-java]. The check is: 1. export SETX=1 to cause all the shell scripts to trace 2. search the log files for the phrase "WARNING" (in upper case) and see if it is complaining about not finding a server. Misc. Changes ------------- 1. Added a pingurl program to see if a server was up. 2. modified some test case url targets
2020-01-01 06:42:58 +08:00
BUILD_BIN_TEST(pingurl)
Re-enable DAP2 authorization tests The thredds-test server now has some password protected datasets that can be used to test DAP2 authorization support. The general location is ```` https://thredds.ucar.edu/thredds/tdscapabilities/authTest.html ```` and specifically: ```` https://thredds.ucar.edu/thredds/dodsC/test3/testData.nc.html ```` This PR replaces old testcases with ncdap_test/testauth.sh. This testcase allows us to test use of the .dodsrc file and .netrc file and embedded user+pwd. As part of this, I had to create a program (ncdap_test/pathcvt.c) that is essentially the equivalent to cygpath. Given a path in windows, unix, msys or cygwin format, it converts it to the equivalent format in one of those four cases. So it can be used to convert a cygwin path to a windows path, for example. This is needed in testpathcvt and testauth to make sure that the paths in .daprc (e.g. the reference to .netrc) are of the proper format. Misc. Other Changes: 1. Fix some memory leaks in libdap2 2. Setting the env variable CURLOPT_VERBOSE allows tracking of curl operations. 3. Make tst_charvlenbug be conditional on NC_VLEN_NOTEST.
2021-05-30 11:30:33 +08:00
ENDIF()
Added test_varm3 back in to the list of active tests, to keep it in step with autotools. Corrected configure.ac; CURLOPT_RESPONSE_CODE should have been CURLINFO_RESPONSE_CODE.
2014-03-14 00:06:12 +08:00
# Base tests
# The tests are set up as a combination of shell scripts and executables that
# must be run in a particular order. It is painful but will use macros to help
# keep it from being too bad.
# Binary Test Macro
disabled a remote test that is currently hanging.
2015-05-16 06:08:48 +08:00
Re-enable DAP2 authorization tests The thredds-test server now has some password protected datasets that can be used to test DAP2 authorization support. The general location is ```` https://thredds.ucar.edu/thredds/tdscapabilities/authTest.html ```` and specifically: ```` https://thredds.ucar.edu/thredds/dodsC/test3/testData.nc.html ```` This PR replaces old testcases with ncdap_test/testauth.sh. This testcase allows us to test use of the .dodsrc file and .netrc file and embedded user+pwd. As part of this, I had to create a program (ncdap_test/pathcvt.c) that is essentially the equivalent to cygpath. Given a path in windows, unix, msys or cygwin format, it converts it to the equivalent format in one of those four cases. So it can be used to convert a cygwin path to a windows path, for example. This is needed in testpathcvt and testauth to make sure that the paths in .daprc (e.g. the reference to .netrc) are of the proper format. Misc. Other Changes: 1. Fix some memory leaks in libdap2 2. Setting the env variable CURLOPT_VERBOSE allows tracking of curl operations. 3. Make tst_charvlenbug be conditional on NC_VLEN_NOTEST.
2021-05-30 11:30:33 +08:00
IF(BUILD_UTILITIES)
add_sh_test(ncdap tst_ncdap3)
Correct an issue with appveyor builds, specific to systems where a bash shell is not available.
2021-08-31 23:27:51 +08:00
IF(HAVE_BASH)
SET_TESTS_PROPERTIES(ncdap_tst_ncdap3 PROPERTIES RUN_SERIAL TRUE)
ENDIF(HAVE_BASH)
Correct logic error.
2021-08-31 23:51:19 +08:00
ENDIF()
1. synch with oc 2. fix ocuri parameter handling 3. add ncdap_test/testuri.sh to test parameter handling.
2014-12-28 11:42:01 +08:00
Added test_varm3 back in to the list of active tests, to keep it in step with autotools. Corrected configure.ac; CURLOPT_RESPONSE_CODE should have been CURLINFO_RESPONSE_CODE.
2014-03-14 00:06:12 +08:00
IF(NOT MSVC)
add_bin_env_test(ncdap t_dap3a)
add_bin_env_test(ncdap test_cvt)
add_bin_env_test(ncdap test_vara)
ENDIF()
IF(ENABLE_DAP_REMOTE_TESTS)
Primary change: add dap4 support Specific changes: 1. Add dap4 code: libdap4 and dap4_test. Note that until the d4ts server problem is solved, dap4 is turned off. 2. Modify various files to support dap4 flags: configure.ac, Makefile.am, CMakeLists.txt, etc. 3. Add nc_test/test_common.sh. This centralizes the handling of the locations of various things in the build tree: e.g. where is ncgen.exe located. See nc_test/test_common.sh for details. 4. Modify .sh files to use test_common.sh 5. Obsolete separate oc2 by moving it to be part of netcdf-c. This means replacing code with netcdf-c equivalents. 5. Add --with-testserver to configure.ac to allow override of the servers to be used for --enable-dap-remote-tests. 6. There were multiple versions of nctypealignment code. Try to centralize in libdispatch/doffset.c and include/ncoffsets.h 7. Add a unit test for the ncuri code because of its complexity. 8. Move the findserver code out of libdispatch and into a separate, self contained program in ncdap_test and dap4_test. 9. Move the dispatch header files (nc{3,4}dispatch.h) to .../include because they are now shared by modules. 10. Revamp the handling of TOPSRCDIR and TOPBUILDDIR for shell scripts. 11. Make use of MREMAP if available 12. Misc. minor changes e.g. - #include <config.h> -> #include "config.h" - Add some no-install headers to /include - extern -> EXTERNL and vice versa as needed - misc header cleanup - clean up checking for misc. unix vs microsoft functions 13. Change copyright decls in some files to point to LICENSE file. 14. Add notes to RELEASENOTES.md
2017-03-09 08:01:10 +08:00
Merged utility-based tests fix into cmake-based builds.
2016-09-01 05:48:10 +08:00
IF(BUILD_UTILITIES)
forgot to add to cmake
2017-07-15 06:44:50 +08:00
add_sh_test(ncdap tst_ber)
Merged utility-based tests fix into cmake-based builds.
2016-09-01 05:48:10 +08:00
add_sh_test(ncdap tst_remote3)
Correct an issue with appveyor builds, specific to systems where a bash shell is not available.
2021-08-31 23:27:51 +08:00
IF(HAVE_BASH)
SET_TESTS_PROPERTIES(ncdap_tst_remote3 PROPERTIES RUN_SERIAL TRUE)
ENDIF(HAVE_BASH)
Added test in support of https://github.com/Unidata/netcdf-c/issues/1300 and https://github.com/Unidata/netcdf-c/issues/1301
2019-01-30 06:23:03 +08:00
add_sh_test(ncdap tst_zero_len_var)
Make use of clock_gettime be conditional. Re: GH Issue https://github.com/Unidata/netcdf-c/issues/1900 Apparently the clock_gettime() function is not always available. It is used in unit_test/tst_exhash.c and unit_test/tst_xcache.c. To solve this, a number of things were changed: * Move the timing code to a new file unit_tests/timer_utils.[ch] * Modify the timing code to choose one of several timing methods depending on availability. The prioritized order is as follows: 1. If Windows, use the QueryPerformanceCounter mechanism else 2. Use clock_gettime if available else 3. Use gettimeofday if available else 4. Use getrusage if available Note that the resolution of 3 and 4 is less than 1 or 2. Misc. Other Changes: * Move the test in CMakeLists.txt that disables unit tests for WIN32 to unit_test/CMakeLists.txt since some unit tests actually work under Visual Studio. * Fix some of the unit tests to work under visual studio * Fix problem with using remove() in zmap_nzf.c * Remove some warning about use of EXTERNL
2020-12-07 09:19:53 +08:00
add_sh_test(ncdap tst_encode)
Temporarily disabled encoding test under cmake
2020-12-05 06:49:30 +08:00
# not yet add_sh_test(ncdap tst_hyrax)
Modify DAP2 and DAP4 to optionally allow Fillvalue/Variable mismatch re: issue https://github.com/Unidata/netcdf-c/issues/1151 Modify DAP2 and DAP4 code to handle case when _FillValue type is not same as the parent variable type. Specifically: 1. Define a parameter [fillmismatch] to allow this mismatch; default is to disallow. 2. If allowed, forcibly change the type of the _FillValue to match the parent variable. 3. If allowed Convert the values to match new type 4. Generate a log message 5. if not allowed, then fail Implementing this required some changes to ncdap_test/dapcvt.c Also added test cases. Minor Unrelated Changes: 1. There were a number of warnings about e.g. assigning a const char* to a char*. Fix these 2. In nccopy.1, replace .NP with .IP "n" (re PR https://github.com/Unidata/netcdf-c/pull/1144) 3. fix minor error in ncdump/ocprint
2018-10-02 05:51:43 +08:00
add_sh_test(ncdap tst_fillmismatch)
The ncdap_tests were a mess, so I decided to clean them up to remove cruft and to remove unused site tests and make the tests somewhat more understandable. Also did a fix to libdispatch/dwinpath to convert relative paths to absolute paths. This will, I hope, take care of some windows path problems when using $srcdir in shell scripts.
2018-03-21 11:31:31 +08:00
IF(ENABLE_DAP_LONG_TESTS)
add_sh_test(ncdap tst_longremote3)
Regularize the semantics of mkstemp. re: https://github.com/Unidata/netcdf-c/issues/1827 The issue is partly resolved by this PR. The proximate problem appears to be that the semantics of mkstemp in **nix is different than the semantics of _mktemp_s in Windows. I had thought they were the same but that is incorrect. The _mktemp_s function will only produce 26 different files and so the netcdf temp file code will fail after about that many iterations. So, to solve this, I created my own version of mkstemp for windows that uses a random number generator. This appears to solve the reported issue. I also added the testcase ncdap_test/test_manyurls but made it conditional on --enable-dap-long-tests because it is very slow. I did note that the provided test program now fails after some 800 iterations with a libcurl error claiming it cannot resolve the host name. My belief is that the library is just running out of resources at this point: too many open curl handles or some such. I doubt if this failure is fixable. So bottom line is that it is really important to do nc_close when you are finished with a file. Misc. Other Changes: 1. I took the opportunity to clean up some bad string hacks in the code. Specifically * change all uses of strncat to strlcat * remove old string hacks: occoncat and occopycat 2. Add heck to see if test.opendap.org is running and if not, then skip test 3. Make CYGWIN use TEMP environment variable
2021-05-15 01:33:03 +08:00
add_bin_test(ncdap test_manyurls)
Attempt at test orchestration to avoid a race condition when running tests in parallel.
2021-08-26 03:33:49 +08:00
SET_TESTS_PROPERTIES(ncdap_tst_longremote3 ncdap_test_manyurls PROPERTIES RUN_SERIAL TRUE)
The ncdap_tests were a mess, so I decided to clean them up to remove cruft and to remove unused site tests and make the tests somewhat more understandable. Also did a fix to libdispatch/dwinpath to convert relative paths to absolute paths. This will, I hope, take care of some windows path problems when using $srcdir in shell scripts.
2018-03-21 11:31:31 +08:00
ENDIF(ENABLE_DAP_LONG_TESTS)
ncdump, other directories updated with copyright stanza.
2018-12-07 06:36:53 +08:00
Correct an issue with appveyor builds, specific to systems where a bash shell is not available.
2021-08-31 23:27:51 +08:00
Attempt at test orchestration to avoid a race condition when running tests in parallel.
2021-08-26 03:33:49 +08:00
Corrected a typo resulting in a cmake warning.
2016-09-07 02:41:48 +08:00
ENDIF(BUILD_UTILITIES)
disabled a remote test that is currently hanging.
2015-05-16 06:08:48 +08:00
Added test_varm3 back in to the list of active tests, to keep it in step with autotools. Corrected configure.ac; CURLOPT_RESPONSE_CODE should have been CURLINFO_RESPONSE_CODE.
2014-03-14 00:06:12 +08:00
IF(ENABLE_DAP_AUTH_TESTS)
1. fix nc_open_mem doxygen description 2. fix some bugs wrt to cygwin vs linux. 3. add to RELEASE_NOTES 4. try to fix tst_inmemory fd error by putting the first arg to dotest in quotes.
2015-05-29 09:23:33 +08:00
##obsolete add_bin_test(ncdap t_auth)
Make cmake run testauth.sh
2015-01-01 13:53:03 +08:00
add_sh_test(ncdap testauth)
Added test_varm3 back in to the list of active tests, to keep it in step with autotools. Corrected configure.ac; CURLOPT_RESPONSE_CODE should have been CURLINFO_RESPONSE_CODE.
2014-03-14 00:06:12 +08:00
ENDIF()
disabled a remote test that is currently hanging.
2015-05-16 06:08:48 +08:00
Added test_varm3 back in to the list of active tests, to keep it in step with autotools. Corrected configure.ac; CURLOPT_RESPONSE_CODE should have been CURLINFO_RESPONSE_CODE.
2014-03-14 00:06:12 +08:00
add_bin_test(ncdap test_varm3)
Avoid spurious test failures when servers fail. re: https://github.com/Unidata/netcdf-c/issues/1451 The situation with the various DAP (and other) remote test servers is currently in a state of flux. For example, Unidata admin is planning to forcibly shift the remote test server to remotetest.unidata.ucar.edu soon. In addition, the server test.opendap.org has shown some recent instability. The result is that various DAP (and byterange) tests can fail unexpectedly. This is an irritant to users and reveals nothing about test sucess or failure. Solve by modifying tests to report server inaccessibility and otherwise pretend to succeed. This puts an onus on Unidata to detect such server failures, but will not cause users to see spurious failures. [Note. Do similar fix for netcdf-java]. The check is: 1. export SETX=1 to cause all the shell scripts to trace 2. search the log files for the phrase "WARNING" (in upper case) and see if it is complaining about not finding a server. Misc. Changes ------------- 1. Added a pingurl program to see if a server was up. 2. modified some test case url targets
2020-01-01 06:42:58 +08:00
add_bin_test(ncdap test_nstride_cached)
disabled a remote test that is currently hanging.
2015-05-16 06:08:48 +08:00
Moved test for [NCF-330] out of 'known-failing' fenceposts and into the regular test rotation. Also added it to the autotools-based tests.
2015-05-09 03:43:59 +08:00
###
# This test relates to NCF-330 in
# the Unidata JIRA system.
###
disabled a remote test that is currently hanging.
2015-05-16 06:08:48 +08:00
#add_bin_test(ncdap t_ncf330)
Added test for issue found in [NCF-330].
2015-05-02 05:28:59 +08:00
Cleaned up indentation, white space in multiple CMakeLists.txt files.
2014-04-22 01:15:33 +08:00
ENDIF()
Added new tests, CMake functionality.
2012-08-22 04:08:53 +08:00
ENDIF()
1. synch with oc 2. fix ocuri parameter handling 3. add ncdap_test/testuri.sh to test parameter handling.
2014-12-28 11:42:01 +08:00
Resolved Conflict when cherry-picking patches.
2014-02-07 02:13:45 +08:00
ADD_SUBDIRECTORY(testdata3)
Added initial 'make dist', 'make distcheck' support to CMake-based builds.
2013-06-04 00:42:04 +08:00
ADD_SUBDIRECTORY(expected3)
ADD_SUBDIRECTORY(expectremote3)
## Specify files to be distributed by 'make dist'
FILE(GLOB CUR_EXTRA_DIST RELATIVE ${CMAKE_CURRENT_SOURCE_DIR} ${CMAKE_CURRENT_SOURCE_DIR}/*.c ${CMAKE_CURRENT_SOURCE_DIR}/*.h ${CMAKE_CURRENT_SOURCE_DIR}/*.sh)
Fix the NC_INMEMORY code to work in all cases with HDF5 1.10. re: github issue https://github.com/Unidata/netcdf-c/issues/1111 One of the less common use cases for the in-memory feature is apparently failing with HDF5-1.10.x. The fix is complicated and requires significant changes to libhdf5/nc4memcb.c. The current setup is detailed in the file docs/inmeminternal.dox. Additionally, it was discovered that the program nc_test/tst_inmemory.c, which is invoked by nc_test/run_inmemory.sh, actually was failing because of the above problem. But the failure is not detected since the script does not return non-zero value. Other Changes: 1. Fix nc_test_tst_inmemory to return errors correctly. 2. Make ncdap_tests/findtestserver.c and dap4_tests/findtestserver4.c be generated from ncdap_test/findtestserver.c.in. 3. Make LOG() print output to stderr instead of stdout to avoid contaminating e.g. ncdump output. 4. Modify the handling of NC_INMEMORY and NC_DISKLESS flags to properly handle that NC_DISKLESS => NC_INMEMORY. This affects a number of code pieces, especially memio.c.
2018-09-05 01:27:47 +08:00
SET(CUR_EXTRA_DIST ${CUR_EXTRA_DIST} findtestserver.c.in CMakeLists.txt Makefile.am)
Add http auth test to cmake
2013-11-16 04:44:27 +08:00
ADD_EXTRA_DIST("${CUR_EXTRA_DIST}")
Reference in New Issue Copy Permalink