Go to file
Dennis Heimbigner aeb3ac2809 Mostly revert the filter code to reduce its complexity of use.
re: https://github.com/Unidata/netcdf-c/issues/1836

Revert the internal filter code to simplify it. From the user's
point of view, the only visible changes should be:

1. The functions that convert text to filter specs have had their signature reverted and have been moved to netcdf_aux.h
2. Some filter API functions now return NC_ENOFILTER when inquiry is made about some filter.

Internally,the dispatch table has been modified to get rid of the filter_actions
entry and associated complex structures. It has been replaced with
inq_var_filter_ids and inq_var_filter_info entries and the dispatch table
version has been bumped to 3. Corresponding NOOP and NOTNC4 functions
were added to libdispatch/dnotnc4.c. Also, the filter_action entries
in dispatch tables were replaced for all dispatch code bases (HDF5, DAP2,
etc). This should only impact UDF users.

In the process, it became clear that the form of the filters
field in NC_VAR_INFO_T was format dependent, so I converted it to
be of type void* and pushed its management into the various dispatch
code bases. Specifically libhdf5 and libnczarr now manage the filters
field in their own way.

The auxilliary functions for parsing textual filter specifications
were moved to netcdf_aux.h and were renamed to the following:
* ncaux_h5filterspec_parse
* ncaux_h5filterspec_parselist
* ncaux_h5filterspec_free
* ncaux_h5filter_fix8

Misc. Other Changes:

1. Document NUG/filters.md updated to reflect the changes above.
2. All the old data types (structs and enums)
   used by filter_actions actions were deleted.
   The exception is the NC_H5_Filterspec because it is needed
   by ncaux_h5filterspec_parselist.
3. Clientside filters were removed -- another enhancement
   for which no-one ever asked.
4. The ability to remove filters was itself removed.
5. Some functionality needed by nczarr was moved from libhdf5
   to libsrc4 e.g. nc4_find_default_chunksizes
6. All the filterx code was removed
7. ncfilter.h and nc4filter.c no longer used

Misc. Unrelated Changes:

1. The nczarr_test makefile clean was leaving some directories; so
   add clean-local to take care of them.
2020-09-27 12:43:46 -06:00
.github Moved code of conduct and contributing to .github folder. 2019-10-08 10:27:32 -06:00
cmake
conda.recipe
ctest_scripts Added a ctest script with DAP tests enabled. 2020-02-11 15:09:29 -07:00
dap4_test This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
debug force check retry 2020-09-12 15:30:42 -06:00
docs Email Removal 2020-07-28 12:15:04 -04:00
examples Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
h5_test fixed tst_h_par_compress.c 2020-08-12 07:28:49 -06:00
hdf4_test Spelling fixes 2019-09-18 08:03:01 -06:00
include Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
libdap2 Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
libdap4 Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
libdispatch Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
libhdf4 Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
libhdf5 Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
liblib Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
libnczarr Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
libsrc Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
libsrc4 Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
libsrcp Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
nc_perf getting tst_gfs_data_1 ready to merge 2020-07-08 14:20:42 -06:00
nc_test Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
nc_test4 Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
ncdap_test Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
ncdump Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
ncgen Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
ncgen3 Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
nctest Spelling fixes 2019-09-18 08:03:01 -06:00
nczarr_test Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
NUG Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
oc2 Merge branch 'ncgenchunks.dmh' of https://github.com/DennisHeimbigner/netcdf-c into master 2020-09-09 10:24:33 -06:00
plugins Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
unit_test Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
.gitignore Shuffling NUG and documentation. 2020-02-06 16:14:25 -07:00
.travis.yml Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
acinclude.m4
appveyor.yml
bootstrap
cmake_uninstall.cmake.in
CMakeInstallation.cmake
CMakeLists.txt Use the built-in HDF5 byte-range reader, if available. 2020-09-24 14:33:58 -06:00
COMPILE.cmake.txt Restoring CMake compilation document. 2019-10-10 13:30:05 -06:00
config.h.cmake.in Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
config.h.cmake.in.old-works
configure.ac Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
COPYRIGHT
CTestConfig.cmake.in Adding new security stance to cdash instance. 2019-11-18 10:58:44 -07:00
CTestCustom.cmake
dods.m4 Spelling fixes 2019-09-18 08:03:01 -06:00
FixBundle.cmake.in
INSTALL.md Added a note about running autoreconf -if in support of https://github.com/Unidata/netcdf-c/issues/1397 2019-08-27 11:24:25 -06:00
lib_flags.am Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
libnetcdf.settings.in Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
Makefile.am Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
mclean
nc-config.cmake.in
nc-config.in Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
netcdf.pc.in
netCDFConfig.cmake.in Correct typo. 2020-01-24 16:53:16 -07:00
PostInstall.cmake
postinstall.sh.in Fix typo postinstall. 2020-08-06 15:27:20 -04:00
README.md Updated README.md Links 2020-06-04 14:16:30 -04:00
RELEASE_NOTES.md Mostly revert the filter code to reduce its complexity of use. 2020-09-27 12:43:46 -06:00
test_common.in Revert "Revert "Fix nczarr-experimental: improve build support, disengage hdf5 vs netcdf4 flags, and find AWS libraries"" 2020-08-17 19:15:47 -06:00
test_prog.c
test-driver-verbose
wjna

Unidata NetCDF

Build Status Coverity Scan Build Status

About

The Unidata network Common Data Form (netCDF) is an interface for scientific data access and a freely-distributed software library that provides an implementation of the interface. The netCDF library also defines a machine-independent format for representing scientific data. Together, the interface, library, and format support the creation, access, and sharing of scientific data. The current netCDF software provides C interfaces for applications and data. Separate software distributions available from Unidata provide Java, Fortran, Python, and C++ interfaces. They have been tested on various common platforms.

Properties

NetCDF files are self-describing, network-transparent, directly accessible, and extendible. Self-describing means that a netCDF file includes information about the data it contains. Network-transparent means that a netCDF file is represented in a form that can be accessed by computers with different ways of storing integers, characters, and floating-point numbers. Direct-access means that a small subset of a large dataset may be accessed efficiently, without first reading through all the preceding data. Extendible means that data can be appended to a netCDF dataset without copying it or redefining its structure.

Use

NetCDF is useful for supporting access to diverse kinds of scientific data in heterogeneous networking environments and for writing application software that does not depend on application-specific formats. For information about a variety of analysis and display packages that have been developed to analyze and display data in netCDF form, see

More information

For more information about netCDF, see

Latest releases

You can obtain a copy of the latest released version of netCDF software for various languages:

Copyright and licensing information can be found here, as well as in the COPYRIGHT file accompanying the software

Installation

To install the netCDF-C software, please see the file INSTALL in the netCDF-C distribution, or the (usually more up-to-date) document:

Documentation

A language-independent User's Guide for netCDF, and some other language-specific user-level documents are available from:

A mailing list, netcdfgroup@unidata.ucar.edu, exists for discussion of the netCDF interface and announcements about netCDF bugs, fixes, and enhancements. For information about how to subscribe, see the URL

Feedback

We appreciate feedback from users of this package. Please send comments, suggestions, and bug reports to support-netcdf@unidata.ucar.edu.