Commit Graph

590 Commits

Author SHA1 Message Date
Dennis Heimbigner
5536bccee1 allow NC_DISKLESS with nc_open() to operate as a in-memory cache 2012-04-08 22:47:38 +00:00
Dennis Heimbigner
7e27052f87 - Implemented diskless files for both netcdf classic and extended.
The in-memory files can be made persistent if nc_create is called with
  NC_DISKLESS|NC_WRITE flags set. Initial test case also included.
- Modified ncio mechanism to support
  multiple ncio packages; this is so we
  can have posixio and memio operating
  at the same time.
- cleanup up a bunch of lint issues (unused variables, etc).
2012-03-26 01:34:32 +00:00
Dennis Heimbigner
99eef24bc2 - Fix NCF-158 to modify ncgen flag defaults.
- Fix NCF-157 to modify DAP code to support
  partial variable retrieval.
- Fix of NCF-154 to solve problem of ncgen
  improperly processing data lists for variables
  of size greater than 2**18 bytes.
- Fix ncgen processing of char variables that have
  multiple unlimited dimensions.
- Partly fix Jira issue: NCF-145 (vlen issues).
- Benchmark program nc_test4/tst_ar4_*) requires arguments
  and should only be invoked inside a shell
  script; fixed so that they terminate cleanly
  if invoked with no arguments.
- Fix the Doxygen processing so it will work
  with make distcheck.
- Begin switchover to using an alternative to ncio.
- Begin support for in-memory (diskless) files.
2012-03-14 23:26:48 +00:00
Russ Rew
07a5f4fd1a Peter Cao's valgrind fixes for nc4file.c 2012-03-14 03:48:30 +00:00
Russ Rew
d412686ec3 Fix Jeff Whittaker's bug NCF-156 2012-03-09 19:19:43 +00:00
Russ Rew
22beaf407c Fix bug with scalar coordinate variables in netCDF-4 files, causing failure with --enable-extra-tests, [NCF-149] 2012-03-01 02:06:14 +00:00
Russ Rew
75e00f3341 Fix bug triggered by --enable-logging. 2012-02-27 23:00:07 +00:00
Russ Rew
fbbdeccc2e Fix performance bug for many variables or types in a group 2012-02-21 13:46:22 +00:00
Russ Rew
6b075d6ab2 Fix bug for netCDF-4 files, where fill values are written by HDF5 even when NOFILL mode is set. Add to ncdump documentation note about handling embedded newlines in strings. 2012-02-15 22:21:47 +00:00
Russ Rew
37b6fbe959 Fix Jira bug NCF-143, found by Wei Huang. Also apply previous NCF-141 fix for nc_get_vara() to nc_put_vara() as well. 2012-02-01 23:52:10 +00:00
Russ Rew
9d2c29045c Fix Jira bug NCF-141 and finish bug fix for NCF-139 2012-01-30 22:10:23 +00:00
Dennis Heimbigner
aebd11348a 1)Integrate the oc with improved performance 2012-01-29 18:56:29 +00:00
Russ Rew
e7b2f2b4c6 Revert last change after discovering problem 2012-01-17 22:49:01 +00:00
Russ Rew
67304dc7e2 Fix Jira issue NCF-138, bad default chunksize for variables with only unlimited dimensions 2012-01-17 21:58:09 +00:00
Ed Hartnett
9e30d5d3be some windows changes 2011-10-26 19:18:09 +00:00
Ed Hartnett
7b47adf3a1 removed executable permissions from all code files 2011-10-04 16:05:11 +00:00
Ed Hartnett
59af73d256 removing executable flag 2011-10-04 15:59:40 +00:00
Ed Hartnett
ff498d2c3a changed permissions 2011-09-26 13:46:43 +00:00
Ed Hartnett
8945e92708 fixed some missing config.h problems 2011-09-26 10:14:55 +00:00
Dennis Heimbigner
732fbff7ce 2011-09-20 17:30:02 +00:00
Russ Rew
b658836a6e Finish handling bounds variables with ncdump -t (NCF-70). Fix bug with permitted dimension sizes in netCDF classic files (NCF-117). 2011-09-05 16:09:17 +00:00
Ed Hartnett
d58c18c623 added diskless files API, subsetting not working, classic model only 2011-08-16 21:04:33 +00:00
Ed Hartnett
9212be6606 took out fortran API, made some documentation changes 2011-08-11 17:54:34 +00:00
Ed Hartnett
2b2bcded42 removed cxx and cxx4, bumped version to 4.2, and fixed up documentation some 2011-08-10 18:00:32 +00:00
Ed Hartnett
b377906536 beginning of conversion to doxygen 2011-07-11 16:04:49 +00:00
Russ Rew
b3b7861756 Fix ncdump/tst_compress bug that shows up on Solaris systems. Fix default variable chunksize algorithm. 2011-06-23 17:15:01 +00:00
Ed Hartnett
e7b3fa19c1 removed mention of pnetcdf and hdf4 link options as they are handled by configure 2011-05-31 15:03:31 +00:00
Ed Hartnett
d469f39e3c workaround for HDF5 dimscale issue 2011-05-19 19:22:43 +00:00
Ed Hartnett
e2685a1475 changes to remove EXTERN_LDFLAG from build, also to fix netCDF-4 sync bug 2011-05-17 19:14:35 +00:00
Dennis Heimbigner
fec4cdb230 Fixed the following Jira minor bugs:
NCF-42: _Format attribute sometimes being ignored
NCF-43: Fixed unsigned long long parsing.
NCF-47: Make opendap code properly handle illegal names like "x.y" by
        supressing them
NCF-49: check for uint type
NCF-50: properly handle username:pwd embedded in urls.
2011-05-12 17:51:32 +00:00
Ed Hartnett
8d99e0b43a more changes for mingw/DLL builds 2011-05-11 19:51:11 +00:00
Ed Hartnett
2f4cf5382e took out ldflags in Makefile.am files 2011-05-11 17:09:12 +00:00
Ed Hartnett
8559e6f976 added test that activates classic library bug 2011-04-25 17:09:14 +00:00
Ed Hartnett
882b48f017 fixed HDF5 object versioning so that all netCDF-4 files can be read by HDF5-1.8.x releases 2011-04-25 11:10:24 +00:00
Dennis Heimbigner
0b477e29cc rebuilt dap constraints 2011-04-16 20:56:36 +00:00
Ed Hartnett
0259975e26 changes in response to user feedback to rc1, plus cleaned up H5 test dependancy 2011-03-21 15:45:17 +00:00
Ed Hartnett
e5c8e924e2 more tests for Jeff W. 2011-03-21 09:47:37 +00:00
Ed Hartnett
d334706ffe added math library 2011-03-18 12:20:13 +00:00
Ed Hartnett
965a3aac70 minor refactor of the build system to work better for cross-compiling 2011-03-15 10:19:08 +00:00
Ed Hartnett
ff3abf1427 fixed some confusion about create mode flag NC_CLASSIC_MODEL 2011-02-23 23:39:25 +00:00
Dennis Heimbigner
bc5abe766e fixed opendap perf. bug for nc_get_vars 2011-02-23 17:37:11 +00:00
Ed Hartnett
ca6b34a92c changes to only run tst_many_atts when benchmarks are turned on, and to fix minor bug: handling of a scalar dimension and scalar var of same name 2011-02-23 17:33:11 +00:00
Ed Hartnett
32735883cd fixed bug that was showing up in buddy extra-tests 2011-02-22 19:27:20 +00:00
Ed Hartnett
b9358f5890 updated (and fixed) shared library version numbers for all netcdf libraries 2011-02-17 12:58:08 +00:00
Ed Hartnett
2f9339e3af fixed integer overflow for ginormous data sizes on 32-bit build 2011-02-15 15:47:10 +00:00
Ed Hartnett
8d91b49ad2 added overhang (not hangover) calculations to default chunksizes 2011-02-14 19:15:36 +00:00
Ed Hartnett
3340b641fd fixed bug that allowed for zero chunksize when one small, and two giant dimension sizes are used 2011-02-14 16:49:05 +00:00
Ed Hartnett
6b0feecb05 some improvements to chunking algorithm 2011-02-09 12:23:09 +00:00
Ed Hartnett
d6a3fb724c fix bug in checking magnitudes of dims when determining default chunk sizes, in the case of unlimited dimensions. 2011-02-08 19:35:33 +00:00
Ed Hartnett
ca11ffde62 fixed test of wasted space for default chunking 2011-02-04 20:22:34 +00:00
Ed Hartnett
5da7f43a3f more changes for extreme dimension sizes and default chunking 2011-02-04 20:00:22 +00:00
Ed Hartnett
b47678006e changed default chunksize calculations so they will not have integer overflows, even on 32-bit machines with huge datasets 2011-02-04 17:17:08 +00:00
Ed Hartnett
ba1b41b160 more fixes for handling default chunks sizes with very large variables 2011-02-03 17:41:02 +00:00
Ed Hartnett
c03aabe083 fixed default chunking for some really big dimensions 2011-02-03 16:50:51 +00:00
Ed Hartnett
668ed2e0a5 fixed chunking bug: default chunks must always be under 4GB in size 2011-02-02 14:09:15 +00:00
Ed Hartnett
bb07a21f1f added chunksize test code from Russ to help develop better default chunks 2011-01-31 22:15:37 +00:00
Ed Hartnett
1d86c471a6 fixed def_var_chunking bug when chunksizes are not provided, but chunking is turned on 2011-01-31 21:30:39 +00:00
Ed Hartnett
cdd254c983 added -lm to please fedore netcdf package maintainer 2011-01-31 11:40:56 +00:00
Ed Hartnett
2ebb1cbafc fixed problems with parallel I/O of classic files with pnetcdf library 2011-01-28 12:45:52 +00:00
Ed Hartnett
14795ffaf1 fixed memory leak when adding to unlimited dimension 2011-01-12 23:18:32 +00:00
Ed Hartnett
52d1a2b74e init data space to shut up valgrind 2011-01-04 13:26:55 +00:00
Russ Rew
b37a176fa0 Clarified documentation for nc_inq_grp_ncid(), differentiating it from nc_inq_ncid(). Fixed problem returning values from functions declared void in some libsrc4/ test programs. Added test for bug in ncdump for dimensions with same name in nested groups, and fix for bug. Fixed nccopy bug involving dimensions with smae name in nested groups. Added code for specifying chunking by dimension to nccopy (but not implemented yet). 2010-12-30 18:17:04 +00:00
Ed Hartnett
94210cb492 fixed HDF4 build memory problem 2010-12-06 16:27:08 +00:00
Ed Hartnett
d66a45f05c optimized way special dimid is written or updated. 2010-12-03 00:03:48 +00:00
Ed Hartnett
edc5c64e54 optimized way special dimid is searched for when var is opened. 2010-12-02 23:52:53 +00:00
Ed Hartnett
184b2d0945 freed new path string for nc3 and nc4 files 2010-12-01 18:21:47 +00:00
Ed Hartnett
03f63a5f1c many changes for memory fixes 2010-11-29 22:23:16 +00:00
Dennis Heimbigner
c96133ded7 removed extraneous global variable 2010-11-24 23:12:20 +00:00
Ed Hartnett
35b0c5422d got benchmark build working agian 2010-11-12 18:09:12 +00:00
Dennis Heimbigner
b2c05fa4d0 fixed:
ncgen: nan bug
       made semicolons optional after type decls
libncdap{3,4}: revamped the NC surrogate to better match
       with libsrc
libdispatch: Added a new_nc function to the dispatch table; its purpose
                 is to allow hierarchical use of NC compatible data structures.
libsrc: cleaned up the NC structure by removing drno field
general: removed --with-oc options
2010-11-09 22:53:03 +00:00
Ed Hartnett
2a88503f52 added missing file 2010-10-14 11:07:53 +00:00
Ed Hartnett
a658960034 added more valgrind testing 2010-10-13 22:53:25 +00:00
Ed Hartnett
c9033810e1 added many valgrind tests in libsrc4, fixed some memory problems 2010-10-12 09:12:08 +00:00
Ed Hartnett
d8cdc2085d more testing of HDF5 vlen type 2010-10-11 14:52:29 +00:00
Ed Hartnett
65c54d88f5 fixed some AIX portability issues, added tests, especially valgrind tests 2010-10-08 18:54:53 +00:00
Russ Rew
0a26928f44 test both for fill-value and non fill-value 2010-10-06 16:28:33 +00:00
Ed Hartnett
60a6253832 fixed NC_SHORT conversion bug 2010-10-06 15:50:42 +00:00
Russ Rew
8416eb3be2 clean up test for USHORT conversions bug fix 2010-10-05 22:11:18 +00:00
Russ Rew
c9956d3674 provide test for USHORT conversions bug fix 2010-10-05 22:04:34 +00:00
Russ Rew
cad6e425e2 fix bug with USHORT conversions 2010-10-05 17:24:58 +00:00
Ed Hartnett
105fe5fed1 fixed extra-test bug, return code from nc_inq_var_* functions with bad ncids, bumped version to beta2 2010-09-24 15:55:54 +00:00
Ed Hartnett
d53c6bdcfc fixed bug with nf90_inquire_variable returning range error because of chunksizes for a contiguous variable 2010-09-22 14:25:42 +00:00
Ed Hartnett
c6fcf09bc6 missing file added 2010-09-22 13:50:32 +00:00
Ed Hartnett
54297ac014 changed way that netcdf-4 scans HDF5 file on open for big performance boost 2010-09-22 13:38:15 +00:00
Ed Hartnett
e9ab6a9157 fixed bug in HDF5-only test, in which chunk sizes were not being set 2010-09-16 14:23:43 +00:00
Ed Hartnett
bf85289d71 commented out H5close call 2010-09-11 16:19:13 +00:00
Russ Rew
20b1e1615a Allow double NaNs and Infinities in double to double conversions. Add tests for nccopy deflation, shuffling, and dimension-fixing options. Add man-page documentation for new nccopy topions, with examples. Run tst_nccopy3.sh test even for netCDF-4 builds. 2010-08-31 22:41:00 +00:00
Russ Rew
4ce85da310 nccopy changes to support compression 2010-08-29 15:08:12 +00:00
Russ Rew
9bc3bd538c Undoing change committed in r400 2010-08-27 21:57:40 +00:00
Russ Rew
1f39119f8f Ignore attempt to compress scalar variables, instead of returning an error. Add compression and shuffling options, option to fix unlimited dimensions. 2010-08-27 21:02:52 +00:00
Ed Hartnett
a27fd4390c added opendap memory test 2010-08-20 17:20:32 +00:00
Ed Hartnett
469731fd88 inq path works for netcdf-4 2010-08-19 18:15:48 +00:00
Ed Hartnett
1aedb82327 fixed some memory problems, more progress towards nc_inq_path 2010-08-19 17:37:29 +00:00
Ed Hartnett
a0e1b037e5 added nc_inq_path in dispatch tables 2010-08-18 15:11:17 +00:00
Dennis Heimbigner
dd4fe6d25c dispatch.h->ncdispatch.h to avoid visualstudio filename conflict 2010-08-05 02:44:59 +00:00
Dennis Heimbigner
6edff3f964 cleanup pre-dispatch stuff 2010-07-30 22:16:15 +00:00
Dennis Heimbigner
c5cb1104b7 removed USE_DISPATCH and most uses of nc3 from libsrc4 2010-07-30 19:20:22 +00:00
Dennis Heimbigner
32b819ada8 add nc_default_format support 2010-07-22 21:50:51 +00:00
Ed Hartnett
45a6f02d7c some changes to get build working on bluefire 2010-07-09 20:57:09 +00:00
Ed Hartnett
0c0576862d fix for out of order dimensions after enddef/redef, then definition of coordinate variables 2010-07-08 13:39:47 +00:00
Ed Hartnett
96970bba9e fixed HDF4 problem with allocated metadata storage 2010-07-06 14:56:28 +00:00
Ed Hartnett
a106e959bc removed more memory use for netcdf-4 performance 2010-07-01 16:02:10 +00:00
Ed Hartnett
8131df9f40 cleaned up memory use in enums and compound types and variables 2010-07-01 15:51:19 +00:00
Ed Hartnett
eb9f666352 reduced memory use for dimensions in netcdf-4 2010-07-01 13:36:41 +00:00
Ed Hartnett
1d5bbb7cfa reduced memory use of type structs for netcdf-4 2010-07-01 13:17:54 +00:00
Ed Hartnett
ad5466af24 reduced memory use for attributes 2010-07-01 13:08:28 +00:00
Ed Hartnett
bc6c5a071b took out more per-variable memory for netCDF-4 files 2010-07-01 12:52:44 +00:00
Ed Hartnett
0e855e0dc5 more changes to make netcdf-4 use less memory per variable 2010-07-01 11:39:34 +00:00
Ed Hartnett
2ca9240913 removed more memory hogging arrays from NC_VAR_INFO_T to improve netcdf-4 memory performance 2010-06-30 21:16:50 +00:00
Ed Hartnett
6db57b7f09 made var->chunksizes array allocated intead of fixed size, to improve memory performance of netCDF-4 2010-06-30 21:05:11 +00:00
Ed Hartnett
0b5fdedb12 fixed HDF5 error messages when file without creation ordering is opened 2010-06-30 15:34:31 +00:00
Ed Hartnett
f1bea72f66 fixed position of test in list, which matters for extra-test builds, and fixed its error handling 2010-06-29 13:03:46 +00:00
Ed Hartnett
f0a72cbefb fixed broken classic-only build 2010-06-28 17:17:43 +00:00
Ed Hartnett
0f7f58d85c added tst_interops6.c 2010-06-25 14:51:46 +00:00
Ed Hartnett
4220dca07a broke out test into libsrc/tst_interops6.c to help find memory problem 2010-06-25 14:51:16 +00:00
Russ Rew
ef66f0cc06 Merged latest trunk changes to my branch. 2010-06-24 22:07:01 +00:00
Ed Hartnett
2ddea973a3 fixed valgrind tests some more 2010-06-24 08:52:03 +00:00
Russ Rew
07967fba22 Merged latest trunk changes to my branch. 2010-06-24 05:23:23 +00:00
Ed Hartnett
663e344099 changes 2010-06-23 18:43:18 +00:00
Ed Hartnett
9da0b67627 fixed some automake issues to get distcheck working 2010-06-23 17:48:10 +00:00
Ed Hartnett
f6447ee94c fixed extra-test libsrc4/tst_h_vl2 problem and valgrind test problems 2010-06-23 13:57:33 +00:00
Ed Hartnett
204685b257 got valgrind tests to pass 2010-06-23 13:20:39 +00:00
Russ Rew
8a013d4f51 Changed calls in tests from deprecated _ubyte functions to equivalent
_uchar functions.
2010-06-22 22:41:04 +00:00
Ed Hartnett
a2593be245 some changes 2010-06-22 17:12:29 +00:00
Ed Hartnett
e5512f4e56 removed v2 test in nc_test4 when --enable-c-only is used 2010-06-22 10:18:15 +00:00
Ed Hartnett
bb57cf2e4b moved functions out of m4 into c files in libdispatch/netcdf.m4 2010-06-18 14:01:51 +00:00
Ed Hartnett
8c64a1e8fe turned off more bad error output from tst_h_vl2.c. 2010-06-17 16:21:13 +00:00
Ed Hartnett
1033ba1e4e turned off too much error output from tst_h_vl2.c 2010-06-17 16:16:16 +00:00
Ed Hartnett
0b54b49991 moved some tests which used v2 API from libsrc4 to nc_test4, to allow the library to be built before the tests 2010-06-15 15:24:28 +00:00
Ed Hartnett
552151d61a fix libnetcdf2 problems with enable-c-only build in libsrc4 and libncdap4 2010-06-14 18:41:52 +00:00
Ed Hartnett
6db9f29704 removed libsrc4/old_*.c files 2010-06-14 12:58:10 +00:00
Ed Hartnett
57d743dddb fixed build problems for libcf/gridspec, pnetcdf, and hdf4 2010-06-10 17:18:48 +00:00
Ed Hartnett
1e87ea9cbd fixed shared build problems 2010-06-09 16:01:32 +00:00
Ed Hartnett
d2b5d51982 fixed bad include of error.h 2010-06-08 12:39:28 +00:00
Ed Hartnett
bb0035c95d fixed Makefile.am includes to find new netcdf.h location 2010-06-07 15:40:31 +00:00
Ed Hartnett
7afbaa4b52 merged trunk up to revision 75, move v2 API 2010-06-07 11:12:14 +00:00
Ed Hartnett
1ba136e4cd fixed makefile problems to allow make dist to work 2010-06-04 12:23:10 +00:00
Ed Hartnett
cdabf7bbf4 build system clean-up 2010-06-03 20:33:02 +00:00
Ed Hartnett
92ccf1c5fa moved headers to include directory 2010-06-03 20:22:55 +00:00
Ed Hartnett
18f4bca367 moving to trunk subdir 2010-06-03 13:24:43 +00:00