Commit Graph

271 Commits

Author SHA1 Message Date
Dennis Heimbigner
1299a0fcee The Jetstream remote test server is now working.
So it now becomes the first default test server to try.
This also means that the dap4 remote testing is enabled.
The only issue to watch is to see if the jetstream-based
server can stay up for significant periods of time.
A uptimerobot (https://uptimerobot.com) has been set ups
to monitor this hourly, so we shall see.
2018-06-26 13:58:45 -06:00
Dennis Heimbigner
ee509ff4f3 Re-Implement the nc_get/put_vars operations for netcdf-4 using the
corresponding HDF5 operations.

re: github issue https://github.com/Unidata/netcdf-c/issues/908
also in reference to https://github.com/pydata/xarray/issues/2004

The netcdf-c library has implemented the nc_get_vars and nc_put_vars
operations as element at a time. This has resulted in very slow
operation.

This pr attempts to improve the situation for netcdf-4/hdf5 files
by using the slab operations provided by the hdf5 library. The new
implementation passes the get/put vars stride information down to
the hdf5 slab operations.

The result appears to improve performance significantly. Some simple
tests on large 2-D arrays shows speedups in excess of 150.

Misc. other changes:
1. fix bug in ncgen/semantics.c; using a list's allocated length
   instead of actual length.
2. Added a temporary hook in the netcdf library plus a performance
   test case (tst_varsperf.c) to estimate the speedup. After users
   have had some experience with this, I will remove it, probably
   after the 4.7 release.
2018-05-22 16:50:52 -06:00
Ward Fisher
c9d1589c39
Merge branch 'master' into cleanncgen.dmh 2018-05-16 14:31:11 -06:00
Ward Fisher
75a3e8997e Updated release notes to reference https://github.com/Unidata/netcdf-c/pull/879 2018-05-04 17:01:19 -06:00
Ward Fisher
0f36b279be Merge remote-tracking branch 'origin/cleanncgen.dmh' into pr-aggregate.wif 2018-04-20 13:06:26 -06:00
Ward Fisher
1ff184d988 Enabled CDF5 support by default, in support of https://github.com/Unidata/netcdf-c/issues/931 2018-04-19 13:26:58 -06:00
Ward Fisher
b7c6618392 Updated release notes to reflect delay in pushing out new release. 2018-03-18 17:06:49 -06:00
Ward Fisher
8536e7c765 Updated release notes in support of the v4.6.1 release. 2018-03-15 14:34:57 -06:00
Ward Fisher
a699d37816 Updated release notes. 2018-03-15 11:03:38 -06:00
Ward Fisher
ffa36e69c9 Updated release notes. 2018-02-28 14:32:45 -07:00
Ward Fisher
a3ea416eb5 Updated release notes in reference to https://github.com/Unidata/netcdf-c/pull/849 2018-02-16 13:05:45 -07:00
Ward Fisher
b20bc97a3c Updated release notes in support of https://github.com/Unidata/netcdf-c/pull/853 2018-02-08 12:55:45 -07:00
Ward Fisher
334734ca4d Bumped release date for 4.6.0 in release notes. 2018-01-24 15:48:21 -07:00
Ward Fisher
8f6c1ed6c7 Preparing for 4.6.1 dev cycle. 2018-01-24 15:46:38 -07:00
Ward Fisher
2341f9f2b4 Updated release notes 2017-11-21 12:49:14 -07:00
Ward Fisher
16d6f94f30 Merge branch 'master' into filters.dmh 2017-11-13 11:15:02 -07:00
Dennis Heimbigner
4ee89ed71b Fix conflicts with master 2017-11-06 13:15:10 -07:00
Ward Fisher
bedff7cfc6 Updated release notes. 2017-11-03 12:45:00 -06:00
Ward Fisher
1b1c441b6d Updated release notes 2017-11-01 16:55:13 -06:00
Dennis Heimbigner
2d77e6451b Master merge 2017-10-28 14:06:39 -06:00
Ward Fisher
b7517758c5 Updated release notes in support of https://github.com/Unidata/netcdf-c/pulls/511 2017-10-23 15:54:17 -06:00
Dennis Heimbigner
440cf724ad Update by merging with master 2017-10-21 13:37:09 -06:00
Ward Fisher
c147f8203a Updated release date. 2017-10-20 11:20:38 -06:00
Ward Fisher
58874fd452 Updated release date in the release notes. 2017-10-17 13:19:19 -06:00
Ward Fisher
631741b0e3 Updated the release notes to reflect the fix provided by https://github.com/Unidata/netcdf-c/pull/449 . 2017-10-16 11:03:28 -06:00
Ward Fisher
e59c0f4753 Updated release notes in support of https://github.com/Unidata/netcdf-c/issues/359. 2017-10-11 10:09:35 -06:00
Dennis Heimbigner
733da154c5 1. Keep up to date by merging master
2. Factored out the parameter string parsing for ncgen and nccopy
   int libdispatch/dfilter.c + include/ncfilter.h
3. Allow a parameter string to use constant types other than
   unsigned int. See docs/filters.md for details.
4. Moved the old content of  include/netcdf_filter.h into include/netcdf.h
   and removed include/netcdf_filter.h as no longer needed.
5. Force the test filter (bzip2) in nc_test4/filter_test to
   be built using BUILT_SOURCES.
2017-10-08 15:56:45 -06:00
Ward Fisher
086523b6ce Updated release notes. 2017-09-29 10:12:25 -06:00
Ward Fisher
69977fd10b Updated release notes. 2017-09-27 12:01:32 -06:00
Ward Fisher
34c66df07b Updated release notes to reference https://github.com/Unidata/netcdf-c/pull/488 2017-09-25 13:15:28 -06:00
Ward Fisher
4b35c43a5e Updated release notes. 2017-09-18 14:44:17 -06:00
Ward Fisher
db7f9c518a Updated release notes in relation to https://github.com/Unidata/netcdf-c/issues/425 and https://github.com/Unidata/netcdf-c/issues/463 2017-09-01 12:36:12 -06:00
Ward Fisher
2bf1f68cf7 Updated release notes in support of https://github.com/Unidata/netcdf-c/pull/473 2017-08-30 12:24:52 -06:00
Dennis Heimbigner
7e8bd784cc Merge branch 'master' into filters.dmh 2017-08-17 14:29:34 -06:00
Dennis Heimbigner
86fc8745dc merge master and resolve conflicts 2017-08-12 15:50:31 -06:00
Ward Fisher
5f0e76b281 Updated release notes. 2017-08-09 14:12:24 -06:00
Ward Fisher
ac503dd565 Updated release notes in support of https://github.com/Unidata/netcdf-c/pull/450 2017-08-08 13:17:51 -06:00
Ward Fisher
a3f2dcff3c Corrected release date for rc2 2017-08-07 10:13:27 -06:00
Ward Fisher
0a02f0cac7 Updated release notes for 4.5.0-rc2 2017-08-03 17:01:16 -06:00
Ward Fisher
401fcc572a Updated release notes in support of https://github.com/Unidata/netcdf-c/issues/385 2017-07-14 10:43:19 -06:00
Ward Fisher
fd2c575597 Updated release notes. 2017-06-29 11:16:02 -06:00
Ward Fisher
40f616488c Corrected release notes again. 2017-06-07 17:14:04 -06:00
Ward Fisher
4d941f5f02 Corrected release notes. 2017-06-07 15:27:11 -06:00
Ward Fisher
ff8b93a1d6 Bumped release date. 2017-06-05 10:32:06 -06:00
Ward Fisher
ec33411c6c Bumped revision information to next version. 2017-06-01 13:35:39 -06:00
Ward Fisher
237594806e Updated release notes in support of https://github.com/Unidata/netcdf-c/issues/410 2017-05-31 09:42:06 -06:00
Ward Fisher
6e0f17f0ac Updated release notes in support of the fix for https://github.com/Unidata/netcdf-c/issues/339 2017-05-24 14:46:08 -06:00
Ward Fisher
f710b29d44 Updated release notes. 2017-05-24 14:03:50 -06:00
Dennis Heimbigner
c834d4af12 merge from master 2017-05-10 12:33:03 -06:00
Ward Fisher
ce20f3bf53 Corrected a build issue on windows for tst_diskless5, and updated release notes. 2017-05-04 10:58:18 -06:00