Commit Graph

585 Commits

Author SHA1 Message Date
Ed Hartnett
3a08d85e13 clean up 2018-07-12 07:08:27 -06:00
Ed Hartnett
786c5a8f2e moved hdf5 specific header stuff to hdf5internal.h 2018-07-12 07:05:21 -06:00
Ed Hartnett
0fed77be82 fixed warning 2018-07-06 06:32:09 -06:00
Dennis Heimbigner
30a4dea21c Disable tst_varsperf; should only be run manually 2018-06-26 15:14:31 -06:00
Ed Hartnett
97faffe072 fixed test issue 2018-06-21 06:51:45 -06:00
Ed Hartnett
d5baca7f97 fixed test issue 2018-06-21 06:36:12 -06:00
Ed Hartnett
eafe151f13 added test 2018-06-19 14:59:07 -06:00
Ed Hartnett
2dc6676bd8 now checking for classic model 2018-06-19 07:30:08 -06:00
Ed Hartnett
828fa3e0a5 changes to tst_varsperf to remove asserts 2018-06-12 07:30:49 -06:00
Ed Hartnett
fb570522bc merged in ejh_fix_user_type 2018-06-12 06:49:40 -06:00
Ed Hartnett
752030f59a merged ejh_test_exten_unlim_no_coord 2018-06-12 06:22:26 -06:00
Ed Hartnett
9e5924ebb4
Merge branch 'master' into ejh_more_testing 2018-06-11 15:58:36 -06:00
Ed Hartnett
12db5e22f3 added test of extending unlimited dim with no coord var 2018-06-11 06:17:52 -06:00
Ward Fisher
5fe7d0ffad
Merge branch 'master' into ejh_udf 2018-06-08 16:52:20 -06:00
Ward Fisher
df4942d280 Merge branch 'master' into vars.dmh 2018-06-08 15:50:28 -06:00
Ed Hartnett
c1106c5f18 szip may not be present 2018-06-08 04:46:33 -06:00
Ed Hartnett
a721f91d45 merged master 2018-06-08 04:44:44 -06:00
Ed Hartnett
367d7c2a57 merged master 2018-06-07 18:36:25 -06:00
Ed Hartnett
5112ef8c72 merged master 2018-06-07 07:27:47 -06:00
Ed Hartnett
7aa073eb5d magic numbers working with user-defined formats 2018-06-07 06:49:16 -06:00
Ed Hartnett
5521e062a4 more udf test 2018-06-06 13:17:32 -06:00
Ed Hartnett
d8f7ca3e6e adding udf test 2018-06-06 13:15:48 -06:00
Ed Hartnett
9a2782b56c got long working with master 2018-06-05 14:40:49 -06:00
Ed Hartnett
17da700a5c adding support for magic numbers 2018-06-05 12:22:38 -06:00
Ed Hartnett
3a8987967e improving testing of user-defined formats 2018-06-05 11:53:59 -06:00
Ed Hartnett
2e831e9bbe initialization of user-defined formats 2018-06-02 08:43:34 -06:00
Ed Hartnett
926ce56775 fixing NC4_show_metadata for windows 2018-06-01 08:10:16 -06:00
Ed Hartnett
d7badd18d9 messing with NC4_show_metadata 2018-06-01 07:09:44 -06:00
Ed Hartnett
011e85cea4 merge ejh_par_tests 2018-05-30 05:06:25 -06:00
Ed Hartnett
3949bd61bc merge ejh_par_leak 2018-05-30 05:03:42 -06:00
Ed Hartnett
5ac7df7ae1 merge ejh_more_tests 2018-05-30 05:01:19 -06:00
Ed Hartnett
fcc6091600 merged ejh_test_def_var_extra 2018-05-30 04:59:10 -06:00
Ed Hartnett
6992295ef7 getting windows build working 2018-05-30 04:31:15 -06:00
Dennis Heimbigner
ee509ff4f3 Re-Implement the nc_get/put_vars operations for netcdf-4 using the
corresponding HDF5 operations.

re: github issue https://github.com/Unidata/netcdf-c/issues/908
also in reference to https://github.com/pydata/xarray/issues/2004

The netcdf-c library has implemented the nc_get_vars and nc_put_vars
operations as element at a time. This has resulted in very slow
operation.

This pr attempts to improve the situation for netcdf-4/hdf5 files
by using the slab operations provided by the hdf5 library. The new
implementation passes the get/put vars stride information down to
the hdf5 slab operations.

The result appears to improve performance significantly. Some simple
tests on large 2-D arrays shows speedups in excess of 150.

Misc. other changes:
1. fix bug in ncgen/semantics.c; using a list's allocated length
   instead of actual length.
2. Added a temporary hook in the netcdf library plus a performance
   test case (tst_varsperf.c) to estimate the speedup. After users
   have had some experience with this, I will remove it, probably
   after the 4.7 release.
2018-05-22 16:50:52 -06:00
Ed Hartnett
7a18d361fb
Merge branch 'master' into ejh_udf 2018-05-22 07:19:10 -06:00
Dennis Heimbigner
02bd33f250 Merge branch 'dapparams.dmh' of https://github.com/Unidata/netcdf-c into dapparams.dmh 2018-05-19 16:11:24 -06:00
Dennis Heimbigner
5fc6be9472 Code duplicated; merge failure? 2018-05-18 20:28:51 -06:00
Ed Hartnett
bab5ef7549 fixed printf statement 2018-05-17 05:53:10 -06:00
Ed Hartnett
df60e5917a added test 2018-05-17 05:50:30 -06:00
Ed Hartnett
6c6c86ef96 added tests, cleaned up test 2018-05-17 05:45:51 -06:00
Ed Hartnett
33bf6147ce cleaned up comments 2018-05-16 03:29:08 -06:00
Ed Hartnett
40c552bd43 cleaned up nc4hdf5.c 2018-05-16 03:18:50 -06:00
Ed Hartnett
d8947c81ee cleaned up whitespace 2018-05-16 02:44:46 -06:00
Ed Hartnett
c0b4e96428 added parallel testing for string type 2018-05-16 02:27:07 -06:00
Ed Hartnett
37cae16b38 added parallel testing for string type 2018-05-16 02:26:13 -06:00
Ed Hartnett
3e79501c3e added parallel compound type test 2018-05-15 08:54:51 -06:00
Ed Hartnett
95e2d10347 fixed comment 2018-05-15 08:15:25 -06:00
Ed Hartnett
b8ad15b6ae tests for ncdump issue with irish rover 2018-05-15 08:09:52 -06:00
Ed Hartnett
942bc48181 test development 2018-05-14 14:25:56 -06:00
Ed Hartnett
984f112580 test development 2018-05-14 10:06:35 -06:00