Commit Graph

744 Commits

Author SHA1 Message Date
Richard Warren
81094ac3cf The initial coding for the superblock read optization 2017-09-28 16:27:29 -04:00
Jordan Henderson
b61bb248cd Amend CMakeLists.txt to add t_filters_parallel to CMake 2017-09-15 07:57:40 -05:00
Jordan Henderson
b95986e50d Merge branch 'develop' of ssh://bitbucket.hdfgroup.org:7999/~jhenderson/hdf5.git into develop 2017-09-01 12:47:12 -05:00
Jordan Henderson
487e77b19e Amend tests to explicitly use H5Dcreate2 and H5Dopen2 2017-09-01 12:45:48 -05:00
Jordan Henderson
fa21f6af4d Merging in latest from upstream (HDFFV/hdf5:refs/heads/develop)
* commit 'abcf30f232914c1ec9b8c5f2a3bb3a621af7bfe4':
  HDFFV-10284 Add VS2017 support
  Add commentary around calling H5Screate_simple with a single element
  Miscellaneous improvements (cont.) Description:     Put back H5Location::getNumObjs and marked as deprecated in favor of     Group::getNumObjs. Platforms tested:     Linux/32 2.6 (jam)     Darwin (osx1010test)
  Miscellaneous improvements Description:     Moved H5Location::getNumObjs to Group::getNumObjs (i.e., H5Gget_info)     Switched reinterpret_cast to static_cast in H5Object::iterateAttrs     Miscellaneous cleanup Platforms tested:     Linux/32 2.6 (jam)     Linux/64 (platypus)     Darwin (osx1010test)
  HDFFV-10282 refactor out assert calls in tools
  Fix the t_bigio test so that it runs on 32bit machines
2017-09-01 09:24:39 -05:00
Jordan Henderson
ce977db07e Minor comment refactoring 2017-09-01 08:38:17 -05:00
Jordan Henderson
b5b1dd0827 Finish up Parallel Compression test scaling work 2017-08-29 11:41:52 -05:00
Richard Warren
22baab211d Add commentary around calling H5Screate_simple with a single element 2017-08-28 20:05:52 -04:00
Jordan Henderson
7f8a8a6878 Partial update for scaling parallel filters tests 2017-08-28 15:12:58 -05:00
Jordan Henderson
1cf7c7ecc9 Modify t_dset.c in lieu of Parallel Compression changes 2017-08-15 16:36:26 -05:00
Richard Warren
f84af6ecc6 Fix the t_bigio test so that it runs on 32bit machines 2017-08-15 09:17:04 -04:00
Jordan Henderson
c34ee0b2a5 Merge branch 'develop' of https://bitbucket.hdfgroup.org/scm/hdffv/hdf5 into develop 2017-08-11 14:25:33 -05:00
Jordan Henderson
1eb7758015 Add test for write parallel; read serial case 2017-08-11 14:09:51 -05:00
Jordan Henderson
f59bfd1754 Fix uninitialized array issue in test 2017-08-11 11:22:51 -05:00
Jordan Henderson
9714dc1124 Test updates 2017-08-10 15:30:06 -05:00
Jordan Henderson
6738d35d8a Add data verification for first half of tests 2017-08-09 21:21:49 -05:00
Jordan Henderson
f74dd2adae Start adding data verification 2017-08-08 15:04:53 -05:00
Jordan Henderson
d5a70edb50 Switch tests over to use testing macros 2017-08-07 21:48:17 -05:00
Jordan Henderson
bf6954f6ba Updates to parallel filters tests 2017-08-03 15:01:10 -05:00
Jordan Henderson
6abd4e9d16 Move test files to testpar directory 2017-08-03 11:56:05 -05:00
Richard Warren
32b0d6ca9f Fix up the ExpressMode check for skipping slow running tests. 2017-07-10 18:20:39 -04:00
Richard Warren
0c4c562cc5 Include code fixes and additional modifications pointed out by code reviewers 2017-07-10 16:17:26 -04:00
Richard Warren
47a4cd816c Commit changes needed for pull request 2017-07-05 15:53:19 -04:00
Larry Knox
89fbe00dec Merge pull request #426 in HDFFV/hdf5 from ~LRKNOX/hdf5_lrk:hdf5_1_10 to hdf5_1_10
* commit '54957d37f5aa73912763dbb6e308555e863c43f4':
  Commit copyright header change for src/H5PLpkg.c which was added after running script to make changes.
  Add new files in release_docs to MANIFEST. Cimmit changes to Makefile.in(s) and H5PL.c that resulted from running autogen.sh.
  Merge pull request #407 in HDFFV/hdf5 from ~LRKNOX/hdf5_lrk:hdf5_1_10_1 to hdf5_1_10_1
  Change copyright headers to replace url referring to file to be removed and replace it with new url for COPYING file.
2017-04-25 16:05:36 -05:00
mainzer
afd8f64c29 Omnibus checkin for several relatively minor modifications:
1) Added code test/page_buffer.c to verify that page buffering is
   disabled in parallel builds.

2) Added code to test/cache_image.c to verify correct interaction
   between evict on close and cache image -- in particular management
   of a file containing a cache image containing dirty metadata that
   has been opened R/O.  Also fix for the bug exposed.

3) Added code to testpar/t_cache_image.c to verify expected procedure
   for reading cache images, and also supporting stats collection code
   needed for the test.

4) Repair of an overactive sanity check in H5C__reconstruct_cache_contents().

5) Other minor tidies in passing.

Tested serial and parallel, debug and production on Jelly.
2017-03-28 11:21:40 -05:00
mainzer
b7c58f7dfc Minor code changes to address comments in pull request 2017-03-17 04:36:05 -05:00
mainzer
11ce930ae9 Checkin of additions to cache image parallel test code and
associated bug fixes.

Also, modifications to H5PB_dest() to flush the page buffer before
destroying the page buffer.  This is necessary, as when persistant
free space managers are enabled, the page buffer will typically contain
dirty FSM data at page buffer destroy time.

Tested serial/debug, serial/production, serial/check-vfd/debug,
       parallel/debug, parallel/production on Jelly.
2017-03-16 12:42:10 -05:00
Quincey Koziol
0313cbb91d Final merge of page buffering branch to develop 2017-03-13 21:30:37 -07:00
Allen Byrne
0df90f9f79 Merge pull request #321 in HDFFV/hdf5 from ~BYRN/hdf5_adb:develop to develop
* commit 'f4dd30f41ccee7bcd97fba065573c5201cbcc743':
  Update CMake formatting
  Update CMake files and formatting
  HDFFV-10120 verify nozlib checking with tools tests
  cmake non-code typo
2017-03-02 12:11:19 -06:00
Quincey Koziol
5df52404bc Misc. small cleanups to sync against incoming page buffering changes. 2017-03-02 06:24:46 -08:00
Allen Byrne
2562ec3a4b Update CMake files and formatting 2017-03-01 14:47:53 -06:00
Quincey Koziol
cf93261099 Correct issues from pull request reviews. 2017-02-28 08:41:57 -08:00
Quincey Koziol
5db402afbb Corrected version of 4b5e05c084:
Fix some more signed -> unsigned value issues with cache data structures,
    also misc. style cleanups.  All to align w/incoming page_buffering changes.
2017-02-27 21:45:55 -08:00
Quincey Koziol
e5fb4191de Revert "Fix some more signed -> unsigned value issues with cache data structures, also"
This reverts commit 4b5e05c084.
2017-02-27 21:23:44 -08:00
Quincey Koziol
4b5e05c084 Fix some more signed -> unsigned value issues with cache data structures, also
misc. style cleanups.  All to align w/incoming page_buffering changes.
2017-02-22 23:21:41 -08:00
Quincey Koziol
5a776edb81 Bring change to use array of metadata cache entry classes for H5C_create
instead of array of class names from cache image branch.
2017-01-27 23:18:47 -08:00
Allen Byrne
e1bcae8a6a Update cmake min version and cmake command convention 2017-01-10 17:10:03 -06:00
Quincey Koziol
8d4c84eae2 Bring changes to metadata cache "get entry status" call and new
"child serialized / unserialized" messages and support from the cache image
branch.
2017-01-06 11:37:17 -08:00
Quincey Koziol
7568dcaf15 Add "image up to date" flag / parameter to metadata cache entry status calls. 2017-01-06 07:51:40 -08:00
Quincey Koziol
64a339183f Bring SWMR support in to the main development branch. (Finally!) More tests
and the tool and API wrappers will be coming in over the weekend.
2016-12-02 08:07:04 -08:00
Quincey Koziol
460b573a73 Eliminate unnecessary data structure for parallel collective metadata cache I/O 2016-11-27 19:00:12 -06:00
Quincey Koziol
ea4d18c3d9 Remove unnecessary assert. 2016-11-25 17:18:52 -06:00
Quincey Koziol
3b0c2b24da Bring over support for retrying metadata cache entry loads, along with all the
supporting metadata cache callback changes, etc.
2016-11-20 04:24:57 -08:00
Quincey Koziol
eba0ff43c9 Remove 'clear' callback from metadata cache client interface, using the
new 'entry cleaned' notify action innstead.
2016-11-17 17:48:21 -08:00
Quincey Koziol
be27e1ad79 Remove explicit support within the metadata cache for tracked compressed
entries, they are now completely handled in the clients.
2016-11-17 12:58:04 -08:00
Quincey Koziol
d4591ff54d Bring over new 'notify' metadata cache client callback actions for when an
entry is cleaned / dirtied or its [flush dependency] child entry is cleaned /
dirtied.
2016-11-12 14:01:30 -08:00
Neil Fortner
7de719287a [svn-r30270] Fix an issue that could occur when allocating a chunked dataset in parallel,
with an alignment threshold set to be larger than the chunk size but smaller
than the size of the small data aggregator.

Tested: koala, ostrich (h5committest); jelly, ummon
2016-08-08 16:56:50 -05:00
Quincey Koziol
d3b724f86a [svn-r30201] Description:
Switch test framework to dynamically allocate the testing array, and
expand the length of the description field.

Tested on:
    MacOSX/64 10.11.5 (amazon) w/serial & parallel
    (h5committest forthcoming)
2016-07-18 17:36:44 -05:00
Quincey Koziol
bb19817c9f [svn-r30189] Description:
Clean up more warnings: drop the warning count from ~1310 down to ~940,
with only 31 types of warnings in 148 files (down from 38 types in 167 files).

Tested on:
    MacOSX/64 10.11.5 (amazon) w/serial & parallel
    (h5committest forthcoming)
2016-07-17 19:18:42 -05:00
Quincey Koziol
b8f809981b [svn-r30112] Description:
Move updated flush dependency code in metadata cache from revise_chunks
branch to trunk.  Also many of the cleanups from r30111 in the revise_chunks
branch.

Tested on:
    MacOSX/64 10.11.5 (amazon) w/serial, parallel & production
    (h5committest forthcoming)
2016-06-28 16:39:09 -05:00
Quincey Koziol
d3396a7953 [svn-r30075] Description:
Bring object/dataset/group/named datatype features from revise_chunks
branch to trunk.  Also CMake support for h5format_convert and a bunch of
misc. cleanups.

Tested on:
    MacOSX/64 10.11.5 (amazon) w/serial, parallel & production
    (h5committest forthcoming)
2016-06-14 18:07:03 -05:00
Quincey Koziol
7a9e13afdb [svn-r30068] Description:
Bring metadata cache corking to trunk.

Tested on:
    MacOSX/64 10.11.5 (amazon) w/serial, parallel & production
    (h5committest forthcoming)
2016-06-13 12:49:39 -05:00
Allen Byrne
1bd3635781 [svn-r29880] Add HD to sleep function calls 2016-05-04 11:16:45 -05:00
Allen Byrne
74f3326a67 [svn-r29862] Convert source list names from *_SRCS to *_SOURCES.
Add/convert most tools to use new HDF5_TOOLS_DIR instead of HDF5_TOOLS_SRC_DIR CMake VAR.
2016-05-04 10:06:05 -05:00
Quincey Koziol
a816d03108 [svn-r29632] Description:
Align w/revise_chunks branch

Tested on:
    MacOSX/64 10.11.4 (amazon) w/parallel
    (h5committest forthcoming)
2016-04-04 23:11:54 -05:00
Quincey Koziol
9d2178ab88 [svn-r29607] Description:
Bring "don't filter partial edge chunks" capability from revise_chunks
to trunk.

Tested on:
    MacOSX/64 10.11.4 (amazon) w/debug, production & parallel
    (h5committest forthcoming)
2016-04-02 04:39:32 -05:00
Dana Robinson
32f21214bb [svn-r29545] Minor normalization w/ trunk in preparation for big merge.
Tested on: 64-bit Ubuntu 15.10 w/ gcc 5.2.1
           autotools serial
           autotools parallel (MPICH 3.1.4)
2016-03-23 19:38:03 -05:00
Mohamad Chaarawi
d12a994986 [svn-r29088] - Add a test for retrieving the property values for the new coll md functions.
- ifdef some code that don't need to be built in parallel
- more minor enhancements

tested on bb-8 with parallel and serial
2016-02-11 11:03:44 -05:00
Mohamad Chaarawi
63c90e5c67 [svn-r29081] - merge in the phdf5_metadata_opt/ branch with the collective metadata optimizations.
- rename H5AC_dxpl_id to H5AC_ind_read_dxpl_id and update all usage in the library

tested on bb-8 with parallel and serial.
2016-02-10 15:48:34 -05:00
Mohamad Chaarawi
25f271d84b [svn-r29079] rename the coll read requirement function. 2016-02-10 13:19:12 -05:00
Quincey Koziol
c8a6c6030a [svn-r29077] Description:
Normalize against the trunk, in preparation for final merge.

Tested on:
    MacOSX/64 10.11.3 (amazon) w/serial & parallel
    (h5committest not required on this branch)
2016-02-10 12:55:55 -05:00
Mohamad Chaarawi
0461830ee3 [svn-r29059] merge from trunk. 2016-02-07 11:38:55 -05:00
Mohamad Chaarawi
48bebcc39e [svn-r29057] added dxpl type checking when debug mode is enabled (H5_DEBUG_BUILD)
tested on bb-8 with Serial and Parallel, debug and production builds.
2016-02-07 10:37:33 -05:00
Mohamad Chaarawi
c3f08947c1 [svn-r28959] merge from trunk.
renaming metadata dxpl properties.
2016-01-22 11:56:09 -05:00
Quincey Koziol
06547eb4dd [svn-r28895] Description:
Minor code tweaks and cleanups during review.

Tested on:
    MacOSX/64 10.11.2 (amazon) w/serial & parallel
    (h5comittest not required on this branch)
2016-01-13 23:30:50 -05:00
Mohamad Chaarawi
2824e6bef0 [svn-r28649] - add new API to toggle collective metadata write.
- set default to FALSE
- fix some bugs.
2015-12-14 14:53:31 -05:00
Mohamad Chaarawi
7a0cdfbbac [svn-r28636] merge from trunk. 2015-12-14 10:22:29 -05:00
Mohamad Chaarawi
3aee46a956 [svn-r28040] avoid use of MPI deprecated routines. 2015-10-12 11:53:51 -05:00
Mohamad Chaarawi
8d131aca15 [svn-r27929] merge from trunk. 2015-10-01 11:12:02 -05:00
Dana Robinson
9af344117c [svn-r27794] Reintegration merge of features/autotools_rework branch with trunk
NOTES:

- Developers will have to run autogen.sh before building with the autotools.

- autogen.sh takes the -p option to mimic the old bin/reconfigure behavior.

- The generated error, overflow and version headers have been left in place.

- The generated H5LT parser code has also been left in place.

- There are no changes for CMake users at this time.

Tested on: h5committest
2015-09-15 15:38:57 -05:00
Quincey Koziol
1023374492 [svn-r27768] Description:
Complete revamp of package initialization/shutdown mechanism in the library.
Each package now has a single init/term routine.

    This new way should avoid packages being re-initialized during library
shutdown and is also be _much_ more proactive about giving feedback for
resource leaks internal to the library.

    Introduces a new "module" header file for packages in the library
(e.g src/H5Fmodule.h) which sets up some necessary package configuration macros
for the FUNC_ENTER/LEAVE macros.  (The VFL drivers have their own slightly
modified version of this header, src/H5FDdrvr_module.h)

    Also cleaned up a bunch of resources leaks all across the library and tests,
along with addressing many warnings, as I encountered them.

Tested on:
    MacOSX/64 10.10.5 (amazon) w/serial & parallel
    Linux/64 3.10.x (kituo) w/serial & parallel
    Linux/64 2.6.x (ostrich) w/serial
2015-09-13 22:58:59 -05:00
Quincey Koziol
26baf1a805 [svn-r27710] Description:
Bring the "metadata rings" code from its branch (mdc_rings_v2) to the trunk.
(This change will support the page buffering feature)

Tested on:
    MacOSX/64 10.10.5 (amazon) w/serial & parallel
    (h5committest forthcoming)
2015-09-09 01:33:03 -05:00
Scot Breitenfeld
e6f9fc5f7f [svn-r27625] Added preprocessor commands for PGI compiler.
tested: h5committest
2015-08-31 13:49:17 -05:00
Mohamad Chaarawi
0286bb12de [svn-r27576] - mark the entry as indepndent when expunged.
- disable the metadata coll hint for smoke checks 1 & 2.
2015-08-25 10:55:57 -05:00
Mohamad Chaarawi
071fb9393e [svn-r27558] merge from trunk. 2015-08-24 11:08:20 -05:00
Scot Breitenfeld
d06fee7bd2 [svn-r27517] Removed all perl scripts from configure.
Tested: h5committest
2015-08-17 16:12:03 -05:00
Dana Robinson
c27d180848 [svn-r27507] Merge of r27237-27500 from the trunk.
Tested w/ h5committest

NOTES: - The manifest may still be messed up.
       - Cmake fails since the dual binary work needs to be merged with
         this repo's CMake externals.
2015-08-14 14:58:54 -05:00
Scot Breitenfeld
caf0e7692a [svn-r27493] Trying again to merge the F2003_v1.10 branch to the trunk.
Tested: h5committest --PASSED--
2015-08-11 09:35:30 -05:00
Scot Breitenfeld
3b4696ccd1 [svn-r27489] reverted merge of branch 2015-08-10 20:22:33 -05:00
Scot Breitenfeld
a9bef45c75 [svn-r27470] svn merge -r27425:27460 https://svn.hdfgroup.uiuc.edu/hdf5/trunk 2015-08-05 16:35:30 -05:00
Allen Byrne
9e2434625d [svn-r27469] Merge from trunk with dual-binary CMake code.
Tested: local linux with CMake
2015-08-05 16:01:07 -05:00
Mohamad Chaarawi
54497d2b53 [svn-r27436] merge from trunk. 2015-07-27 10:39:54 -05:00
Mohamad Chaarawi
81d3377737 [svn-r27427] - free comm keyval after setting atribute on comm_self
- free allocated buffer in t_file_image test

tested on jam with parallel.
2015-07-23 10:03:43 -05:00
Scot Breitenfeld
985e8d02a4 [svn-r27327] svn merge -r27208:27326 https://svn.hdfgroup.uiuc.edu/hdf5/trunk 2015-07-02 14:12:03 -05:00
Quincey Koziol
ad37464819 [svn-r27296] Description:
Correct error with braces around macro (in production builds), also clean
up a few warnings.

Tested on:
    MacOSX/64 10.10.3 (amazon) w/serial, parallel & production
    Linux/32 2.6 (jam) w/serial & parallel
2015-06-29 15:22:30 -05:00
Quincey Koziol
8e94745298 [svn-r27293] Description:
Split parallel metadata cache code into separate source code modules.

Tested on:
    MacOSX/64 10.10.3 (amazon) w/serial & parallel
    (too minor for h5committest)
2015-06-27 11:45:21 -05:00
Mohamad Chaarawi
a07297e90d [svn-r27271] fix a few warnings in t_mpi.c 2015-06-23 08:54:01 -05:00
Mohamad Chaarawi
f56008e0fe [svn-r27264] some cleanups. 2015-06-22 10:54:43 -05:00
Mohamad Chaarawi
cf07aa6803 [svn-r27261] apply metadata enhancement patch that was based on the mdc 3 branch. 2015-06-21 16:45:01 -05:00
Quincey Koziol
f30ab55f41 [svn-r27237] Description:
Merge v3 metadata cache changes to trunk.  Yay! :-)

Tested on:
    MacOSX/64 10.10.3 (amazon) w/serial & parallel
    Linux/32 2.6.x (jam) w/serial & parallel
    (daily tested on branch)
2015-06-17 19:58:49 -05:00
Dana Robinson
fb27787c2a [svn-r27222] Merge of r27035-27221 from the trunk.
Tested on 64-bit linux VM:
    Serial: C++ and Fortran 2003
    Parallel: Fortran
2015-06-17 06:48:34 -05:00
Scot Breitenfeld
85bcb77904 [svn-r27221] Reworked Fortran autools REAL KIND detection. 2015-06-16 16:47:00 -05:00
Scot Breitenfeld
48086667b5 [svn-r27209] svn merge -r27186:27208 https://svn.hdfgroup.uiuc.edu/hdf5/trunk 2015-06-16 08:49:28 -05:00
Quincey Koziol
adbb64c6cd [svn-r27204] Description:
Clean up compiler warnings before merging in v3 metadata cache changes
from branch.

Tested on:
    MacOSX/64 10.10.3 (amazon) w/serial & parallel
    Linux/32 2.6.x (jam) w/serial & parallel
2015-06-15 11:07:38 -05:00
Scot Breitenfeld
6c4e3759f5 [svn-r27187] svn merge -r27135:27186 https://svn.hdfgroup.uiuc.edu/hdf5/trunk 2015-06-10 14:23:09 -05:00
Scot Breitenfeld
f2d14c76b8 [svn-r27186] added fix for jam with promoted reals and integers 2015-06-10 14:15:08 -05:00
Scot Breitenfeld
62401ac7c6 [svn-r27167] more DT fixes 2015-06-09 12:05:09 -05:00
Scot Breitenfeld
32703c9fc5 [svn-r27164] various bug fixes for DT 2015-06-08 16:13:15 -05:00
Mohamad Chaarawi
929e8ce128 [svn-r27162] fix for HDFFV-9412:
- Check for mpi is_initialized and is_finalized before making MPI calls in init/terminate of HDF5.
- Add a test to make sure we can make serial HDF5 calls from rank 0 after MPI_Finalize is called.

tested with h5committest
2015-06-08 15:52:48 -05:00
Scot Breitenfeld
8641814c4e [svn-r27154] fixed issue with mis-matching long double between Fortran and C 2015-06-05 17:17:13 -05:00