Commit Graph

769 Commits

Author SHA1 Message Date
Allen Byrne
24c62ba7fe Change CMake min to 3.10 2018-03-09 12:32:06 -06:00
Allen Byrne
08fc36b0ca Correct cutnpaste 2018-03-07 12:23:04 -06:00
Allen Byrne
2db84441d7 ifdef around another function 2018-03-06 16:51:31 -06:00
Allen Byrne
b8b0afc4c3 Add #ifdef H5_HAVE_FORK eliminates special handling 2018-03-06 15:41:51 -06:00
Allen Byrne
e5b602fafe Add #ifdef H5_HAVE_FORK 2018-03-06 15:40:15 -06:00
Richard Warren
c0aafa78e5 Fixed t_pread.c to remove the use of h5jam, etc.. This fixes HDFFV-8839 and should merge into develop 2018-03-02 11:32:13 -05:00
Allen Byrne
bf9b73e877 Remove t_cache_image test on Windows 2018-02-28 09:26:11 -06:00
Allen Byrne
b36bad53d9 Inc CMake min, Add new tests, rework test CMake files 2018-02-27 12:57:07 -06:00
Allen Byrne
205d33f332 Cleanup overuse of include files 2018-02-14 10:08:09 -06:00
Allen Byrne
6ca95c512a HDFFV-10385 rework java names 2018-01-17 10:27:00 -06:00
Allen Byrne
be42e04791 HDFFV-10385 refactor CMAKE_BUILD_TYPE usage 2018-01-09 09:56:28 -06:00
Allen Byrne
732074d47e Add library INTERFACE and MPI to tools 2017-12-28 16:30:51 -06:00
Richard Warren
0d2fd7ae0c Make a fix to allow CMake testing which does not use relative directories. 2017-11-02 12:33:08 -04:00
Allen Byrne
f8fd6d0b41 Correct usage of MPI vars 2017-11-01 13:41:44 -05:00
Richard Warren
8a391887be Merge pull request #711 in HDFFV/hdf5 from optimize_superblock_read to develop
* commit '9aada2bdb51f1c235e483f2bce109262bfbe22fa':
  in 'production' mode builds
  Make fixes to avoid test failures in 'production' mode builds
2017-10-18 06:21:33 -05:00
Richard.Warren
9aada2bdb5 in 'production' mode builds 2017-10-17 15:34:36 -05:00
Richard.Warren
c230ffa268 Make fixes to avoid test failures in 'production' mode builds 2017-10-17 15:23:54 -05:00
Richard Warren
0c207cd2f8 Merge pull request #704 in HDFFV/hdf5 from optimize_superblock_read to develop
* commit '3dde6d0e32461f46630f814a2fdfbd4c813703bf':
  Updated the code and RELEASE.txt note per comments from John Mainzer
  Try to address most of the issues raised by Dana in the code review
  Made edits suggested by John as part of the code review
  Update the MANIFEST and release_docs/RELEASE files
  Add a test for parallel reads of independent files using MPI subgroups
  Edits to the file open optimization and associated test code to bring them closer to the HDF5 library's unwritten coding standards.  Also bug fix to repair a hang in testphdf5.
  The initial coding for the superblock read optization
2017-10-13 07:58:46 -05:00
Richard Warren
3dde6d0e32 Updated the code and RELEASE.txt note per comments from John Mainzer 2017-10-11 16:22:50 -04:00
Richard Warren
157398107e Try to address most of the issues raised by Dana in the code review 2017-10-11 13:40:54 -04:00
Richard Warren
9849d61344 Made edits suggested by John as part of the code review 2017-10-11 10:15:33 -04:00
Richard Warren
837624b9cd Add a test for parallel reads of independent files using MPI subgroups 2017-10-09 16:47:21 -04:00
M. Scot Breitenfeld
45192768ad fixed missing prototype warning 2017-10-09 11:30:10 -05:00
M. Scot Breitenfeld
c643b13594 removed always true ifdef 2017-10-09 11:19:20 -05:00
mainzer
ceab5a5176 Edits to the file open optimization and associated test
code to bring them closer to the HDF5 library's unwritten
coding standards.  Also bug fix to repair a hang in testphdf5.

Tested parallel/debug on Charis and Jelly, parallel/production on Jelly.
2017-10-05 17:25:57 -05:00
Richard Warren
81094ac3cf The initial coding for the superblock read optization 2017-09-28 16:27:29 -04:00
Jordan Henderson
b61bb248cd Amend CMakeLists.txt to add t_filters_parallel to CMake 2017-09-15 07:57:40 -05:00
Jordan Henderson
b95986e50d Merge branch 'develop' of ssh://bitbucket.hdfgroup.org:7999/~jhenderson/hdf5.git into develop 2017-09-01 12:47:12 -05:00
Jordan Henderson
487e77b19e Amend tests to explicitly use H5Dcreate2 and H5Dopen2 2017-09-01 12:45:48 -05:00
Jordan Henderson
fa21f6af4d Merging in latest from upstream (HDFFV/hdf5:refs/heads/develop)
* commit 'abcf30f232914c1ec9b8c5f2a3bb3a621af7bfe4':
  HDFFV-10284 Add VS2017 support
  Add commentary around calling H5Screate_simple with a single element
  Miscellaneous improvements (cont.) Description:     Put back H5Location::getNumObjs and marked as deprecated in favor of     Group::getNumObjs. Platforms tested:     Linux/32 2.6 (jam)     Darwin (osx1010test)
  Miscellaneous improvements Description:     Moved H5Location::getNumObjs to Group::getNumObjs (i.e., H5Gget_info)     Switched reinterpret_cast to static_cast in H5Object::iterateAttrs     Miscellaneous cleanup Platforms tested:     Linux/32 2.6 (jam)     Linux/64 (platypus)     Darwin (osx1010test)
  HDFFV-10282 refactor out assert calls in tools
  Fix the t_bigio test so that it runs on 32bit machines
2017-09-01 09:24:39 -05:00
Jordan Henderson
ce977db07e Minor comment refactoring 2017-09-01 08:38:17 -05:00
Jordan Henderson
b5b1dd0827 Finish up Parallel Compression test scaling work 2017-08-29 11:41:52 -05:00
Richard Warren
22baab211d Add commentary around calling H5Screate_simple with a single element 2017-08-28 20:05:52 -04:00
Jordan Henderson
7f8a8a6878 Partial update for scaling parallel filters tests 2017-08-28 15:12:58 -05:00
Jordan Henderson
1cf7c7ecc9 Modify t_dset.c in lieu of Parallel Compression changes 2017-08-15 16:36:26 -05:00
Richard Warren
f84af6ecc6 Fix the t_bigio test so that it runs on 32bit machines 2017-08-15 09:17:04 -04:00
Jordan Henderson
c34ee0b2a5 Merge branch 'develop' of https://bitbucket.hdfgroup.org/scm/hdffv/hdf5 into develop 2017-08-11 14:25:33 -05:00
Jordan Henderson
1eb7758015 Add test for write parallel; read serial case 2017-08-11 14:09:51 -05:00
Jordan Henderson
f59bfd1754 Fix uninitialized array issue in test 2017-08-11 11:22:51 -05:00
Jordan Henderson
9714dc1124 Test updates 2017-08-10 15:30:06 -05:00
Jordan Henderson
6738d35d8a Add data verification for first half of tests 2017-08-09 21:21:49 -05:00
Jordan Henderson
f74dd2adae Start adding data verification 2017-08-08 15:04:53 -05:00
Jordan Henderson
d5a70edb50 Switch tests over to use testing macros 2017-08-07 21:48:17 -05:00
Jordan Henderson
bf6954f6ba Updates to parallel filters tests 2017-08-03 15:01:10 -05:00
Jordan Henderson
6abd4e9d16 Move test files to testpar directory 2017-08-03 11:56:05 -05:00
Richard Warren
32b0d6ca9f Fix up the ExpressMode check for skipping slow running tests. 2017-07-10 18:20:39 -04:00
Richard Warren
0c4c562cc5 Include code fixes and additional modifications pointed out by code reviewers 2017-07-10 16:17:26 -04:00
Richard Warren
47a4cd816c Commit changes needed for pull request 2017-07-05 15:53:19 -04:00
Larry Knox
89fbe00dec Merge pull request #426 in HDFFV/hdf5 from ~LRKNOX/hdf5_lrk:hdf5_1_10 to hdf5_1_10
* commit '54957d37f5aa73912763dbb6e308555e863c43f4':
  Commit copyright header change for src/H5PLpkg.c which was added after running script to make changes.
  Add new files in release_docs to MANIFEST. Cimmit changes to Makefile.in(s) and H5PL.c that resulted from running autogen.sh.
  Merge pull request #407 in HDFFV/hdf5 from ~LRKNOX/hdf5_lrk:hdf5_1_10_1 to hdf5_1_10_1
  Change copyright headers to replace url referring to file to be removed and replace it with new url for COPYING file.
2017-04-25 16:05:36 -05:00
mainzer
afd8f64c29 Omnibus checkin for several relatively minor modifications:
1) Added code test/page_buffer.c to verify that page buffering is
   disabled in parallel builds.

2) Added code to test/cache_image.c to verify correct interaction
   between evict on close and cache image -- in particular management
   of a file containing a cache image containing dirty metadata that
   has been opened R/O.  Also fix for the bug exposed.

3) Added code to testpar/t_cache_image.c to verify expected procedure
   for reading cache images, and also supporting stats collection code
   needed for the test.

4) Repair of an overactive sanity check in H5C__reconstruct_cache_contents().

5) Other minor tidies in passing.

Tested serial and parallel, debug and production on Jelly.
2017-03-28 11:21:40 -05:00
mainzer
b7c58f7dfc Minor code changes to address comments in pull request 2017-03-17 04:36:05 -05:00
mainzer
11ce930ae9 Checkin of additions to cache image parallel test code and
associated bug fixes.

Also, modifications to H5PB_dest() to flush the page buffer before
destroying the page buffer.  This is necessary, as when persistant
free space managers are enabled, the page buffer will typically contain
dirty FSM data at page buffer destroy time.

Tested serial/debug, serial/production, serial/check-vfd/debug,
       parallel/debug, parallel/production on Jelly.
2017-03-16 12:42:10 -05:00
Quincey Koziol
0313cbb91d Final merge of page buffering branch to develop 2017-03-13 21:30:37 -07:00
Allen Byrne
0df90f9f79 Merge pull request #321 in HDFFV/hdf5 from ~BYRN/hdf5_adb:develop to develop
* commit 'f4dd30f41ccee7bcd97fba065573c5201cbcc743':
  Update CMake formatting
  Update CMake files and formatting
  HDFFV-10120 verify nozlib checking with tools tests
  cmake non-code typo
2017-03-02 12:11:19 -06:00
Quincey Koziol
5df52404bc Misc. small cleanups to sync against incoming page buffering changes. 2017-03-02 06:24:46 -08:00
Allen Byrne
2562ec3a4b Update CMake files and formatting 2017-03-01 14:47:53 -06:00
Quincey Koziol
cf93261099 Correct issues from pull request reviews. 2017-02-28 08:41:57 -08:00
Quincey Koziol
5db402afbb Corrected version of 4b5e05c084:
Fix some more signed -> unsigned value issues with cache data structures,
    also misc. style cleanups.  All to align w/incoming page_buffering changes.
2017-02-27 21:45:55 -08:00
Quincey Koziol
e5fb4191de Revert "Fix some more signed -> unsigned value issues with cache data structures, also"
This reverts commit 4b5e05c084.
2017-02-27 21:23:44 -08:00
Quincey Koziol
4b5e05c084 Fix some more signed -> unsigned value issues with cache data structures, also
misc. style cleanups.  All to align w/incoming page_buffering changes.
2017-02-22 23:21:41 -08:00
Quincey Koziol
5a776edb81 Bring change to use array of metadata cache entry classes for H5C_create
instead of array of class names from cache image branch.
2017-01-27 23:18:47 -08:00
Allen Byrne
e1bcae8a6a Update cmake min version and cmake command convention 2017-01-10 17:10:03 -06:00
Quincey Koziol
8d4c84eae2 Bring changes to metadata cache "get entry status" call and new
"child serialized / unserialized" messages and support from the cache image
branch.
2017-01-06 11:37:17 -08:00
Quincey Koziol
7568dcaf15 Add "image up to date" flag / parameter to metadata cache entry status calls. 2017-01-06 07:51:40 -08:00
Quincey Koziol
64a339183f Bring SWMR support in to the main development branch. (Finally!) More tests
and the tool and API wrappers will be coming in over the weekend.
2016-12-02 08:07:04 -08:00
Quincey Koziol
460b573a73 Eliminate unnecessary data structure for parallel collective metadata cache I/O 2016-11-27 19:00:12 -06:00
Quincey Koziol
ea4d18c3d9 Remove unnecessary assert. 2016-11-25 17:18:52 -06:00
Quincey Koziol
3b0c2b24da Bring over support for retrying metadata cache entry loads, along with all the
supporting metadata cache callback changes, etc.
2016-11-20 04:24:57 -08:00
Quincey Koziol
eba0ff43c9 Remove 'clear' callback from metadata cache client interface, using the
new 'entry cleaned' notify action innstead.
2016-11-17 17:48:21 -08:00
Quincey Koziol
be27e1ad79 Remove explicit support within the metadata cache for tracked compressed
entries, they are now completely handled in the clients.
2016-11-17 12:58:04 -08:00
Quincey Koziol
d4591ff54d Bring over new 'notify' metadata cache client callback actions for when an
entry is cleaned / dirtied or its [flush dependency] child entry is cleaned /
dirtied.
2016-11-12 14:01:30 -08:00
Neil Fortner
7de719287a [svn-r30270] Fix an issue that could occur when allocating a chunked dataset in parallel,
with an alignment threshold set to be larger than the chunk size but smaller
than the size of the small data aggregator.

Tested: koala, ostrich (h5committest); jelly, ummon
2016-08-08 16:56:50 -05:00
Quincey Koziol
d3b724f86a [svn-r30201] Description:
Switch test framework to dynamically allocate the testing array, and
expand the length of the description field.

Tested on:
    MacOSX/64 10.11.5 (amazon) w/serial & parallel
    (h5committest forthcoming)
2016-07-18 17:36:44 -05:00
Quincey Koziol
bb19817c9f [svn-r30189] Description:
Clean up more warnings: drop the warning count from ~1310 down to ~940,
with only 31 types of warnings in 148 files (down from 38 types in 167 files).

Tested on:
    MacOSX/64 10.11.5 (amazon) w/serial & parallel
    (h5committest forthcoming)
2016-07-17 19:18:42 -05:00
Quincey Koziol
b8f809981b [svn-r30112] Description:
Move updated flush dependency code in metadata cache from revise_chunks
branch to trunk.  Also many of the cleanups from r30111 in the revise_chunks
branch.

Tested on:
    MacOSX/64 10.11.5 (amazon) w/serial, parallel & production
    (h5committest forthcoming)
2016-06-28 16:39:09 -05:00
Quincey Koziol
d3396a7953 [svn-r30075] Description:
Bring object/dataset/group/named datatype features from revise_chunks
branch to trunk.  Also CMake support for h5format_convert and a bunch of
misc. cleanups.

Tested on:
    MacOSX/64 10.11.5 (amazon) w/serial, parallel & production
    (h5committest forthcoming)
2016-06-14 18:07:03 -05:00
Quincey Koziol
7a9e13afdb [svn-r30068] Description:
Bring metadata cache corking to trunk.

Tested on:
    MacOSX/64 10.11.5 (amazon) w/serial, parallel & production
    (h5committest forthcoming)
2016-06-13 12:49:39 -05:00
Allen Byrne
1bd3635781 [svn-r29880] Add HD to sleep function calls 2016-05-04 11:16:45 -05:00
Allen Byrne
74f3326a67 [svn-r29862] Convert source list names from *_SRCS to *_SOURCES.
Add/convert most tools to use new HDF5_TOOLS_DIR instead of HDF5_TOOLS_SRC_DIR CMake VAR.
2016-05-04 10:06:05 -05:00
Quincey Koziol
a816d03108 [svn-r29632] Description:
Align w/revise_chunks branch

Tested on:
    MacOSX/64 10.11.4 (amazon) w/parallel
    (h5committest forthcoming)
2016-04-04 23:11:54 -05:00
Quincey Koziol
9d2178ab88 [svn-r29607] Description:
Bring "don't filter partial edge chunks" capability from revise_chunks
to trunk.

Tested on:
    MacOSX/64 10.11.4 (amazon) w/debug, production & parallel
    (h5committest forthcoming)
2016-04-02 04:39:32 -05:00
Dana Robinson
32f21214bb [svn-r29545] Minor normalization w/ trunk in preparation for big merge.
Tested on: 64-bit Ubuntu 15.10 w/ gcc 5.2.1
           autotools serial
           autotools parallel (MPICH 3.1.4)
2016-03-23 19:38:03 -05:00
Mohamad Chaarawi
d12a994986 [svn-r29088] - Add a test for retrieving the property values for the new coll md functions.
- ifdef some code that don't need to be built in parallel
- more minor enhancements

tested on bb-8 with parallel and serial
2016-02-11 11:03:44 -05:00
Mohamad Chaarawi
63c90e5c67 [svn-r29081] - merge in the phdf5_metadata_opt/ branch with the collective metadata optimizations.
- rename H5AC_dxpl_id to H5AC_ind_read_dxpl_id and update all usage in the library

tested on bb-8 with parallel and serial.
2016-02-10 15:48:34 -05:00
Mohamad Chaarawi
25f271d84b [svn-r29079] rename the coll read requirement function. 2016-02-10 13:19:12 -05:00
Quincey Koziol
c8a6c6030a [svn-r29077] Description:
Normalize against the trunk, in preparation for final merge.

Tested on:
    MacOSX/64 10.11.3 (amazon) w/serial & parallel
    (h5committest not required on this branch)
2016-02-10 12:55:55 -05:00
Mohamad Chaarawi
0461830ee3 [svn-r29059] merge from trunk. 2016-02-07 11:38:55 -05:00
Mohamad Chaarawi
48bebcc39e [svn-r29057] added dxpl type checking when debug mode is enabled (H5_DEBUG_BUILD)
tested on bb-8 with Serial and Parallel, debug and production builds.
2016-02-07 10:37:33 -05:00
Mohamad Chaarawi
c3f08947c1 [svn-r28959] merge from trunk.
renaming metadata dxpl properties.
2016-01-22 11:56:09 -05:00
Quincey Koziol
06547eb4dd [svn-r28895] Description:
Minor code tweaks and cleanups during review.

Tested on:
    MacOSX/64 10.11.2 (amazon) w/serial & parallel
    (h5comittest not required on this branch)
2016-01-13 23:30:50 -05:00
Mohamad Chaarawi
2824e6bef0 [svn-r28649] - add new API to toggle collective metadata write.
- set default to FALSE
- fix some bugs.
2015-12-14 14:53:31 -05:00
Mohamad Chaarawi
7a0cdfbbac [svn-r28636] merge from trunk. 2015-12-14 10:22:29 -05:00
Mohamad Chaarawi
3aee46a956 [svn-r28040] avoid use of MPI deprecated routines. 2015-10-12 11:53:51 -05:00
Mohamad Chaarawi
8d131aca15 [svn-r27929] merge from trunk. 2015-10-01 11:12:02 -05:00
Dana Robinson
9af344117c [svn-r27794] Reintegration merge of features/autotools_rework branch with trunk
NOTES:

- Developers will have to run autogen.sh before building with the autotools.

- autogen.sh takes the -p option to mimic the old bin/reconfigure behavior.

- The generated error, overflow and version headers have been left in place.

- The generated H5LT parser code has also been left in place.

- There are no changes for CMake users at this time.

Tested on: h5committest
2015-09-15 15:38:57 -05:00
Quincey Koziol
1023374492 [svn-r27768] Description:
Complete revamp of package initialization/shutdown mechanism in the library.
Each package now has a single init/term routine.

    This new way should avoid packages being re-initialized during library
shutdown and is also be _much_ more proactive about giving feedback for
resource leaks internal to the library.

    Introduces a new "module" header file for packages in the library
(e.g src/H5Fmodule.h) which sets up some necessary package configuration macros
for the FUNC_ENTER/LEAVE macros.  (The VFL drivers have their own slightly
modified version of this header, src/H5FDdrvr_module.h)

    Also cleaned up a bunch of resources leaks all across the library and tests,
along with addressing many warnings, as I encountered them.

Tested on:
    MacOSX/64 10.10.5 (amazon) w/serial & parallel
    Linux/64 3.10.x (kituo) w/serial & parallel
    Linux/64 2.6.x (ostrich) w/serial
2015-09-13 22:58:59 -05:00
Quincey Koziol
26baf1a805 [svn-r27710] Description:
Bring the "metadata rings" code from its branch (mdc_rings_v2) to the trunk.
(This change will support the page buffering feature)

Tested on:
    MacOSX/64 10.10.5 (amazon) w/serial & parallel
    (h5committest forthcoming)
2015-09-09 01:33:03 -05:00
Scot Breitenfeld
e6f9fc5f7f [svn-r27625] Added preprocessor commands for PGI compiler.
tested: h5committest
2015-08-31 13:49:17 -05:00
Mohamad Chaarawi
0286bb12de [svn-r27576] - mark the entry as indepndent when expunged.
- disable the metadata coll hint for smoke checks 1 & 2.
2015-08-25 10:55:57 -05:00
Mohamad Chaarawi
071fb9393e [svn-r27558] merge from trunk. 2015-08-24 11:08:20 -05:00