Commit Graph

669 Commits

Author SHA1 Message Date
mainzer
b7c58f7dfc Minor code changes to address comments in pull request 2017-03-17 04:36:05 -05:00
mainzer
11ce930ae9 Checkin of additions to cache image parallel test code and
associated bug fixes.

Also, modifications to H5PB_dest() to flush the page buffer before
destroying the page buffer.  This is necessary, as when persistant
free space managers are enabled, the page buffer will typically contain
dirty FSM data at page buffer destroy time.

Tested serial/debug, serial/production, serial/check-vfd/debug,
       parallel/debug, parallel/production on Jelly.
2017-03-16 12:42:10 -05:00
Quincey Koziol
0313cbb91d Final merge of page buffering branch to develop 2017-03-13 21:30:37 -07:00
Allen Byrne
0df90f9f79 Merge pull request #321 in HDFFV/hdf5 from ~BYRN/hdf5_adb:develop to develop
* commit 'f4dd30f41ccee7bcd97fba065573c5201cbcc743':
  Update CMake formatting
  Update CMake files and formatting
  HDFFV-10120 verify nozlib checking with tools tests
  cmake non-code typo
2017-03-02 12:11:19 -06:00
Quincey Koziol
5df52404bc Misc. small cleanups to sync against incoming page buffering changes. 2017-03-02 06:24:46 -08:00
Allen Byrne
2562ec3a4b Update CMake files and formatting 2017-03-01 14:47:53 -06:00
Quincey Koziol
cf93261099 Correct issues from pull request reviews. 2017-02-28 08:41:57 -08:00
Quincey Koziol
5db402afbb Corrected version of 4b5e05c084:
Fix some more signed -> unsigned value issues with cache data structures,
    also misc. style cleanups.  All to align w/incoming page_buffering changes.
2017-02-27 21:45:55 -08:00
Quincey Koziol
e5fb4191de Revert "Fix some more signed -> unsigned value issues with cache data structures, also"
This reverts commit 4b5e05c084.
2017-02-27 21:23:44 -08:00
Quincey Koziol
4b5e05c084 Fix some more signed -> unsigned value issues with cache data structures, also
misc. style cleanups.  All to align w/incoming page_buffering changes.
2017-02-22 23:21:41 -08:00
Quincey Koziol
5a776edb81 Bring change to use array of metadata cache entry classes for H5C_create
instead of array of class names from cache image branch.
2017-01-27 23:18:47 -08:00
Allen Byrne
e1bcae8a6a Update cmake min version and cmake command convention 2017-01-10 17:10:03 -06:00
Quincey Koziol
8d4c84eae2 Bring changes to metadata cache "get entry status" call and new
"child serialized / unserialized" messages and support from the cache image
branch.
2017-01-06 11:37:17 -08:00
Quincey Koziol
7568dcaf15 Add "image up to date" flag / parameter to metadata cache entry status calls. 2017-01-06 07:51:40 -08:00
Quincey Koziol
64a339183f Bring SWMR support in to the main development branch. (Finally!) More tests
and the tool and API wrappers will be coming in over the weekend.
2016-12-02 08:07:04 -08:00
Quincey Koziol
460b573a73 Eliminate unnecessary data structure for parallel collective metadata cache I/O 2016-11-27 19:00:12 -06:00
Quincey Koziol
ea4d18c3d9 Remove unnecessary assert. 2016-11-25 17:18:52 -06:00
Quincey Koziol
3b0c2b24da Bring over support for retrying metadata cache entry loads, along with all the
supporting metadata cache callback changes, etc.
2016-11-20 04:24:57 -08:00
Quincey Koziol
eba0ff43c9 Remove 'clear' callback from metadata cache client interface, using the
new 'entry cleaned' notify action innstead.
2016-11-17 17:48:21 -08:00
Quincey Koziol
be27e1ad79 Remove explicit support within the metadata cache for tracked compressed
entries, they are now completely handled in the clients.
2016-11-17 12:58:04 -08:00
Quincey Koziol
d4591ff54d Bring over new 'notify' metadata cache client callback actions for when an
entry is cleaned / dirtied or its [flush dependency] child entry is cleaned /
dirtied.
2016-11-12 14:01:30 -08:00
Neil Fortner
7de719287a [svn-r30270] Fix an issue that could occur when allocating a chunked dataset in parallel,
with an alignment threshold set to be larger than the chunk size but smaller
than the size of the small data aggregator.

Tested: koala, ostrich (h5committest); jelly, ummon
2016-08-08 16:56:50 -05:00
Quincey Koziol
d3b724f86a [svn-r30201] Description:
Switch test framework to dynamically allocate the testing array, and
expand the length of the description field.

Tested on:
    MacOSX/64 10.11.5 (amazon) w/serial & parallel
    (h5committest forthcoming)
2016-07-18 17:36:44 -05:00
Quincey Koziol
bb19817c9f [svn-r30189] Description:
Clean up more warnings: drop the warning count from ~1310 down to ~940,
with only 31 types of warnings in 148 files (down from 38 types in 167 files).

Tested on:
    MacOSX/64 10.11.5 (amazon) w/serial & parallel
    (h5committest forthcoming)
2016-07-17 19:18:42 -05:00
Quincey Koziol
b8f809981b [svn-r30112] Description:
Move updated flush dependency code in metadata cache from revise_chunks
branch to trunk.  Also many of the cleanups from r30111 in the revise_chunks
branch.

Tested on:
    MacOSX/64 10.11.5 (amazon) w/serial, parallel & production
    (h5committest forthcoming)
2016-06-28 16:39:09 -05:00
Quincey Koziol
d3396a7953 [svn-r30075] Description:
Bring object/dataset/group/named datatype features from revise_chunks
branch to trunk.  Also CMake support for h5format_convert and a bunch of
misc. cleanups.

Tested on:
    MacOSX/64 10.11.5 (amazon) w/serial, parallel & production
    (h5committest forthcoming)
2016-06-14 18:07:03 -05:00
Quincey Koziol
7a9e13afdb [svn-r30068] Description:
Bring metadata cache corking to trunk.

Tested on:
    MacOSX/64 10.11.5 (amazon) w/serial, parallel & production
    (h5committest forthcoming)
2016-06-13 12:49:39 -05:00
Allen Byrne
1bd3635781 [svn-r29880] Add HD to sleep function calls 2016-05-04 11:16:45 -05:00
Allen Byrne
74f3326a67 [svn-r29862] Convert source list names from *_SRCS to *_SOURCES.
Add/convert most tools to use new HDF5_TOOLS_DIR instead of HDF5_TOOLS_SRC_DIR CMake VAR.
2016-05-04 10:06:05 -05:00
Quincey Koziol
a816d03108 [svn-r29632] Description:
Align w/revise_chunks branch

Tested on:
    MacOSX/64 10.11.4 (amazon) w/parallel
    (h5committest forthcoming)
2016-04-04 23:11:54 -05:00
Quincey Koziol
9d2178ab88 [svn-r29607] Description:
Bring "don't filter partial edge chunks" capability from revise_chunks
to trunk.

Tested on:
    MacOSX/64 10.11.4 (amazon) w/debug, production & parallel
    (h5committest forthcoming)
2016-04-02 04:39:32 -05:00
Dana Robinson
32f21214bb [svn-r29545] Minor normalization w/ trunk in preparation for big merge.
Tested on: 64-bit Ubuntu 15.10 w/ gcc 5.2.1
           autotools serial
           autotools parallel (MPICH 3.1.4)
2016-03-23 19:38:03 -05:00
Mohamad Chaarawi
d12a994986 [svn-r29088] - Add a test for retrieving the property values for the new coll md functions.
- ifdef some code that don't need to be built in parallel
- more minor enhancements

tested on bb-8 with parallel and serial
2016-02-11 11:03:44 -05:00
Mohamad Chaarawi
63c90e5c67 [svn-r29081] - merge in the phdf5_metadata_opt/ branch with the collective metadata optimizations.
- rename H5AC_dxpl_id to H5AC_ind_read_dxpl_id and update all usage in the library

tested on bb-8 with parallel and serial.
2016-02-10 15:48:34 -05:00
Mohamad Chaarawi
25f271d84b [svn-r29079] rename the coll read requirement function. 2016-02-10 13:19:12 -05:00
Quincey Koziol
c8a6c6030a [svn-r29077] Description:
Normalize against the trunk, in preparation for final merge.

Tested on:
    MacOSX/64 10.11.3 (amazon) w/serial & parallel
    (h5committest not required on this branch)
2016-02-10 12:55:55 -05:00
Mohamad Chaarawi
0461830ee3 [svn-r29059] merge from trunk. 2016-02-07 11:38:55 -05:00
Mohamad Chaarawi
48bebcc39e [svn-r29057] added dxpl type checking when debug mode is enabled (H5_DEBUG_BUILD)
tested on bb-8 with Serial and Parallel, debug and production builds.
2016-02-07 10:37:33 -05:00
Mohamad Chaarawi
c3f08947c1 [svn-r28959] merge from trunk.
renaming metadata dxpl properties.
2016-01-22 11:56:09 -05:00
Quincey Koziol
06547eb4dd [svn-r28895] Description:
Minor code tweaks and cleanups during review.

Tested on:
    MacOSX/64 10.11.2 (amazon) w/serial & parallel
    (h5comittest not required on this branch)
2016-01-13 23:30:50 -05:00
Mohamad Chaarawi
2824e6bef0 [svn-r28649] - add new API to toggle collective metadata write.
- set default to FALSE
- fix some bugs.
2015-12-14 14:53:31 -05:00
Mohamad Chaarawi
7a0cdfbbac [svn-r28636] merge from trunk. 2015-12-14 10:22:29 -05:00
Mohamad Chaarawi
3aee46a956 [svn-r28040] avoid use of MPI deprecated routines. 2015-10-12 11:53:51 -05:00
Mohamad Chaarawi
8d131aca15 [svn-r27929] merge from trunk. 2015-10-01 11:12:02 -05:00
Dana Robinson
9af344117c [svn-r27794] Reintegration merge of features/autotools_rework branch with trunk
NOTES:

- Developers will have to run autogen.sh before building with the autotools.

- autogen.sh takes the -p option to mimic the old bin/reconfigure behavior.

- The generated error, overflow and version headers have been left in place.

- The generated H5LT parser code has also been left in place.

- There are no changes for CMake users at this time.

Tested on: h5committest
2015-09-15 15:38:57 -05:00
Quincey Koziol
1023374492 [svn-r27768] Description:
Complete revamp of package initialization/shutdown mechanism in the library.
Each package now has a single init/term routine.

    This new way should avoid packages being re-initialized during library
shutdown and is also be _much_ more proactive about giving feedback for
resource leaks internal to the library.

    Introduces a new "module" header file for packages in the library
(e.g src/H5Fmodule.h) which sets up some necessary package configuration macros
for the FUNC_ENTER/LEAVE macros.  (The VFL drivers have their own slightly
modified version of this header, src/H5FDdrvr_module.h)

    Also cleaned up a bunch of resources leaks all across the library and tests,
along with addressing many warnings, as I encountered them.

Tested on:
    MacOSX/64 10.10.5 (amazon) w/serial & parallel
    Linux/64 3.10.x (kituo) w/serial & parallel
    Linux/64 2.6.x (ostrich) w/serial
2015-09-13 22:58:59 -05:00
Quincey Koziol
26baf1a805 [svn-r27710] Description:
Bring the "metadata rings" code from its branch (mdc_rings_v2) to the trunk.
(This change will support the page buffering feature)

Tested on:
    MacOSX/64 10.10.5 (amazon) w/serial & parallel
    (h5committest forthcoming)
2015-09-09 01:33:03 -05:00
Scot Breitenfeld
e6f9fc5f7f [svn-r27625] Added preprocessor commands for PGI compiler.
tested: h5committest
2015-08-31 13:49:17 -05:00
Mohamad Chaarawi
0286bb12de [svn-r27576] - mark the entry as indepndent when expunged.
- disable the metadata coll hint for smoke checks 1 & 2.
2015-08-25 10:55:57 -05:00
Mohamad Chaarawi
071fb9393e [svn-r27558] merge from trunk. 2015-08-24 11:08:20 -05:00