Go to file
Songyu Lu 6fa26d7e49 HDFFV-10601 Issues with chunk cache hash value calcuation:
1. H5D__chunk_hash_val: When the number of chunks in the fastest changing dimension is larger than the number of slots in the hash table, H5D__chunk_hash_val abandons the normal hash value calculation algorithm and simply uses the scaled dimension.  This will cause chunks a selection that cuts across chunks in dimensions other than the fastest changing to all have the same hash value, and they will therefore always evict each other from the cache, having an obvious major performance impact. Eliminated the check  for the number of slots in this function and always use the full algorithm.

2. H5D__chunk_init: When the scaled dimensions (number of chunks in each dimension) are calculated in H5D__chunk_init, a simple divide ("/") operator is used with the dataset size in elements and the chunk size in elements. While this is fine when the dataset size is an exact multiple of the chunk size, in other cases, since "/" rounds down, it results in a scaled dimension one less than it should (it ignores the partial edge chunk). This has trickle down effects on hash value calculation that can cause excess hash value collisions and therefore performance issues. Changed the calculation to (((dataset_size - 1) / chunk_size) + 1).

Tested the build with Autotool and CMake.
2018-11-02 14:53:35 -05:00
bin Add script to run tests with sbatch when not cross compiling. 2018-10-29 16:17:10 -05:00
c++ VOL FEATURE 2018-10-10 08:10:15 -07:00
config Add files and changes to cross compile with CrayLinuxEnvironment and run 2018-10-29 14:24:08 -05:00
examples Removed a couple of extraneous commas from VOL example. 2018-10-30 14:44:54 -07:00
fortran TRILABS-34 add batch option. Also fix cmakedefine01 usage 2018-10-11 11:31:09 -05:00
hl Makes the installed header files the same between the autotools 2018-10-26 20:44:29 -07:00
java VOL FEATURE 2018-10-10 08:10:15 -07:00
m4 Fixed a bug in autotools Fortran processing where a test for the 2017-06-28 17:30:45 -07:00
release_docs Updated RELEASE.txt to reflect HDFFV-10609 work (H5Xpkg.h files 2018-10-29 12:59:25 -07:00
src HDFFV-10601 Issues with chunk cache hash value calcuation: 2018-11-02 14:53:35 -05:00
test Fixed exit() to HDexit() in use_append_chunk.c and use_append_mchunks.c 2018-11-01 15:00:40 -05:00
testpar VOL FEATURE 2018-10-10 08:10:15 -07:00
tools Makes the installed header files the same between the autotools 2018-10-26 20:44:29 -07:00
.autom4te.cfg Merge pull request #426 in HDFFV/hdf5 from ~LRKNOX/hdf5_lrk:hdf5_1_10 to hdf5_1_10 2017-04-25 16:05:36 -05:00
.gitattributes Update Java util lib, Refactor H5D write VL to match read 2018-06-27 17:53:47 -05:00
.gitignore ignore java classpath 2017-04-17 13:19:20 -05:00
.h5chkright.ini Merge pull request #426 in HDFFV/hdf5 from ~LRKNOX/hdf5_lrk:hdf5_1_10 to hdf5_1_10 2017-04-25 16:05:36 -05:00
ACKNOWLEDGMENTS [svn-r19803] Description: 2010-11-17 11:42:57 -05:00
acsite.m4 Merge pull request #426 in HDFFV/hdf5 from ~LRKNOX/hdf5_lrk:hdf5_1_10 to hdf5_1_10 2017-04-25 16:05:36 -05:00
autogen.sh Fixed HDFFV-10404 2018-07-13 13:40:22 -05:00
CMakeFilters.cmake Correct linkage of filters and other libs 2017-11-16 09:04:51 -06:00
CMakeInstallation.cmake HDFFV-10603 patch 6 2018-10-15 13:49:53 -05:00
CMakeLists.txt Move options to root cmake file 2018-10-19 13:34:31 -05:00
configure.ac Merging in latest from upstream (HDFFV/hdf5:refs/heads/develop) 2018-09-21 12:17:19 -05:00
COPYING Update COPYING file with new HDF5 license. 2018-09-17 16:09:59 -05:00
COPYING_LBNL_HDF5 Add LBNL license file and modify COPYING file accordingly. 2017-03-29 13:36:52 -05:00
CTestConfig.cmake Update Drop Site options and Coverage settings 2018-08-09 10:59:32 -05:00
Makefile.am Merge pull request #426 in HDFFV/hdf5 from ~LRKNOX/hdf5_lrk:hdf5_1_10 to hdf5_1_10 2017-04-25 16:05:36 -05:00
Makefile.dist Merge pull request #426 in HDFFV/hdf5 from ~LRKNOX/hdf5_lrk:hdf5_1_10 to hdf5_1_10 2017-04-25 16:05:36 -05:00
MANIFEST Merge pull request #1313 in HDFFV/hdf5 from ~DEROBINS/hdf5_der:vol_tweaks to develop 2018-10-30 18:54:05 -05:00
README.txt Snapshot version 1.11 release 2. 2018-09-20 14:54:10 -05:00
UserMacros.cmake Merge pull request #426 in HDFFV/hdf5 from ~LRKNOX/hdf5_lrk:hdf5_1_10 to hdf5_1_10 2017-04-25 16:05:36 -05:00

HDF5 version 1.11.3 currently under development

------------------------------------------------------------------------------
Please refer to the release_docs/INSTALL file for installation instructions.
------------------------------------------------------------------------------

THE HDF GROUP
---------------

The HDF Group is the developer of HDF5®, a high-performance software library and 
data format that has been adopted across multiple industries and has become a 
de facto standard in scientific and research communities.

More information about The HDF Group, the HDF5 Community and the HDF5 software
project, tools and services can be found at the Group's website.

    https://www.hdfgroup.org/


DOCUMENTATION
-------------
This release is fully functional for the API described in the documentation. 
    https://portal.hdfgroup.org/display/HDF5/The+HDF5+API

Full Documentation and Programming Resources for this release can be found at
    https://portal.hdfgroup.org/display/HDF5

See the RELEASE.txt file in the release_docs/ directory for information specific 
to the features and updates included in this release of the library. 

Several more files are located within the release_docs/ directory with specific 
details for several common platforms and configurations.

    INSTALL - Start Here. General instructions for compiling and installing the library
    INSTALL_CMAKE  - instructions for building with CMake (Kitware.com)
    INSTALL_parallel - instructions for building and configuring Parallel HDF5 
    INSTALL_Windows and INSTALL_Cygwin - MS Windows installations.



HELP AND SUPPORT
----------------
Information regarding Help Desk and Support services is available at

    https://portal.hdfgroup.org/display/support/The+HDF+Help+Desk



FORUM and NEWS
--------------
The following public forums are provided for public announcements and discussions 
of interest to the general HDF5 Community.

    Homepage of the Forum
        https://forum.hdfgroup.org

    News and Announcement
        https://forum.hdfgroup.org/c/news-and-announcements-from-the-hdf-group

    HDF5 and HDF4 Topics
        https://forum.hdfgroup.org/c/hdf5
 
These forums are provided as an open and public service for searching and reading. 
Posting requires completing a simple registration and allows one to join in the 
conversation.  Please read the following instructions pertaining to the Forum's 
use and configuration
    https://forum.hdfgroup.org/t/quickstart-guide-welcome-to-the-new-hdf-forum


SNAPSHOTS, PREVIOUS RELEASES AND SOURCE CODE
--------------------------------------------
Periodically development code snapshots are provided at the following URL:
    https://gamma.hdfgroup.org/ftp/pub/outgoing/hdf5/snapshots/

Source packages for current and previous releases are located at:
    https://portal.hdfgroup.org/display/support/Downloads

Development code is available at our BitBucket Server:
    https://bitbucket.hdfgroup.org/projects/HDFFV/repos/hdf5/browse