2
0
mirror of https://github.com/HDFGroup/hdf5.git synced 2025-02-17 16:10:24 +08:00
Commit Graph

8331 Commits

Author SHA1 Message Date
MuQun Yang
caefcc2133 [svn-r11953] Purpose:
code cleanup

Description:
remove two printf lines accidently added for debugging at NCSA cobalt.

Solution:

Platforms tested:
No need to test.

Misc. update:
2006-02-17 15:55:20 -05:00
MuQun Yang
4336ee7bf3 [svn-r11952] Purpose:
Enhance the collective chunk IO support

Description:

Solution:

Platforms tested:

Misc. update:
2006-02-16 12:20:37 -05:00
MuQun Yang
25837d324e [svn-r11951] Purpose:
Enhance collective chunk IO supports

Description:
Add a new test to check the correctness of the HDF5 library behavior for collective IO mode when one process doesn't have any contribution for IO.

Solution:

Platforms tested:
IBM AIX 5.2(copper)
Linux (heping) mpich-1.2.6


Misc. update:
2006-02-16 12:12:08 -05:00
MuQun Yang
0fe91bb1a2 [svn-r11950] Purpose:
Enhanced collective chunk IO supports

Description:
1. When using collective IO with chunking storage without any tuning, performance may become worse under some circumstances.
2. Current HDF5 handles raw-data IO per chunk. So for many small chunks, many small IOs will be passed into MPI-IO. That may cause bad performance.
3. For one IO per chunk case, sometimes performance with collective is worse than performance with independent. An obvious case is when only one process is doing IO and all other process are not doing IO, the collective IO will only add overheads for communication. We want to avoid this case. Some management inside our library needs to be done.


Solution:
- Added managements of collective IO supports for chunking storage
         inside parallel HDF5
         1) Implemented One IO with collective mode for all chunks in the
            application by building one MPI derived datatype accross all
            chunks.
         2) Implemented the decision-making support to do collective IO inside
            MPI-IO per chunk.
         3) Added the decision-making support to do one IO accross all chunks
            or to do multiple IOs with each IO per chunk.
         4) Added the support to handle the case some processes won't do any IOs in
            collectively.
         5) Some MPI-IO package(mpich 1.2.6 or lower, e.g.) cannot handle
            collective IO correctly for the case when some processes have no
            contributions to IOs, a special macro is added to change
            collective IO mode to independent IO mode inside HDF5 library.



Platforms tested:

Parallel:

IBM AIX 5.2(copper)
Linux (heping) mpich-1.2.6
SDSC Teragrid mpich-1.2.5
Linux(Tungsten) mpich-1.2.6
Altix(NCSA cobalt)

Seq:
Linux(heping)

Misc. update:
2006-02-16 12:08:34 -05:00
Fang Guo
2a4cd8949e [svn-r11949] Purpose:
Remove deleteline.bat and add in tooltest.bat
Description:

Solution:

Platforms tested:

Misc. update:
2006-02-16 12:07:16 -05:00
Fang Guo
3bc27f1741 [svn-r11948] Purpose:
Batch file Improvement
Description:
This batch file is not necessary for new batch files
Solution:

Platforms tested:

Misc. update:
2006-02-16 12:05:28 -05:00
Fang Guo
beca2df12b [svn-r11947] Purpose:
Add in copyright information
Description:

Solution:

Platforms tested:

Misc. update:
2006-02-16 12:03:52 -05:00
Fang Guo
eb24bf8fc0 [svn-r11946] Purpose:
Batch File Improvement
Description:
Make tool test batch files easier to maintain
Solution:

Platforms tested:
Windows XP
Misc. update:
2006-02-16 12:01:47 -05:00
Fang Guo
4f841b0ab3 [svn-r11945] Purpose:
Batch file improvement
Description:
Make tool test batch files easier to maintain
Solution:

Platforms tested:
Windows XP
Misc. update:
2006-02-16 11:58:43 -05:00
Fang Guo
b60f1ac81a [svn-r11944] Purpose:
Batch file improvement
Description:
This batch file will be call by all of the tool test batch files
Solution:

Platforms tested:
Windows XP
Misc. update:
2006-02-16 11:56:20 -05:00
MuQun Yang
eea5371123 [svn-r11943] Purpose:
Added descriptions for the current collective chunk IO supports.

Description:

Solution:

Platforms tested:

Misc. update:
2006-02-16 11:53:00 -05:00
MuQun Yang
a8a2d5dedb [svn-r11942] Purpose:
Add collective chunk IO supports

Description:
Added a macro hdf5_mpi_special_collective_io_works to filter out
some mpi-io packages that don't support collective IO for no IO
contributions in some processes.

Solution:
1.
"hdf5_mpi_special_collective_io_works=${hdf5_mpi_special_collective_io_works=
'no'}"
has been added at the end of file ia64-linux-gnu and linux-gnulibc1

2. Some comments are added in ia64-linux-gnu and linux-gnulibc1.
3. Documents are added inside RELEASE.txt.

Platforms tested:
Parallel:

IBM AIX 5.2(copper)
Linux (heping) mpich-1.2.6
SDSC Teragrid mpich-1.2.5
Linux(Tungsten) mpich-1.2.6
Altix(NCSA cobalt)

Seq:
Linux(heping)

Misc. update:
2006-02-16 11:51:47 -05:00
Fang Guo
6a3e8c405f [svn-r11941] Purpose:
Batch file improvement
Description:
Make tool test batch files easier to maintain
Solution:

Platforms tested:
Windows XP
Misc. update:
2006-02-16 11:48:24 -05:00
Fang Guo
f2b9b502d2 [svn-r11940] Purpose:
Batch file improvement
Description:
Make tool tests batch files easier to maintain
Solution:

Platforms tested:
Windows XP
Misc. update:
2006-02-16 11:46:28 -05:00
MuQun Yang
bac54105f6 [svn-r11939] Purpose:
Supports for collective chunk IO inside parallel HDF5

Description:
Added a macro hdf5_mpi_special_collective_io_works to filter out
          some mpi-io packages that don't support collective IO for no IO
          contributions in some processes.

Solution:
Using AC_CACHE_VAL to do the job.

Platforms tested:
Parallel:

IBM AIX 5.2(copper)
Linux (heping) mpich-1.2.6
SDSC Teragrid mpich-1.2.5
Linux(Tungsten) mpich-1.2.6
Altix(NCSA cobalt)

Seq:
Linux(heping)

Misc. update:
2006-02-16 11:45:42 -05:00
Fang Guo
811131397c [svn-r11938] Purpose:
Batch file improvement
Description:
Make tool tests batch file easier to maintain
Solution:

Platforms tested:
Windows XP
Misc. update:
2006-02-16 11:45:27 -05:00
Albert Cheng
b7d3a581e0 [svn-r11937] Purpose:
New feature.

Description:
Added the feature to make a release tarball for the documents tree too.

Platforms tested:
Feature code was created by James.  I just did some touch up and
tested it by hand in heping.  I am checking it in while he is absent.

Misc. update:
2006-02-15 15:37:00 -05:00
Albert Cheng
d6fd191015 [svn-r11935] Purpose:
Cleanup

Description:
v1.7:
Removed some debug files left by previous change.
Uncommented the removal of the temporary working directory.

v1.6:
Moved the code of removal of the temporary working directory
to a later location in order to stay in sync with v1.7.
(The later location is needed for v1.7 code but makes no different
to v1.6)

Platforms tested:
Tested by hand.
2006-02-15 15:30:51 -05:00
Pedro Vicente Nunes
ed9449e009 [svn-r11932] Purpose:
bug fix

Description:
the --disable-hl switch was causing linking errors on gif2h5 that uses image api (bugzilla )

Solution:
used the condional macro for hl to build gif2h5

Platforms tested:
linux

Misc. update:
2006-02-10 11:29:34 -05:00
Pedro Vicente Nunes
f6dd21fb11 [svn-r11931] Purpose:
bug fix

Description:
the linking order in Makefile.am of the gif2h5 tool was causing linking errors on some configurations (pgcc, --disable-shared)

Solution:
changed the order of the linking (hl before hdf5)

Platforms tested:
linux, several configurations
solaris

Misc. update:
2006-02-09 16:06:14 -05:00
Pedro Vicente Nunes
45ab968ad8 [svn-r11926] Purpose:
bug fix

Description:
the build order of the several folders was causing linking errors

Solution:
changed the "." to be the last to avoid it

Platforms tested:
linux

Misc. update:
2006-02-08 12:12:35 -05:00
Fang Guo
91f4f60a4a [svn-r11925] Purpose:
Windows Maintenance
Description:
Update all.sln
Solution:

Platforms tested:

Misc. update:
2006-02-07 17:37:10 -05:00
Fang Guo
8a9da174d1 [svn-r11924] Purpose:
Maintenance on Windows
Description:
Change project settings to include path to H5IM.h
Solution:

Platforms tested:
Windows XP
Misc. update:
2006-02-07 17:31:44 -05:00
Fang Guo
8874b3eac4 [svn-r11923] Purpose:
Maintenance on Windows
Description:
Change project settings to include the path to H5IM.h
Solution:

Platforms tested:

Misc. update:
2006-02-07 17:30:51 -05:00
Fang Guo
f396c4caa0 [svn-r11922] Purpose:
Maintenance on Windows
Description:
Add hdf hl library as the dependency of gifconv and gifconvdll
Solution:

Platforms tested:
Windows XP
Misc. update:
2006-02-07 17:29:46 -05:00
Albert Cheng
8ff52b9038 [svn-r11920] Purpose:
improvement.

Description:
Release must be run at the top of the hdf5 source directory.
Added a test to verify this condition at the beginning of the
command.

Platforms tested:
Tested by hand.
2006-02-06 22:49:32 -05:00
Pedro Vicente Nunes
7ffbea9c24 [svn-r11919] Purpose:
some code cleaning

Description:

Solution:

Platforms tested:
none

Misc. update:
2006-02-06 11:33:47 -05:00
Pedro Vicente Nunes
35c1f3682e [svn-r11918] Purpose:
bug fix , bugzilla bug 

Description:
the gif2h5 was not writing HDF5 images correctly

Solution:
use the Image API to write the image, rewrote the writing functionY

Platforms tested:
linux
solaris

Misc. update:
2006-02-06 11:11:48 -05:00
James Laird
5495641296 [svn-r11916] Purpose:
Bug fix in release script

Description:
release --private should create a release without changing the current
version of the library.  This wasn't working for the libtool version, which
was getting bumped regardless.

Solution:
Fixed the release and h5vers scripts to leave the source directory
unchanged when bin/release --private is run.

Platforms tested:
mir (changes to scripts only)
2006-02-01 17:26:14 -05:00
John Mainzer
42d4edcb4a [svn-r11915] Purpose:
Attempt to ensure that the parallel cache test runs at a reasonable
speed with large numbers of processors.

Description:

In some cases, the number of random locks and unlocks was a multiple of
the MPI rank.

Solution:

Use rank % 4 instead of simply rank.

Platforms tested:
copper

Misc. update:
2006-01-31 16:09:37 -05:00
Fang Guo
fa00ad762d [svn-r11914] Purpose:
Add in cache_api.dsp and cache_apidll.dsp
Description:

Solution:

Platforms tested:

Misc. update:
2006-01-31 15:15:40 -05:00
Fang Guo
44ac5d87fa [svn-r11913] Purpose:
Windows Maintenance
Description:
Add in cache_api.dsp and cache_apidll.dsp
Solution:

Platforms tested:

Misc. update:
2006-01-31 15:12:16 -05:00
Fang Guo
00f3f8f4c1 [svn-r11912] Purpose:
Maintenance on Windows
Description:
Update all.sln to include cache_api.dsp and cache_apidll.dsp
Solution:

Platforms tested:

Misc. update:
2006-01-31 15:10:16 -05:00
Fang Guo
433b9ecf6b [svn-r11911] Purpose:
Maintenance on Windows
Description:
Update workspace to include cache_api.dsp and cache_apidll.dsp
Solution:

Platforms tested:

Misc. update:
2006-01-31 15:01:41 -05:00
Fang Guo
f6e8d8c469 [svn-r11910] Purpose:
Maintenance on Windows
Description:
Add cache_common.c into cachedll.dsp
Solution:

Platforms tested:
Windows XP
Misc. update:
2006-01-31 14:51:44 -05:00
Fang Guo
72406bcaae [svn-r11909] Purpose:
Maintenance on Windows
Description:
Add cache_common.c into project cache.dsp
Solution:

Platforms tested:
Windows XP
Misc. update:
2006-01-31 14:50:58 -05:00
Fang Guo
1cc33a5f31 [svn-r11908] Purpose:
Maintenance on Windows
Description:
Add tests for cache_api.dsp and cache_apidll.dsp
Solution:

Platforms tested:

Misc. update:
2006-01-31 14:49:43 -05:00
Fang Guo
7340e2c148 [svn-r11907] Purpose:
Maintenance on Windows
Description:
Add new tests cache_apidll.dsp
Solution:

Platforms tested:
Windows XP
Misc. update:
2006-01-31 14:48:35 -05:00
Fang Guo
b37446fb40 [svn-r11906] Purpose:
Mintainance on Windows
Description:
Add new tests cache_api.dsp
Solution:

Platforms tested:
Windows XP
Misc. update:
2006-01-31 14:47:41 -05:00
John Mainzer
43df732a9b [svn-r11904] Purpose:
Add a file that I forgot in my last checkin.

Description:

t_cache.c is the source file for the new parallel metadata cache test.


Solution:

See above.

Platforms tested:

h5committested before the last checkin.  Will run another
h5committest shortly, but it shouldn't be necessary as there
are no new changes.

Misc. update:
2006-01-28 21:34:52 -05:00
John Mainzer
c18b328ff1 [svn-r11903] Purpose:
Add files that I forgot in my last checkin.

Description:

cache_api.c cache_common.c cache_common.h are new files that result
from breaking the old cache test into two tests.


Solution:

See above.

Platforms tested:

h5committested before the last checkin.  Will run another
h5committest shortly, but it shouldn't be necessary as there
are no new changes.

Misc. update:
2006-01-28 21:34:14 -05:00
Quincey Koziol
6e0ea943fa [svn-r11901] Purpose:
Bug fix/additional tests

Description:
    Add additional tests for holding open an object of a given type (dataset,
group, etc) while incorrectly trying to open that object with a different
type of API routine (i.e. using the group open call on a dataset, etc.)


Platforms tested:
    FreeBSD 4.11 (sleipnir)
    Too minor to require h5committest
2006-01-28 17:09:27 -05:00
Quincey Koziol
d579d6aa5e [svn-r11899] Purpose:
Bug fix & new feature

Description:
    Support variable-length datatypes in compact data storage and chunked
data storage, along with attributes.

    Bug fix on the H5T_vlen_set_loc to allow for changing the file on a
variable-length datatype on disk.

Platforms tested:
    FreeBSD 4.11 (sleipnir)
    Linux 2.4
    Can't h5committest right now, due to missing cache files.
2006-01-28 13:31:22 -05:00
John Mainzer
dfb1f40cbb [svn-r11897] Purpose:
1) Add parallel test for metadata cache

2) Split serial test for metadata cache into two parts

3) Fix bug in which cache was flushed needlessly when the
   cache wasn't full.

4) Performance improvements

5) Update API for parallel cache coherency bug fix.

Description:

See above.

Solution:

See above.

Platforms tested:

h5committest


Misc. update:
2006-01-27 17:58:48 -05:00
John Mainzer
22e5198407 [svn-r11896] Purpose:
1) Add parallel test for metadata cache

2) Split serial test for metadata cache into two parts

3) Fix bug in which cache was flushed needlessly when the
   cache wasn't full.

4) Performance improvements

Description:

See above.

Solution:

See above.

Platforms tested:

h5committest


Misc. update:
2006-01-27 17:57:19 -05:00
Leon Arber
05b8021db4 [svn-r11895] Purpose:
Bug fix.

Description:
Seems like some compilers don't like the "inline" function spec.

Solution:
Removed the inline description for the sub_time function.

Platforms tested:
heping and tg-login.

Misc. update:
2006-01-27 10:32:04 -05:00
Leon Arber
d61b687587 [svn-r11894] Purpose:
Feature, address bug 

Description:
The h5perf test now also keeps track of the time it takes to:

open a file: Time between start of open and start first read/write
close a file: Time between end of last read/write and end of close.

This information is only displayed if debug output printing is enabled (level 3 or higher)

Solution:
The test actually has all of the data necessary to compute the time it takes to open
and close a file; it just wasn't recording it.  Added 4 new timers:

HDF5_FILE_READ_OPEN
HDF5_FILE_READ_CLOSE
HDF5_FILE_WRITE_OPEN
HDF5_FILE_WRITE_CLOSE

that keep track of the time to open/close a file opened for reading/writing.

Platforms tested:
heping and mir

Misc. update:
2006-01-26 17:45:51 -05:00
Elena Pourmal
25f2ebda39 [svn-r11891] Purpose: Small bug fix
Description: h5_group example didn't work on VMS; it turned out
             that a group was not closed and since the default
             file close degree is "weak", file was not closed either.
             When program attempted to open the same file, system reported
             an error since the file was "locked by another user".
             UNIX systems apperently do not care and open the same file
             without any problem.

Solution: Added H5Gclose calls.

Platforms tested: VMS server and heping

Misc. update:
2006-01-25 11:53:14 -05:00
Quincey Koziol
6cf7a8fe7d [svn-r11889] Purpose:
Bug fix

Description:
    Fix compile problem with C++ compiler after recent changes.

Platforms tested:
    FreeBSD 4.11 (sleipnir) w/CC=g++
2006-01-24 09:48:36 -05:00
Quincey Koziol
56e3f667d6 [svn-r11886] Purpose:
Code cleanup

Description:
    Check in some of the code cleanups from working on the external link
support.  (This doesn't include any of the external link features)

Platforms tested:
    FreeBSD 4.11 (sleipnir)
    Mac OSX.4 (amazon)
    Linux 2.4
2006-01-23 15:46:34 -05:00