Commit Graph

9053 Commits

Author SHA1 Message Date
Pedro Vicente Nunes
df803f78d0 [svn-r12793] 1. fix a compiling error in atlantia
2. added the test library delete framework to delete output .h5 files
3. cleaned warnings
2006-10-20 13:45:17 -05:00
James Laird
14c697f7e4 [svn-r12792] Fixed a Makefile.am to clean up a test file generated by the Packet Table
compression test.

Tested that the file is removed on juniper and heping.

Running reconfigure also regenerated the H5E* files (I think this means
somebody updated these files but didn't run reconfigure).
2006-10-20 13:10:53 -05:00
MuQun Yang
db3c44c6d6 [svn-r12791] Change stattest.bat to stattest.BAT.
Windows is not case sensitive but Unix is.
2006-10-20 09:47:21 -05:00
MuQun Yang
5d1ebe6b0a [svn-r12790] Add a new batch file to test h5stat.
Update repacktest.bat for the new h5repack test.
Update tooltest.bat to include h5stat test.
2006-10-19 20:43:43 -05:00
MuQun Yang
2a973f740a [svn-r12789] Add a new windows test batch file(stattest.bat) to test h5stat on windows. 2006-10-19 20:40:25 -05:00
Raymond Lu
15135723d6 [svn-r12788] Enable the algorithm of Direct driver to read data in fragment from file. If the application
requests large data from file, to avoid using too much of memory for copying data from library's 
own aligned buffer to application's (unaligned) buffer, this step is done in fragment.  The next
step checkin is to handle writing data in fragment.
2006-10-19 17:35:45 -05:00
James Laird
4c8e9ca848 [svn-r12787] Fix some references to Variable-length packet table functions.
For some reason, only Visual Studio DLLs complained about these.

Current code compiles for me under Visual Studio and generates no related
warnings on juniper.
2006-10-19 15:10:19 -05:00
Pedro Vicente Nunes
e925ba26bb [svn-r12786]
a more improved usage message, specially on the filter and layout
information
2006-10-19 14:48:42 -05:00
Pedro Vicente Nunes
06a2780901 [svn-r12785]
added a new much more readable usage message
2006-10-19 13:50:37 -05:00
Pedro Vicente Nunes
a1edc70691 [svn-r12784]
Fixes for bugs 676, 228

676: both h5repack and h5diff use H5Dread. In the case of a "big"
dataset, use read/write by hyperslabs the same way h5dump uses. An
arbitrary value of 1GB was defined for "big", i.e, if the dataset is
greater than 1GB, then read/write by hyperslabs

228: use the file type in read/write by default. A new switch -n was
introduced if the user wants to use a native type, which was the
previous use by default.

Added a new test for h5repack that repacks a 1GB dataset

Tested: heping (serial, parallel), sol, copper
2006-10-19 12:07:26 -05:00
Raymond Lu
78a3d673e6 [svn-r12783] Took out the function H5FD_direct_alloc that was added yesterday. This function would be redundant
because the allocation function in H5FD.c H5FD_real_alloc actually has handled the aligned 
allocation.
2006-10-19 10:12:23 -05:00
Elena Pourmal
ef778326fd [svn-r12778] Multi file driver test fails.
Skipped until fix is found.

Tested on heping with pgf90.

Note:  Logic was wrong; as a result, the test was bypassed for all 
compilers except those (like Intel) that understand !DEC compiler directive. 

I confirmed that the test fails on heping with pgf90. The symptoms are the same:
1.6.5 h5dump can read multi files created by fortran test, 
but built h5dump fails with internal error.

 --This line, and those below, will be ignored--

M    test/fortranlib_test.f90
2006-10-18 21:07:16 -05:00
Raymond Lu
5e4114b908 [svn-r12777] Added support to aligned file space allocation. The alignment should be set through
H5Pset_alignment.
2006-10-18 16:42:32 -05:00
Raymond Lu
4d32eb160b [svn-r12776] The internal change is to make the 3 parameters of H5Pset_fapl_direct be a structure and passed
through driver info functions in H5FD_direct_open, H5FD_direct_read, and H5FD_direct_write.  The
external change is to add a new API function H5Pget_fapl_direct to query 3 control values, the
memory boundary, file system block size, and the maximal buffer size for copying data.
2006-10-18 15:20:32 -05:00
James Laird
d4daafbc85 [svn-r12775] Fixed HL C++ errors from removing VL packet table. Silly me for
omitting the C++ test in the first place!

Tested on heping (with --enable-cxx!).
2006-10-18 12:56:33 -05:00
John Mainzer
2d6bb59329 [svn-r12774] Modified flush code in the metadata cache to allow it to
handle flush callbacks which can dirty other entries, and
resize and/or rename the target entry.

This feature is needed by the fractal heap code.

Also added associated test code.


H5Commit tested.  Test failed on heping, but the 
error appears to be a syntax error in an un-related
file.

Tests on copper & sol passed, along with tests on 
phoenix.
2006-10-18 05:51:26 -05:00
James Laird
ce30ee9b28 [svn-r12773] Removed Variable-length packet tables from the HL libraries.
This is a quick change to make sure nothing breaks; VL functions in
the header files have been #ifdef'd out.

Tested on mir.
2006-10-17 16:19:11 -05:00
Pedro Vicente Nunes
2d586abc27 [svn-r12772]
added more tests for h5copy (compressed datasets, vl named datatypes )
2006-10-17 15:59:10 -05:00
Quincey Koziol
3a2bcc84ac [svn-r12771] Description:
More fixes to make the I/O & memory operations more efficient when loading
& flushing object header chunks.

    Add in concept of a chunk having a "gap" at the end - unused space that is
not large enough to hold a full null message that describes it.

    Clean up formatting a bit.

    Latest version of object header format not enabled yet, still working on a
few bugs...

Tested on:
    Linux/32 2.6 (chicago)
    Linux/64 2.6 (chicago2)
2006-10-17 15:36:15 -05:00
Quincey Koziol
f7a8a14bfd [svn-r12770] Description:
Overhaul usage of object header chunks to reduce I/O operations and
memory allocations.  The object header prefix is now stored in the first
object header chunk's "image" in memory.

    Also, lots of formatting cleanups.

    Taught h5debug tool about new object header format (which isn't enabled
just yet).

Tested on:
    Linux/32 2.6 (chicago)
    Linux/64 2.6 (chicago2)
2006-10-16 18:04:45 -05:00
Quincey Koziol
a504b0dcc3 [svn-r12769] Description:
Move object header creation past several internal possibilities for
errors, making the routine more resistant to errors encountered.

    Also, various formatting/compiler warning cleanups.

Tested on:
    Linux/32 2.6 (chicago)
    Linux/64 2.6 (chicago2)
2006-10-16 18:02:03 -05:00
Quincey Koziol
16a95636a3 [svn-r12768] Description:
Add 'initval' parameter to "lookup3" checksum routine (and implicitly to
the metadata checksum routine), to allow chaining several checksums together
easily (which isn't used by these modules, but will be used in my next checkin)

Tested on:
    Linux/32 2.6 (chicago)
    Linux/64 2.6 (chicago2)
2006-10-16 17:57:56 -05:00
Quincey Koziol
84bf19bec4 [svn-r12767] Description:
Code cleanup to improve formatting & reduce compiler warnings.

Tested on:
    Linux/32 2.6 (chicago)
    Linux/64 2.6 (chicago2)
2006-10-16 17:53:56 -05:00
Raymond Lu
775bd09974 [svn-r12766] Made two changes to Direct I/O VFD: first added 3 parameters to H5Pset_fapl_direct to control
memory boundary, file block size, and maximal copy buffer size; second in H5FD_direct_write and
H5FD_direct_read, the library checks whether data buffer is aligned.  If it is, then write and 
read the data directly instead of making a copy buffer.
2006-10-16 17:31:27 -05:00
Elena Pourmal
caf3fa51d8 [svn-r12765] Description:
Daily tests failed for Absoft f95 compiler

Solution:
	Failure was due to several typos in H5f90prpto.h file; fixed
	I also removed redundant flags from the configration files.

Platforms tested: heping with f95, g95, pgf90; pommier with f95
2006-10-16 17:24:33 -05:00
Pedro Vicente Nunes
c00121ce00 [svn-r12764]
put the H5LTcreate_compound_type function inside the 
#ifdef NOT_YET
macro

meaning that the function is not used by us
2006-10-16 16:20:05 -05:00
Pedro Vicente Nunes
3300d035b0 [svn-r12763]
removed the function H5LTcreate_compound_type from the source directory.
this function was not being used. when it was written, it was meant to be an auxiliary function to be used on the table api, but it never had an usage

commented the H5LTrepack function with the 
#ifdef NOT_YET
macro

it is also not being used
2006-10-16 12:51:21 -05:00
Pedro Vicente Nunes
6a35d4c306 [svn-r12762]
rewrote the -b option to make it more clear
2006-10-16 11:53:51 -05:00
Quincey Koziol
9848ea0387 [svn-r12761] Description:
Refactor object header macros, in preparation for updating the format.

Tested on:
    Mac OS/PPC 10.4.8 (amazon)
    FreeBSD/32 4.11 (sleipnir) w/thread-safe
    Linux/32 2.4 (heping) w/C++ & FORTRAN
    Linux/64 2.4 (mir) w/1.6 compat & build-all
2006-10-16 09:46:00 -05:00
Quincey Koziol
10e8a68a0c [svn-r12760] Description:
Speculatively attempt to read in the entire first chunk in object header
with the object header prefix.  If successful (which it is most of the time),
this reduces by 1 the # of I/Os required to read in the object header.  Since
the object header typically was taking 2 I/Os, this should cut the number of
I/O operations when opening an object's header in half.

Tested on:
    FreeBSD/32 4.11 (sleipnir) w/threadsafe
    Linux/32 2.4 (heping) w/C++ & FORTRAN
2006-10-15 23:30:07 -05:00
Quincey Koziol
2374bb1012 [svn-r12759] Description:
Fix errors with check-vfd and recent modifications to tests.

Tested on:
    Linux/64 2.4 (mir) w/check-vfd
2006-10-13 12:16:07 -05:00
Elena Pourmal
7ff0e2eacd [svn-r12758] Description: Maintenenace for VMS
Solution: Added new library files to the compilation script

Platforms tested: VMS server at Boeing
2006-10-13 09:21:53 -05:00
Quincey Koziol
6716ae8429 [svn-r12756] Description:
Clean up some object header code in advance of more major changes in the
near future.

    Fix small initialization error in attribute message name buffer copy.

    Tweak down the default # of messages for new object headers.

Tested on:
    FreeBSD/32 4.11 (sleipnir) w/threadsafe
    Linux/32 2.4 (heping) w/FORTRAN & C++
    Mac OS/32 10.4.8 (amazon)
2006-10-12 13:42:02 -05:00
Raymond Lu
7da414109c [svn-r12755] The line "#define _XOPEN_SOURCE 600" is recommended for posix_memalign function but causes compiling
error on copper.  Comment it out.  It only gives a warning on SGI Altix.
2006-10-12 13:35:44 -05:00
James Laird
17a40b2b72 [svn-r12753] Added 1.6 compatibility support for packet table test.
Tested on mir.
2006-10-12 13:23:39 -05:00
Elena Pourmal
65a1c88821 [svn-r12752] Descripton: This is a port to G95 compiler for MAC OSX and AIX 5.2
Previous implementation failed to compile on MAC OS X Tiger 10.4 and AIX 5.2

In previous implementation, each overloaded Fortran function called the same
C function. Since declaration of parameters in INTERFACE block for
C Function differed, some compilers issued warnings but g95 on MAC and AIX
failed to compile.

Solution: Add C wrappers corresponding to each overloaded Fortran function
to call C stub function. This fix should also reduce number of warnings
on IRIX systems.

Platforms tested:  MAC OS and AIX 5.2 (copper) with g95;
                   sol (with Sun compilers), heping with PGI compilers
2006-10-11 22:59:18 -05:00
Albert Cheng
e065eee4a8 [svn-r12751] Purpose:
Bug fix (related to 544)

Description:
h5_get_file_size() was coded to return 0 if failed but
file size can be 0.  Changed the failure return value to -1
which is allowed by the returned type of off_t which is a signed
type.
Also changed the checking code of the stat call to just == 0
since that is how it is defined.

Test:
Could test it in heping only.  Both Sol and Copper failed to
compiled due to error in the Direct IO VFD code.
2006-10-11 22:55:06 -05:00
Albert Cheng
9b24333b19 [svn-r12750] Purpose:
Bug Fix (Bug 544)

Description:
SGI Altix's MPI_File_get_size overflowed at 2GB and more.
Replaced h5_mpi_get_file_size calls by h5_get_file_size.

Tested:
Cobalt.
2006-10-11 21:12:24 -05:00
MuQun Yang
3cb353e883 [svn-r12748] _exit() function for Windows DLL cannot immediately terminate the calling process.
So new flush2 tests generates false failures for DLL version on windows.
Two cases of flush2 tests were skipped temporarily on windows. 
The inserted windows macros should be removed when a better solution is found.
Tested on vs6.0 and vs 7.1 and Linux.
2006-10-11 17:32:26 -05:00
Raymond Lu
c69d0bd40b [svn-r12747] Added a condition check to see if Direct I/o is enabled. 2006-10-11 16:57:18 -05:00
James Laird
c0712895d2 [svn-r12746] Changed Packet Table compression to what is hopefully a more portable test
(apparently, there are some systems for which compression makes things bigger
:/ ).

Tested on heping.
2006-10-11 16:25:50 -05:00
Raymond Lu
ed7ba34f1f [svn-r12743] Took out printout for driver information because the driver used can be different from the driver
used for standard output.
2006-10-11 10:21:10 -05:00
Raymond Lu
484ce75af4 [svn-r12742] Updated this output for a new driver "direct" has been added. 2006-10-11 09:58:55 -05:00
James Laird
de383a7edf [svn-r12741] Added support for direct I/O to check-vfd. The direct VFD is only tested
if it is enabled.

Added Direct VFD status to the configure summary.

Removed a line left over from pablo support.  Oops!
2006-10-10 15:47:24 -05:00
Quincey Koziol
c0c896e724 [svn-r12740] Description:
Update datasets and the layout, attributes and fill-value
object header messages to use the latest version
of the file format flag.

Tested  on:
    FreeBSD 4.11 (sleipnir)
    Linux/64 2.4 (mir)
    Linux/32 2.4 (heping)
2006-10-10 15:36:33 -05:00
Raymond Lu
65d30cc9c3 [svn-r12739] Added Direct I/O driver to VFD. It's only supported by SGI Altix (cobalt). There's a configure
option --enable-direct-vfd/--disable-direct-vfd to enable/disable Direct I/O support.  The default
is enabled.  There's a small test in test/vfd.c.  Another way to test it is to set environment
variable HDF5_DRIVER to "direct" and run "make check" in the test/ directory.  There'll be some
further improvement in the following checkin including allowing user to provide memory boundary
value, file block size, and copying buffer size.
2006-10-10 15:07:16 -05:00
Quincey Koziol
176f59f0f4 [svn-r12738] Description:
Tweak down some of the static array definitions for new & re-loaded object
header data structures, to reduce memory use in common cases.

Tested on:
    Linux/32 2.6 (chicago)
2006-10-10 14:41:37 -05:00
Quincey Koziol
14dcb6db33 [svn-r12736] Description:
Add "use the latest format" support for dataspace object header encode/
decode routines and clean up format a bit for the latest format (new to 1.8.x
releases)

    Remove storing 'perm' parameter for array datatypes in memory and the file,
and add test to make certain that if any user applications are attempting to
store them, we get some reports back.  (Should be unlikely, since the RefMan
says that the parameter is not implemented and is unsupported).
    Carry those changes into the tests, etc.

    Clean up a bunch more compiler warnings.

Tested on:
    FreeBSD/32 4.11 (sleipnir) w/threadsafe
    Linux/32 2.4 (heping) w/FORTRAN & C++
    Linux/64 2.4 (mir) w/enable-1.6-compat
2006-10-08 23:18:18 -05:00
Quincey Koziol
20720af231 [svn-r12735] Description:
Clean up some compiler warnings and resolve some inconsistenceis between
hsize_t and size_t in the interface.

Tested on:
    FreeBSD/32 4.11 (sleipnir) w/threadsafe
    Linux/32 2.4 (heping) w/FORTRAN & C++
    Linux/64 2.4 (mir) w/enable-1.6-compat
2006-10-08 23:14:29 -05:00
Quincey Koziol
25d1056dbf [svn-r12734] Description:
Clean up some compiler warnings.

Tested on:
    FreeBSD/32 4.11 (sleipnir) w/threadsafe
    Linux/32 2.4 (heping) w/FORTRAN & C++
    Linux/64 2.4 (mir) w/enable-1.6-compat
2006-10-08 22:51:03 -05:00