Commit Graph

259 Commits

Author SHA1 Message Date
Pedro Vicente Nunes
00235dba7e [svn-r8333] Purpose:
new test

Description:
add a test that generates a file with "holes" and then uses h5repack to clean
the empty space. it works

Solution:

Platforms tested:
linux

Misc. update:
2004-04-09 09:20:49 -05:00
Pedro Vicente Nunes
1f80ae6a89 [svn-r8323] Purpose:
bug fix, new tests

Description:
added a couple of #ifdefs to check if a specific filter is available for read
added more tests
the h5tools check filters had a mismatched filter variable

Solution:

Platforms tested:
linux, with several filter configurations (all, some , none )

Misc. update:
2004-04-08 10:59:43 -05:00
Pedro Vicente Nunes
698f1af7ce [svn-r8320] Purpose:
new tests for h5repack

Description:
added more tests both to the test program and shell script that test
a variation of different filter converssions

Solution:

Platforms tested:
linux


Misc. update:
2004-04-07 20:44:14 -05:00
Pedro Vicente Nunes
6f711ab4cb [svn-r8318] Purpose:
new tests for h5repack

Description:
added tests that do layout type to layout type conversion in a matrix of 9 between compact, contiguous and chunking

Solution:

Platforms tested:
linux
afs has problems; I could not telnet to sol and copper, arabica is really slow (meaning
waiting 1 minute for a typed character) and the writing of a file gave an error
arabica 181% afs: failed to store file (145)
afs: failed to store file (145)



Misc. update:
2004-04-07 16:36:15 -05:00
Pedro Vicente Nunes
45878f9a8a [svn-r8311] Purpose:
cleaned some comments and printfs

Description:

Solution:

Platforms tested:
linux

Misc. update:
2004-04-06 13:30:30 -05:00
Pedro Vicente Nunes
6705762081 [svn-r8297] Purpose:
bug fix

Description:
the synntax of the input of h5repack conatined double quotes and spaces, which
were causing problems on the parsing in AIX paralell

Solution:
replaced the spaces by =
that is, instead of -f "GZIP 6"
we have now
-f GZIP=6

Platforms tested:
linux
solaris
AIX paralell


Misc. update:
2004-04-02 10:52:24 -05:00
Albert Cheng
5d91eb8a80 [svn-r8295] Purpose:
Bug fix.

Description:
nerror was not updated when errors were detected.
Added the nerror update and print a message at
the end if all is well.

Platforms tested:
Tested in copper, both parallel and serial.
2004-04-02 09:34:01 -05:00
Pedro Vicente Nunes
9c79ce84ee [svn-r8281] Purpose:
code clean, change test script

Description:
removed soem debugging messages
changed the chunking command line call to a non square dimensionality

Solution:

Platforms tested:
linux

Misc. update:
2004-03-25 14:31:42 -05:00
Pedro Vicente Nunes
472394a0e9 [svn-r8252] Purpose:
bug fix
new test

Description:
the fletcher filter used a temporary  2 byte word buffer to compute the checksum.
this is non portable between big-endian/little endian.

added a test that reads 2  pre-saved files (one LE, other BE) with that filter enabled

Solution:
replaced with a buffer of 1 byte type

Platforms tested:
linux
solaris
solaris 64 bit
AIX
windows

Misc. update:
2004-03-10 19:25:31 -05:00
Pedro Vicente Nunes
2a93f99317 [svn-r8232] Purpose:
new feature

Description:
added a check for the return value of the tools h5repack and h5diff
in the run script.
the return value is used to print PASSED (tool returns 0) or FAILED

Solution:

Platforms tested:
linux

Misc. update:
2004-03-04 11:55:07 -05:00
Pedro Vicente Nunes
931efcb5eb [svn-r8229] Purpose:
1) new function  for tools library
2) new test script for h5repack


Description:
1) currently all the tools (h5dump, h5diff, etc)  do not check if a filter is available
for reading some dataset that might have a filter not available on the current configuration (the behaviour
of the tools until now was to trigger a library error, saying that the dataset cannot be read
due to the lack of the filter)


Solution:
1) added a new function h5tools_canreadf that checks if a dataset can be read
depending on the availability of filters.
this function was added in calls for h5diff and h5repack.
instead of triggering the library error, a message is printed, saying that the dataset
cannot be read (the print is optional, it is on on verbose mode)

2) added a shell script that tests the commannd line tool behaviour of h5repack
the script does a series of runs of h5repack  with several options on the same file (this file test4.h5
was added to the testfiles dir).
then, it runs the h5diff tool, with the input and output files , in each run.
the goal of the test is also to check item 1) . the binary file was saved with filters
that might not be available on other configurations


Platforms tested:
linux (all filters enabled)
linux (some filters disabled)
solaris (some filters disabled)
AIX (some filters disabled)
windows (all filters on and off )


Misc. update:
2004-03-02 13:12:25 -05:00
Pedro Vicente Nunes
b20cf81c5c [svn-r8224] Purpose:
bug fix

Description:
I introduced some #ifdef <have_filter> on the check in yesterday on the places
that generated datasets, that had no corresponding on the read part.
this caused failures in the configurations  where a filter was not defined

Solution:
just removed the #ifdefs

Platforms tested:
linux

Misc. update:
2004-02-26 09:32:21 -05:00
Pedro Vicente Nunes
40357176e3 [svn-r8223] Purpose:
bug fix

Description:
generating a dataset in linux 2.4 (verbena) with the pgcc compiler gave an error with the following
sequence

1) make a space id1 and a dcpl
2) make a space id2, create and write a dataset with space id2, close
3) attempt to create a dataset with space id1 fails and calling a set_filter function with the dcpl in 1) fails


Solution:
just changed the order 2) to 1)


Platforms tested:
linux 2.4 (verbena) with pgcc compiler

Misc. update:
2004-02-25 14:37:45 -05:00
Pedro Vicente Nunes
f29e2a01e3 [svn-r8218] Purpose:
bug fix in H5Zshuffle.c
add more tests to h5repack that exposed the bug

Description:
when creating a dataset with the shuffle filter and duplicating it in a new dataset (file)
the call to H5Z_set_local_shuffle failed. this is because the value of cd_nelmts of the filter
structure is set to 1 (H5Z_SHUFFLE_TOTAL_NPARMS) when the original dataset is created, but when
the new dataset is created there is a checking instruction that fails if the value of
cd_nelmts is not 0 (its original value, H5Z_SHUFFLE_USER_NPARMS)

Solution:
just remove that check condition, since the value of cd_nelmts is not used anyway.
if we decide that the value of cd_nelmts is necessary, then the H5O_pline_copy function
must be changed to update this value (a different update for each filter)

Platforms tested:
linux
solaris
AIX

Misc. update:
2004-02-23 11:52:45 -05:00
Pedro Vicente Nunes
192c316dd5 [svn-r8176] Purpose:
new feature, bug fix, changed function

Description:
1) implemented the option that says if the dataset is too small , do not compress it
2) bug fix in the SZIP checking . only apply szip to atomic datatypes
3) made the apply_filters function more compact


Solution:

Platforms tested:
linux
AIX
solaris

Misc. update:
2004-02-10 13:33:20 -05:00
Pedro Vicente Nunes
c238a6c13c [svn-r8150] Purpose:
introduced the constant H5Z_FILTER_ALL, used to remove all filters in H5Premove_filter

Description:

Solution:

Platforms tested:
linux

Misc. update:
2004-02-04 15:35:37 -05:00
Pedro Vicente Nunes
78fb916259 [svn-r8149]
Purpose:
replaced name of delete filter with remove filter for the new function H5Premove_filter

Description:

Solution:

Platforms tested:
linux

Misc. update:
2004-02-04 14:36:12 -05:00
Quincey Koziol
2d8964517b [svn-r8128] Purpose:
Update dependencies after restructuring of MPI stuff
2004-01-30 21:32:19 -05:00
Pedro Vicente Nunes
203799486d [svn-r8123] Purpose:
added more tests for szip and more verbose output

Description:

Solution:

Platforms tested:
linux
solaris
AIX

Misc. update:
2004-01-29 10:04:32 -05:00
Pedro Vicente Nunes
796fe1c402 [svn-r8122] Purpose:
h5repack new feature

Description:
in the SZIP settings, when the requested pixels per block parameter does not conform
to the SZIP specifications, instead of returning without applying the filter,
do an attempt to set this parameter to a valid value, issuing a warning in the process

Solution:

Platforms tested:
linux
solaris
AIX

Misc. update:
2004-01-28 17:48:47 -05:00
Pedro Vicente Nunes
48c7a5e35e [svn-r8121] Purpose:
bug fix

Description:
avoid reading and writing data when one of the dimensions is 0 (attributes case )

Solution:
linux
solaris
AIX

Platforms tested:

Misc. update:
2004-01-28 14:07:21 -05:00
Pedro Vicente Nunes
500292582f [svn-r8120] Purpose:
bug fix

Description:
avoid reading and writing data when one of the dimensions is 0

Solution:

Platforms tested:
linux
solaris
AIX

Misc. update:
2004-01-28 11:06:09 -05:00
Pedro Vicente Nunes
afc3563b76 [svn-r8113] Purpose:
new library function H5Pdelete_filter
deletes one or all filters from a dataset creation property list
this was done for the NONE option of h5repack, added tests for this feature
added a test for the new function in /test/dsets.c


Description:

Solution:

Platforms tested:
linux
solaris
AIX

Misc. update:
2004-01-26 18:20:20 -05:00
Pedro Vicente Nunes
efbde3c2f3 [svn-r8074] Purpose:
added h5repack and h5diff support for copying and differences of references to dataset regions
modified the behaviour in the diff of attributes, when a difference in name is detected
in the attribute cycle (number of attributes of object), instead of exiting the
cycle, rather continue


Description:

Solution:

Platforms tested:
linux
solaris
AIX

Misc. update:
2004-01-16 10:31:55 -05:00
Pedro Vicente Nunes
5112a79d81 [svn-r8068] Purpose:
changed the text of a error message related to the fail of H5Fopen to " unable to open file "

Description:

Solution:

Platforms tested:
linux (small change )

Misc. update:
2004-01-15 11:48:48 -05:00
Pedro Vicente Nunes
7f7fbb4718 [svn-r8062] Purpose:
bug fix

Description:
cases of rank 0 were not handled, now a warning is made that the dataset cannot be compressed

Solution:

Platforms tested:
linux
solaris
AIX

Misc. update:
2004-01-14 15:09:44 -05:00
Pedro Vicente Nunes
62a9b30a64 [svn-r8060] Purpose:
added a usage message for h5repack

Description:

Solution:

Platforms tested:
linux
solaris
AIX

Misc. update:
2004-01-14 12:45:20 -05:00
Pedro Vicente Nunes
d83a48e4f9 [svn-r8056] Purpose:
h5repack change

Description:
changed the default size of chunks when defining a new dataset to apply a filter
this size is now equal to the current dimensions. previously , it was set to half this
value, and it was causing write calls to fail on some files (probably a bug)

Solution:

Platforms tested:
linux
solaris
AIX

Misc. update:
2004-01-13 13:12:47 -05:00
Pedro Vicente Nunes
be7ebb248f [svn-r8040] Purpose:
bug fix, code improvment

Description:
fixed a bug in the parse of chunking function
added some auxiliary functions to avoid repeated parts of the code in several places

Solution:

Platforms tested:
linux
solaris
AIX

Misc. update:
2004-01-08 10:53:32 -05:00
Quincey Koziol
feaa5bb9d5 [svn-r8038] Purpose:
Bug fix

Description:
    When two property lists are compared, the H5Pequal routine was just
comparing the raw information for the property values.  This causes problems
when the raw information contains pointers to other information.

Solution:
    Allow a 'compare' callback to be registered for properties, so that a user
application get perform the comparison itself, allowing for "deep" compares of
the property value.
    This was exported to the H5Pregister & H5Pinsert routines in the development
branch, but not the release branch.

Platforms tested:
    FreeBSD 4.9 (sleipnir)
    h5committest
2004-01-08 09:55:11 -05:00
Pedro Vicente Nunes
3396dd9513 [svn-r8028] Purpose:
small change  to the szip generated dataset

Description:

Solution:

Platforms tested:
linux
solaris
AIX

Misc. update:
2004-01-06 13:55:09 -05:00
Pedro Vicente Nunes
e59b3d3bcf [svn-r8025] Purpose:
small fix

Description:
the main prog had some repeated code

Solution:

Platforms tested:
linux
solaris
AIX

Misc. update:
2004-01-06 13:18:05 -05:00
Pedro Vicente Nunes
68607efcd1 [svn-r8021] Purpose:
h5repack new features

Description:
added support/tests for multi filters

Solution:

Platforms tested:
linux
solaris
AIX

Misc. update:
2004-01-06 12:49:00 -05:00
Quincey Koziol
0d405bdfb2 [svn-r8006] Purpose:
Code cleanup

Description:
    Tweaked down the size of the szip 'pixels per block' for a test, now that
the library is range-checking this value more strictly.

Platforms tested:
    FreeBSD 4.9 (sleipnir)
    too minor for h5committest
2003-12-31 15:26:00 -05:00
Quincey Koziol
b3a3693688 [svn-r8005] Purpose:
Code cleanup

Description:
    Removed redundant testing script from being executed, since it's just
running the program in the "TEST_PROGS" macro.

Platforms tested:
    FreeBSD 4.9 (sleipnir)
    too minor for h5committest
2003-12-31 15:25:05 -05:00
Pedro Vicente Nunes
738e808d26 [svn-r7999] Purpose:
h5repack new features

Description:
added support/ tests for contiguous and compact layout processing

Solution:

Platforms tested:
linux
solaris
AIX

Misc. update:
2003-12-31 09:00:36 -05:00
Pedro Vicente Nunes
d8531b8482 [svn-r7997] Purpose:
h5repack new features

Description:
added support for layout options

Solution:

Platforms tested:
linux
solaris
AIX

Misc. update:
2003-12-30 17:59:33 -05:00
Pedro Vicente Nunes
95da5842df [svn-r7996] Purpose:
h5repack new features

Description:
added support for shuffle and checksum filters

Solution:

Platforms tested:
linux
solaris
AIX

Misc. update:
2003-12-30 12:01:30 -05:00
Pedro Vicente Nunes
f503a72491 [svn-r7994] Purpose:
h5repack new features

Description:
added checking routines for the filters that were applied to the output file
added tests for szip filter

Solution:

Platforms tested:
linux
solaris

(IRIX is not available)
:

Misc. update:
2003-12-29 15:26:21 -05:00
Albert Cheng
f1e00b2afe [svn-r7980] Purpose:
Regenerate the Dependncies files.

Platforms tested:
"h5committested"

Misc. update:
2003-12-25 19:08:54 -05:00
Pedro Vicente Nunes
5658d88327 [svn-r7971] Purpose:
h5repack bug

Description:
changed the copy hardlinks algorithm
added more tests

Solution:

Platforms tested:
linux
solaris
IRIX


Misc. update:
2003-12-18 15:25:11 -05:00
Pedro Vicente Nunes
8f65e4252d [svn-r7969] Purpose:
h5repack new features

Description:
addded the copy routines for hard links
changed the traversal structure to store information about the hard links
added tests

Solution:

Platforms tested:
linux
solaris
IRIX

Misc. update:
2003-12-18 11:18:09 -05:00
Pedro Vicente Nunes
cd7b4b8b90 [svn-r7966] Purpose:
h5repack new features

Description:
added debugging functions and a hard link generated dataset for the test suite

Solution:

Platforms tested:
linux
solaris 2.7
IRIX

Misc. update:
2003-12-17 09:07:41 -05:00
Pedro Vicente Nunes
dc4f40f02f [svn-r7962] Purpose:
h5repack new features

Description:
added the copy of referenced objects

Solution:

Platforms tested:
linux
solaris 2.7
IRIX

Misc. update:
2003-12-16 13:08:45 -05:00
Albert Cheng
aaff647518 [svn-r7914] Purpose:
Regenerate the Dependencies files if needed.

Description:

Solution:

Platforms tested:

Misc. update:
2003-12-05 10:39:53 -05:00
Pedro Vicente Nunes
28e43d818f [svn-r7913] Purpose:
code clean

Description:
separated the h5repack code in several  modules

Solution:

Platforms tested:
linux
IRIX
solaris


Misc. update:
2003-12-04 14:35:33 -05:00
Pedro Vicente Nunes
54f35626c1 [svn-r7834] Purpose:
code clean

Description:
removed compiler warnings on IRIX

Solution:

Platforms tested:
linux
solaris 2.7
IRIX

Misc. update:
2003-11-10 16:32:01 -05:00
Pedro Vicente Nunes
b00b2d31e7 [svn-r7833] Purpose:
bug fix, clean code

Description:
a malloced buffer was not release
cleaned some compiler warnings


Platforms tested:
linux
solaris 2.7
IRIX

Misc. update:
2003-11-10 15:59:32 -05:00
Quincey Koziol
8ca8c23b5a [svn-r7822] Purpose:
Bug fix & code cleanup

Description:
    Propagate error value out of function, so that failures can be detected by
testing scripts.

    Clean up a few compiler warnings while I'm here.

Platforms tested:
    FreeBSD 4.9 (sleipnir)
    too minor to require h5committest
2003-11-06 08:45:39 -05:00
Pedro Vicente Nunes
8b45b9a5f0 [svn-r7785] Purpose:
h5repack new features


Description:
added a copy routine for all types
added a copy routine for attributes
commnented some debug messages in h5trav
added the verbose option to some h5diff messages


Platforms tested:
linux
solaris 2.5
IRIX


Misc. update:
2003-10-29 12:46:11 -05:00
Bill Wendling
0a2a91f24a [svn-r7777] Purpose:
Regenerated

Description:
    Regenerated Dependencies files because of changes to the h5diff and
    tools library.

Platforms tested:
    Linux (small change and just needed to be checked once).
2003-10-28 15:52:00 -05:00
Pedro Vicente Nunes
f2b52777f4 [svn-r7769] Purpose:
moved h5diff "public API" routines to tools/lib folder



Platforms tested:
linux
solaris 2.7
IRIX

Misc. update:
2003-10-28 12:40:05 -05:00
Pedro Vicente Nunes
cf86beb983 [svn-r7717] Purpose:
new features of h5repack

Description:
added copy routine
added parsing of command line arguments



Platforms tested:
linux, solaris, IRIX

Misc. update:
2003-10-23 14:51:51 -05:00
Pedro Vicente Nunes
9ad2479dd4 [svn-r7705] Purpose:
forgot to CVS add these new  .h files to the h5repack bunch






Misc. update:
2003-10-22 16:55:07 -05:00
Pedro Vicente Nunes
04d8607a9a [svn-r7704] Purpose:
continuation of commit message

Platforms tested:
linux
solaris
IRIX


Misc. update:
2003-10-22 16:45:59 -05:00
Pedro Vicente Nunes
d28bc61b33 [svn-r7703] Purpose:
h5repack new features

Description:
implemented some features of h5repack , mostly borrowed from hrepack
like
1) the parsing of options
2) building a list of options
3) printing formats

added a test program that generates files and calls h5diff to compare
the input and output files


Platforms tested:

Misc. update:
2003-10-22 16:43:34 -05:00
Quincey Koziol
e2518919c9 [svn-r7626] Purpose:
Update dependencies and tracing information

Platforms tested:
    Linux 2.4 (verbena) w/FORTRAN
    too minor for h5committest
2003-10-14 10:46:38 -05:00
Pedro Vicente Nunes
e61aa077c4 [svn-r7500]
Purpose:

added the Dependencies file to the folder

tested on IRIX     b

Description:

Solution:

platforms tested:

Misc. update:
2003-09-19 16:57:36 -05:00
Pedro Vicente Nunes
14b9ac8763 [svn-r7497] Purpose:
added  the new tool h5repack
right now it just contains source files with an empty main


Platforms tested:
linux (small change)

Misc. update:
2003-09-19 14:33:41 -05:00