Szip compression

[King]

Hi,

Are you planning to implemented Szip compression support in the next
major release?
Szip compression seems to work better then other schemes.

Prashant

[Andrew Collette]

Hi,

Yes, SZIP will be available via the high-level interface in 1.1,
assuming you're using a version of HDF5 which includes it. Keep in
mind that the SZIP encoder is not available everywhere for licensing
reasons; in particular, I'm not able to include the compressor in the
Windows version of h5py.

Version 1.1 will also include a new high-speed compressor based on the
LZF library. You might also want to try using the HDF5 "shuffle"
filter with GZIP; it will improve the compression ratio.

Andrew Collette

[King]

Hi,

We are using HDF5 C API for writing files and h5py for reading them
back.
In this case SZIP decompression support in h5py will do the job.
I haven't tested various compression schemes supported by HDF5 but an
article here:
http://www.hdfgroup.org/doc_resource/SZIP/

shows that SZIP performs better in compression/decompression timings.

Prashant