Shuffle filter
52 views
Skip to first unread message
Thomas Pfaff
Feb 7, 2012, 9:20:15 AM2/7/12
to h5py
Hi there,
just out of curiosity.
I usually create my HDF datasets with h5py (v. 2.0.1) using
shuffle=True, compression='gzip' and compression_opts=6.
When I open those files in HDFView and look at the dataset's
properties I read something like "SHUFFLE: Nbytes=0".
When I created a similar dataset with PyTables it read "SHUFFLE:
Nbytes=4".
Now I'm kind of afraid that Nbytes=0 might mean that actually not much
shuffling is taking place?
I didn't find any more detailed explanations to the shuffle filter in
the HDF documentation.
Do you know, what might be the difference there?
Thomas
just out of curiosity.
I usually create my HDF datasets with h5py (v. 2.0.1) using
shuffle=True, compression='gzip' and compression_opts=6.
When I open those files in HDFView and look at the dataset's
properties I read something like "SHUFFLE: Nbytes=0".
When I created a similar dataset with PyTables it read "SHUFFLE:
Nbytes=4".
Now I'm kind of afraid that Nbytes=0 might mean that actually not much
shuffling is taking place?
I didn't find any more detailed explanations to the shuffle filter in
the HDF documentation.
Do you know, what might be the difference there?
Thomas
Reply all
Reply to author
Forward
0 new messages