Getting data into fuel's data path

197 views
Skip to first unread message

Pablo Jadzinsky

unread,
Jun 2, 2015, 4:46:54 PM6/2/15
to fuel-...@googlegroups.com
Hi,

I'm making a script to convert my own data into Fuel following the examples here http://fuel.readthedocs.org/en/latest/h5py_dataset.html 

Everything seems to be working well, but now I want my fuel file to be stored in fuel's data folder (next to MNIST) such that I can do (as in block's intro tutorial)

from fuel.datasets import MYDATA

Any ideas on how to do that?
Thanks
Pablo

Bart van Merriënboer

unread,
Jun 2, 2015, 4:49:25 PM6/2/15
to Pablo Jadzinsky, fuel-...@googlegroups.com
You need a very thin wrapper around H5PYDataset that looks for your HDF5 file in the right place and (optionally) sets some sensible default arguments to H5PYDataset. Have a look at the MNIST class, it should be straightforward to adapt: https://github.com/mila-udem/fuel/blob/master/fuel/datasets/mnist.py

--
You received this message because you are subscribed to the Google Groups "fuel-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to fuel-users+...@googlegroups.com.
To post to this group, send email to fuel-...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/fuel-users/4ccdf0a3-c582-403f-93dd-4dfa6ce1d31f%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

David Warde-Farley

unread,
Jun 2, 2015, 10:17:11 PM6/2/15
to Pablo Jadzinsky, fuel-...@googlegroups.com
I think you're conflating a couple of issues.

from fuel.datasets import <name> will only work if the dataset wrapper class is actually part of the fuel.datasets package, meaning it's distributed with Fuel's source code. This is limited to stuff that is officially supported by Fuel. It has nothing to do with where the data is actually stored.

You can move the hdf5 file you've created into whatever you have "data_path" set to in your ~/.fuelrc, but you will still need to import the class you've written from "from yourpackage import whatever".

On Tue, Jun 2, 2015 at 4:46 PM, Pablo Jadzinsky <pjadz...@gmail.com> wrote:

--
Reply all
Reply to author
Forward
0 new messages