Question about the Database

827 views
Skip to first unread message

Tc Jen

unread,
Dec 20, 2011, 11:38:23 AM12/20/11
to MIT-Adobe FiveK Dataset
Dear Sir

I’m a graduate student in taiwan. My research field is about image
enhancement
and I want to use your database for some simulations.

However, due to some network issue
I could not download the file (50 GB) in the website

Could you please provide me the file of the each category ?
(Raw data, expert1, expert2 , expert3, expert4, expert5 )

I thank you so much in advance and hope you have a great day.
Best Regards,
Jen

Vladimir Bychkovsky

unread,
Dec 20, 2011, 11:47:13 AM12/20/11
to MIT-Adobe FiveK Dataset
Hi Jen,

The bulk of the 50GB file are the raw files. Metadata (the Lightroom
catalog containing adjustments is relatively small). In other words,
most of the archive are just the 5000 raw photos.
I'll try to break up the archive into multiple files and will let you
know.

Vlad.

Vladimir Bychkovsky

unread,
Dec 20, 2011, 2:40:02 PM12/20/11
to MIT-Adobe FiveK Dataset
I've split the single tar file into 10 parts. Once you download them,
simply append them to each other in alphabetical order.

The following page is linked from the dataset page (search for "by
parts"), but here is a direct link for your convenience.
http://groups.csail.mit.edu/graphics/fivek_dataset/parts

After you put append all files together unpack it using tar.

Vlad.

On Dec 20, 11:47 am, Vladimir Bychkovsky

Armin Samii

unread,
Dec 20, 2011, 3:52:43 PM12/20/11
to fivek-dataset
Vladimir,
Thanks for splitting it! (And, of course, for providing the research
community with this dataset.)

Jen and others,
I have this little bash script that should run on a standard unix box;
it may be of use.
It grabs the URLs from the FiveK dataset page and downloads however
many you want.
(This does not get you the Lightroom catalog.)

Script:
wget -x $(wget -O- http://groups.csail.mit.edu/graphics/fivek_dataset/
| sed -n 's/.*\([id][mn][g]\/[^"]*\.[td][in][fg]\).*/\1/p' | head
-999999999999)

Replace the sequence of 9s with the number of images you want to grab.
This should be a multiple of 6 to get the DNG + 5 associated images.


Enjoy,
Armin Samii
Graduate Student Researcher
University of California, Berkeley

Reply all
Reply to author
Forward
0 new messages