Input/output error when creating ImageNet lmdb data

2,110 views
Skip to first unread message

junli gu

unread,
Sep 14, 2015, 9:28:54 PM9/14/15
to Caffe Users
Hi All:

I am seeking advice for the following problem i ran into. This is a new system with a new hard disk. I followed instructions at http://caffe.berkeleyvision.org/gathered/examples/imagenet.html to create imagenet data: I downloaded imagenet data, decompressed it, then ran ./examples/imagenet/create_imagenet.sh.  The script ran to until 11000 files and stopped with the error below.  (Input/output error). Actually the creation ilsvrc12_train_lmdb finished correctly. 

Did anyone see this error before? What is it? I could not find similar error on the website before. Could it be due to disk format error? or access permission error? Any advice is appreciated!

I0914 16:36:30.358037 24734 convert_imageset.cpp:82] A total of 1281167 images.
I0914 16:36:30.377306 24734 db_lmdb.cpp:23] Opened lmdb examples/imagenet/ilsvrc12_train_lmdb
E0914 16:39:50.922551 24734 convert_imageset.cpp:143] Processed 1000 files.
E0914 16:42:50.806234 24734 convert_imageset.cpp:143] Processed 2000 files.
E0914 16:47:26.736636 24734 convert_imageset.cpp:143] Processed 3000 files.
E0914 16:49:47.467708 24734 convert_imageset.cpp:143] Processed 4000 files.
E0914 16:52:34.925706 24734 convert_imageset.cpp:143] Processed 5000 files.
E0914 16:55:38.211323 24734 convert_imageset.cpp:143] Processed 6000 files.
E0914 16:58:47.917551 24734 convert_imageset.cpp:143] Processed 7000 files.
E0914 17:01:57.149382 24734 convert_imageset.cpp:143] Processed 8000 files.
E0914 17:05:07.006512 24734 convert_imageset.cpp:143] Processed 9000 files.
E0914 17:08:22.901008 24734 convert_imageset.cpp:143] Processed 10000 files.
E0914 17:11:48.960362 24734 convert_imageset.cpp:143] Processed 11000 files.
F0914 17:13:37.500121 24734 db_lmdb.hpp:14] Check failed: mdb_status == 0 (5 vs. 0) Input/output error
*** Check failure stack trace: ***
    @     0x7f74b0bf0daa  (unknown)
    @     0x7f74b0bf0ce4  (unknown)
    @     0x7f74b0bf06e6  (unknown)
    @     0x7f74b0bf3687  (unknown)
    @     0x7f74b0ff8dcb  (unknown)
    @           0x40386d  main
    @     0x7f74afdf1ec5  (unknown)
    @           0x40433c  (unknown)
    @              (nil)  (unknown)
Aborted (core dumped)

Thanks a lot!

junli 

Junli Gu

unread,
Sep 15, 2015, 12:35:43 AM9/15/15
to Caffe Users
Ok. I figured out why. I ran the create scripts on another disk, which ran out of space.

Junli 

--
You received this message because you are subscribed to a topic in the Google Groups "Caffe Users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/caffe-users/j-nG4mCuz2E/unsubscribe.
To unsubscribe from this group and all its topics, send an email to caffe-users...@googlegroups.com.
To post to this group, send email to caffe...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/caffe-users/ead9086a-7d18-407e-a30c-874bb69cee44%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.



--
************************************************
Junli Gu--谷俊丽
Coordinated Science Lab
University of Illinois at Urbana-Champaign
************************************************

p.Paul

unread,
Feb 23, 2017, 11:34:11 AM2/23/17
to Caffe Users
So how did you solve it ? I am facing a similar problem with lmdb creation.

lmdb.Error: ../data/HPElmdb/image-lmdb_train:  Input/output error

Kritika Garg

unread,
Dec 6, 2017, 4:27:14 PM12/6/17
to Caffe Users
Hi p.Paul. How did you solve this error? i am having the same error. can you help me please?
Reply all
Reply to author
Forward
0 new messages