Issue generating lmdb with own dataset

[archan...@gmail.com]

Hey,

I'm working with my own dataset and am trying to run create_imagenet in order to generate lmdbs. Every time I run create_imagenet.sh, I get the following error: 

Creating train lmdb...
I0801 14:38:20.097810 10417 convert_imageset.cpp:86] Shuffling data
I0801 14:38:21.020372 10417 convert_imageset.cpp:89] A total of 39211 images.
I0801 14:38:21.021061 10417 db_lmdb.cpp:35] Opened lmdb /home/ubuntu/caffe/izimele/izimele_train_lmdb
E0801 14:38:21.021185 10417 io.cpp:80] Could not open or find file /home/ubuntu/caffe/izimele/train/slow5695.jpg 2
E0801 14:38:21.021239 10417 io.cpp:80] Could not open or find file /home/ubuntu/caffe/izimele/train/no-tracks6004.jpg 1
E0801 14:38:21.021288 10417 io.cpp:80] Could not open or find file /home/ubuntu/caffe/izimele/train/no-tracks4316.jpg 1
E0801 14:38:21.021332 10417 io.cpp:80] Could not open or find file /home/ubuntu/caffe/izimele/train/yes-track2413.jpg 0
E0801 14:38:21.021373 10417 io.cpp:80] Could not open or find file /home/ubuntu/caffe/izimele/train/yes-track3970.jpg 0
E0801 14:38:21.021412 10417 io.cpp:80] Could not open or find file /home/ubuntu/caffe/izimele/train/yes-track5045.jpg 0
E0801 14:38:21.021453 10417 io.cpp:80] Could not open or find file /home/ubuntu/caffe/izimele/train/stop7009.jpg 3

Creating val lmdb...
I0801 14:38:23.213891 10424 convert_imageset.cpp:86] Shuffling data
I0801 14:38:24.051872 10424 convert_imageset.cpp:89] A total of 5004 images.
I0801 14:38:24.052541 10424 db_lmdb.cpp:35] Opened lmdb /home/ubuntu/caffe/izimele/izimele_val_lmdb
E0801 14:38:24.052665 10424 io.cpp:80] Could not open or find file /home/ubuntu/caffe/izimele/val/walking8191.jpg 4
E0801 14:38:24.052726 10424 io.cpp:80] Could not open or find file /home/ubuntu/caffe/izimele/val/slow877.jpg 2
E0801 14:38:24.052774 10424 io.cpp:80] Could not open or find file /home/ubuntu/caffe/izimele/val/stop8577.jpg 3
E0801 14:38:24.052816 10424 io.cpp:80] Could not open or find file /home/ubuntu/caffe/izimele/val/stop8662.jpg 3
E0801 14:38:24.052856 10424 io.cpp:80] Could not open or find file /home/ubuntu/caffe/izimele/val/yes-track735.jpg 0

I've found a few posts (not necessarily on this group) about this sort of issue before but I haven't yet found any sort of way to resolve it. 

Here's a snippet of my train.txt: 

no-tracks1.jpg 1
no-tracks10.jpg 1
no-tracks100.jpg 1
no-tracks1000.jpg 1
no-tracks1001.jpg 1
no-tracks1002.jpg 1
no-tracks1003.jpg 1
no-tracks1004.jpg 1
no-tracks1005.jpg 1
no-tracks1006.jpg 1
no-tracks1007.jpg 1

(the image labels go from 0 to 4)

A bit of my val.txt: 

slow8340.jpg 2
slow8341.jpg 2
slow8342.jpg 2
slow8343.jpg 2
slow8344.jpg 2
slow8345.jpg 2
slow8346.jpg 2
slow8347.jpg 2
slow8348.jpg 2
slow8349.jpg 2

(again, labels go from 0 to 4)

I've only really modified the paths in my create_imageset.sh--here it is: 

Not really sure how to fix this all--I've also been copying random files to the desktop and viewing them to see if they're corrupted and the ones that I've checked seem to be fine...

I can dig around more and check to see if some image file is corrupted (train.txt and val.txt shouldn't have any random aberrations since they were script-generated) but I really doubt it. 

Thanks!

[Andriy Lysak]

What are the permissions for those files? 

[archan...@gmail.com]

They're accessible (read, write, etc) to all users. 

[archan...@gmail.com]

oh i lied, here's what ls -l outputs

(train and val respectively)