Groups
Sign in
Groups
Caffe Users
Conversations
Labels
About
Send feedback
Help
How to classify multiple images (5000+)
319 views
batch_size
caffe
classification
data-augmentation
error
example
gpu
images
memory
multiple
pycaffe
python
Skip to first unread message
Mipso
unread,
Jun 15, 2016, 3:31:01 AM
6/15/16
Reply to author
Sign in to reply to author
Forward
Sign in to forward
Delete
You do not have permission to delete messages in this group
Copy link
Report message
Show original message
Either email addresses are anonymous for this group or you need the view member email addresses permission to view the original message
to Caffe Users
I've been using the Caffe classify example with C (
https://github.com/BVLC/caffe/blob/master/examples/cpp_classification/classification.cpp
) and with python (
https://github.com/BVLC/caffe/blob/master/python/classify.py
) and they work well. However, when I try to pass in several images at once (I modified classification.cpp to
https://github.com/flx42/caffe/commit/be0bff1a84c9e16fb8e8514dc559f2de5ab1a416
), it works, but I cannot pass in more than 2943 images at once on C, and more than 1000 images on python because of an Out of memory error.
I am using GPU with a Titan X 12 Giga, so I am surprised that the limit is so low.
Is there a way to classify more images at once ??
Thanks!
Yossi Biton
unread,
Jun 15, 2016, 3:54:28 AM
6/15/16
Reply to author
Sign in to reply to author
Forward
Sign in to forward
Delete
You do not have permission to delete messages in this group
Copy link
Report message
Show original message
Either email addresses are anonymous for this group or you need the view member email addresses permission to view the original message
to Caffe Users
There will always be some memory limit - batch of 3k images sound too much, even for Titan X.
I suggest you to split them into smaller batches (of 1000 images for example) and feed the network with each batch separately.
Message has been deleted
Mipso
unread,
Jun 15, 2016, 4:01:43 AM
6/15/16
Reply to author
Sign in to reply to author
Forward
Sign in to forward
Delete
You do not have permission to delete messages in this group
Copy link
Report message
Show original message
Either email addresses are anonymous for this group or you need the view member email addresses permission to view the original message
to Caffe Users
Thank you! Would changing the batch size have an impact on how many images I can pass in?
Reply all
Reply to author
Forward
0 new messages