I'm new to caffe and I'm trying to run caffe time benchmark. I tried single GPU and it works but when I try more than one always seems to pickup GPU ID 0.
Not sure what I'm missing but if I do training I can use all the GPUs no problem.
[root@103-124 caffe]# ./build/tools/caffe time -model models/bvlc_alexnet/train_val.prototxt -gpu 0,1,2,3
I0502 21:57:56.262063 12749 caffe.cpp:348] Use GPU with device ID 0
I0502 21:57:57.150985 12749 net.cpp:294] The NetState phase (0) differed from the phase (1) specified by a rule in layer data
I0502 21:57:57.151041 12749 net.cpp:294] The NetState phase (0) differed from the phase (1) specified by a rule in layer accuracy
I0502 21:57:57.151235 12749 net.cpp:51] Initializing net from parameters:
name: "AlexNet"