I'm using caffe with caffenet model and 12Gib GPU.
To my surprise the computation time vs. batch size graph is almost linear with slope=1.
The computation is solver.step(10) (10 iterations of solver), using default solver
I have expected both computation time to have a much lower slope
100 images take 16 sec
300 images take 44 sec
600 images take 80 sec
2000 images take 260 sec
more notes:
- In a second test I tested forward pass only. same linear results
- I already made sure caffe is utilizing the GPU ( by using nvidia-smi command )
Any advice/idea for what may I be wrong with?
Isn't my expectation for a much lower slope correct?