How fast should the loss in Caffe decrease?

[Kwot Sin Lee]

My loss decreases from 3.6 to around 2.0 in 24 hours. However, is this fast enough? Is the acceptable loss around the range of 1e-5? If not, what is the acceptable range and how fast should one expect to see a loss in this magnitude?

I am currently finetuning my last layer on the BVLC caffenet with around 100k AVA images.

My test net loss is also remaining roughly equal around 3.65 without any decrease, resulting in the same test net accuracy. Is the decrease too minimal, or is the model training correctly?

Thank you.

[신승원]

How much is the loss in epoch 0, i.e. with initial random parameter?