Suddenly super slow during training

[Charon Zhai]

I'm training a CNN. For first few tens of iterations, the speed is normal. Then out of a sudden, it becomes super slow. Does anyone else come cross same situation? Or can anybody tell me what might be the cause? Thanks very much!