Learning rate update

[curr...@gmail.com]

Hellow again,

I can´t find how the Learning rate is being updated. Could you tell me wich ecuation does that? This is the only information i have found:

net.hyperParam.ni_initial    = 0.05;% ni to start training process

net.hyperParam.ni_final = 0.00001;% final ni to stop the training process

Thanks!

[Hagay Garty]

learning rate starts from ni_initial and after 'noImprovementTh' consecutive iterations with no improvement in loss value, the learning rate is reduced by half.

when learning rate drops below ni_final training stops.