Multiple train phases

23 views
Skip to first unread message

Tim

unread,
Sep 7, 2017, 1:43:10 AM9/7/17
to Caffe Users
Hello!

Is it possible to have multiple training phases/stages like the options for testing phase in https://github.com/BVLC/caffe/issues/3864
I would like to training different layers of the net individually.during the different training stages.

Jonathan R. Williford

unread,
Sep 7, 2017, 3:45:56 AM9/7/17
to Tim, Caffe Users
If you are using the caffe command for training, you will need to make a separate call for each stage. The caffe command accepts a parameter "-stage". It might be easier to make a separate prototxt for each stage. For a single prototxt, you will need to duplicate the layers for each stage. For layers without learning, you will need to set both lr_mult and decay_mult to 0 (separately for the weights and biases).

Best,
Jonathan

--
You received this message because you are subscribed to the Google Groups "Caffe Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to caffe-users+unsubscribe@googlegroups.com.
To post to this group, send email to caffe...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/caffe-users/4ca08e13-9846-4b24-8361-7f8f0a555920%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Tim

unread,
Sep 7, 2017, 8:58:36 AM9/7/17
to Caffe Users
Thanks for your answer!


On Thursday, September 7, 2017 at 3:45:56 PM UTC+8, Jonathan R. Williford wrote:
If you are using the caffe command for training, you will need to make a separate call for each stage. The caffe command accepts a parameter "-stage". It might be easier to make a separate prototxt for each stage. For a single prototxt, you will need to duplicate the layers for each stage. For layers without learning, you will need to set both lr_mult and decay_mult to 0 (separately for the weights and biases).

Best,
Jonathan
On Thu, Sep 7, 2017 at 7:43 AM, Tim <radica...@gmail.com> wrote:
Hello!

Is it possible to have multiple training phases/stages like the options for testing phase in https://github.com/BVLC/caffe/issues/3864
I would like to training different layers of the net individually.during the different training stages.

--
You received this message because you are subscribed to the Google Groups "Caffe Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to caffe-users...@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages