Gradient clipping

262 views
Skip to first unread message

Bjarke Felbo

unread,
Jul 9, 2015, 12:56:00 PM7/9/15
to caffe...@googlegroups.com
I just found the gradient clipping functionality in solver.cpp. When would one want to perform gradient clipping when training a RNN or CNN? I'm especially interested in the latter. What would be a good starting value for clipping? (it can of course be tuned)

escorciav

unread,
Aug 15, 2015, 4:27:27 PM8/15/15
to Caffe Users
Ping...

Eric Wang

unread,
Jan 5, 2016, 7:32:53 AM1/5/16
to Caffe Users
I am also curious about that, have you figured it out?

在 2015年7月10日星期五 UTC+8上午12:56:00,Bjarke Felbo写道:

Daniil Pakhomov

unread,
Apr 7, 2016, 1:00:57 PM4/7/16
to Caffe Users
I am also interested.

This feature is not documented to the best of my knowledge.

Anyone successfully used it?

Thank you.

вторник, 5 января 2016 г., 7:32:53 UTC-5 пользователь Eric Wang написал:
Reply all
Reply to author
Forward
0 new messages