More info about RBM and CD

10 views

Skip to first unread message

Samuel St-Jean

unread,

Nov 6, 2012, 4:57:31 PM11/6/12

to ift-72...@googlegroups.com

For those who would like to know more about RBM and why using only one step of CD can work (although more are prefered as the training progress, but you should read it instead of being spoiled), lecture 12 of Hinton's machine learning course on Coursera explains how RBM works and some other stuff. So for those who are intererested, are are the slides + videos which are relevant.

(Actually, video 4 is broken on Coursera, so I'll try to upload it later when/if it becomes available).

rbm.pdf

12 - 3 - Restricted Boltzmann Machines [11 min].mp4

Samuel St-Jean

unread,

Nov 8, 2012, 1:52:58 PM11/8/12

to ift-72...@googlegroups.com

Video 4 is still broken, but here is a ripped off and re-encoded version for the time being. And as a bonus a small pdf explaining the CD, with a good analogy as CD vs traditionnal gradient descent in my opinion.

NotesOnCD.pdf

12 - 4 - An example of RBM learning [7 mins].mp4

Reply all

Reply to author

Forward

0 new messages