CNN autoencoder

526 views
Skip to first unread message

Alexandre Franco

unread,
Jan 18, 2015, 9:36:16 AM1/18/15
to caffe...@googlegroups.com
Can someone give me an example how to implement an CNN autoencoder?

Thanks.

Nand Dalal

unread,
Jan 20, 2015, 9:11:19 AM1/20/15
to caffe...@googlegroups.com
I am also working on a similar problem to implement the CAE described here: http://people.idsia.ch/~ciresan/data/icann2011.pdf
I have started by looking at the example in 'examples/mnist/mnist_autoencoder.prototxt', but I am not sure how to "tie" the weights. Namely, I am not sure how to initialize the gradient between the input/middle layer to the gradient between the middle/output layer.

Youssef Kashef

unread,
Sep 10, 2015, 1:13:57 PM9/10/15
to Caffe Users
Hi Nand and Alexandre,

I was thinking of a solution on a thread with a similar question: How can I run tied weight AutoEncoder ?
The idea is to use the weight sharing feature supported by Caffe and define a new layer class that inherits from InnerProduct that transpose the weights before calling forward() and backward() of the parent class.
Have you tried this or anything similar to it?

thanks,

Youssef 
Reply all
Reply to author
Forward
0 new messages