On Tue, Aug 4, 2015, at 16:43, Youssef Kashef wrote:
> Hello Evan,
>
> I'm trying to figure out why my trained fcn has a very large loss and
> predicts all pixels as background.
> Does the initialization through bilinear interpolation initialize all
> parameters in the Deconvolution layer to non-zero values? When viewing
> the
> Deconv. parameters I see blocks of parameters that are either all-zeros
> or
> all-non-zeros. Is this expected?
As far as I understand, this is expected. Let's say that your last layer
before deconvolution has two channels (or feature maps), i.e. it is
32x32x2 or something. You want to upscale the two channels separately to
become the two channels of your deconvolutional layer. You do not want
to mix the two channels, which is why half the filter parameters will be
zero.
--
Bjørn Rustad
bj...@rustad.me