Re: [kaldi-help] What's the difference between "relu-renorm-layer " and "relu-batchnorm-layer"?

[Daniel Povey]

It has a different form of normalization componanes instead of batchnorm, which is essentially like LayerNorm but without the mean subtraction or the trainable parameters.

On Tue, May 18, 2021 at 4:09 PM dragon stone <z7933...@gmail.com> wrote:

When I am running the script named"run_tdnn_lstm.sh" , I see relu-renorm-layer .

But I don't know what it mean.

I will appreciate if someone tell me.

--
Go to http://kaldi-asr.org/forums.html to find out how to join the kaldi-help group
---
You received this message because you are subscribed to the Google Groups "kaldi-help" group.
To unsubscribe from this group and stop receiving emails from it, send an email to kaldi-help+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/kaldi-help/22cd94d9-ae68-418f-92ba-abe907aa5b47n%40googlegroups.com.