Where does Kaldi utilize CuDNN?

[Sage Khan (Sage Khan)]

Hello. During Kaldi compilation we compile CUDA and CUDNN. 

In this thread https://groups.google.com/g/kaldi-help/c/DjLhHVEBJMI I found that CuDNN is not used  because cuDNN seems to mostly provide routines that would be useful in convolutional networks, and since we've never had great results from using convolutional networks so far in Kaldi, and the installation procedure for cuDNN requires registration and is a hassle, it hasn't made sense to use it.

Is this a 2015 thing or is this still relevant. 

I went through CUDA Matrix portion in the docs as well which shows CUDA's usage. but for CUDNN TDNN, CNN-TDNN, RNN etc does Kaldi use CuDNN? Where else it is used?

[Daniel Povey]

TDNNs are in effect 1-dimensional convolutional networks.

The reason we don't use CUDNN is that nnet3 uses a different data layout than CUDNN, it's one of those NCHW things vs. NCWH or something like that.

In any case, it's something quite deep in the design of nnet3 that would take a lot of work to change.

--
Go to http://kaldi-asr.org/forums.html to find out how to join the kaldi-help group
---
You received this message because you are subscribed to the Google Groups "kaldi-help" group.
To unsubscribe from this group and stop receiving emails from it, send an email to kaldi-help+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/kaldi-help/5f241bfe-3bc0-41a9-a0ef-037828958babn%40googlegroups.com.

[Muhammad Danyal Khan]

What about CNN-TDNN. It requires CNN which works will Cudnn I think

Get Outlook for Android

---

From: kaldi...@googlegroups.com <kaldi...@googlegroups.com> on behalf of Daniel Povey <dpo...@gmail.com>
Sent: Monday, October 17, 2022 7:44:07 AM
To: kaldi...@googlegroups.com <kaldi...@googlegroups.com>
Subject: Re: [kaldi-help] Where does Kaldi utilize CuDNN?

 

You received this message because you are subscribed to a topic in the Google Groups "kaldi-help" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/kaldi-help/fxaxY1-cfn4/unsubscribe.
To unsubscribe from this group and all its topics, send an email to kaldi-help+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/kaldi-help/CAEWAuyTemgNz9gV3-OvHViVggGFrMXMA9VXOinpo%2BwS37tJWuQ%40mail.gmail.com.

[Daniel Povey]

yes but as I mentioned, the memory layouts are incompatible and unfortunately it would be quite complex to resolve that.

To view this discussion on the web visit https://groups.google.com/d/msgid/kaldi-help/DB9PR02MB701974DC4082554A97A0C21FA6299%40DB9PR02MB7019.eurprd02.prod.outlook.com.

[class...@gmail.com]

Got it. So despite not using CuDNN die to memory layout issue, Kaldi is capable of doing NN training on GPU. 

 

Get Outlook for Android

From: kaldi...@googlegroups.com <kaldi...@googlegroups.com> on behalf of Daniel Povey <dpo...@gmail.com>
Sent: Monday, October 17, 2022 10:22:18 AM
To: kaldi...@googlegroups.com <kaldi...@googlegroups.com>
Subject: Re: [kaldi-help] Where does Kaldi utilize CuDNN?

 

yes but as I mentioned, the memory layouts are incompatible and unfortunately it would be quite complex to resolve that.

 

On Mon, Oct 17, 2022 at 10:48 AM Muhammad Danyal Khan <class...@gmail.com> wrote:

What about CNN-TDNN. It requires CNN which works will Cudnn I think

 

Get Outlook for Android

To view this discussion on the web visit https://groups.google.com/d/msgid/kaldi-help/CAEWAuyRDGbttAtDOhQ-%3DLKFOX-%3DiOxAr4hg%3Di23z2rYvFYyGCA%40mail.gmail.com.