Potential error in nnet online decoding fisher english example / problem with pipelines

123 views
Skip to first unread message

odo...@gmail.com

unread,
Jun 29, 2016, 7:19:26 AM6/29/16
to kaldi-help
Hi, 
Just a note that on
http://kaldi-asr.org/doc2/online_decoding.html
smbr_epoch2.mdl should probably be final.mdl as that was the only mdl file present in the nnet_a_gpu_online archive.



On a side note, when I try to run the example as is written in the site, I have a problem with the pipes -
WARNING (online2-wav-nnet2-latgen-faster:Open():kaldi-io.cc:455) Failed opening pipe for reading, command is: echo utterance-id1 utterance-id1, errno is Cannot allocate memory
WARNING (online2-wav-nnet2-latgen-faster:Open():util/kaldi-table-inl.h:525) Failed to open stream 'echo utterance-id1 utterance-id1|'
ERROR (online2-wav-nnet2-latgen-faster:SequentialTableReader():util/kaldi-table-inl.h:888) Error constructing TableReader: rspecifier is ark:echo utterance-id1 utterance-id1|

I guess it's a problem with popen - any idea of why this might happen?
It's the first time I've seen this while working with Kaldi (I've managed to run a few of the other testsets without problems)

For the moment, to bypass this I directed the lines that needed pipelines to files utt2spk and wav.scp and it works.
"ark:utt2spk" "scp:wav.scp" ark:/dev/null
Similar problem when I try to output the files and pass them directly through lattice-best-path int2sym.pl by pipes.

Thanks!

Daniel Povey

unread,
Jun 29, 2016, 3:54:50 PM6/29/16
to kaldi-help
The doc2/ directory is outdated. I've removed it, and fixed the
problem in the doc/ directory.
You are having an issue with virtual memory availability. Even though
'echo' takes very little memory, when you open a piped command linux
does this by first calling 'fork', which duplicates the calling
process, and then 'exec' from one of the copies of the calling
process. The 'fork' call needs to allocate and amount of virtual
memory equal to the size of the calling process.
You may be able to fix this by increasing the overcommit_ratio (search
for how to do it), or by increasing the amount of swap space available
(which is more tricky to do). Or get a bigger machine.

Dan
> --
> You received this message because you are subscribed to the Google Groups
> "kaldi-help" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to kaldi-help+...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
Reply all
Reply to author
Forward
0 new messages