Problem training initialized nnet with Karel's recipe

50 views
Skip to first unread message

Yulu ZHANG

unread,
Jul 2, 2017, 6:54:06 AM7/2/17
to kaldi-help
Hi,
I have a problem training an initialized nnet with Karel's recipe,but I get stuck at train_scheduler.sh, here's my log:

train_nnet.log
# NN-INITIALIZATION
# using pre-initialized network 'exp/dbn_lstm_dnn/nnet_dbn_lstm_dnn.init'

# RUNNING THE NN-TRAINING SCHEDULER
steps/nnet/train_scheduler.sh --momentum 0.9 --halving-factor 0.5 --feature-transform exp/dbn_lstm_dnn/final.feature_transform --learn-rate 0.00001 exp/dbn_lstm_dnn/nnet_dbn_lstm_dnn.init ark:copy-feats scp:exp/dbn_lstm_dnn/train.scp ark:- | apply-cmvn --norm-means=true --norm-vars=true --utt2spk=ark:data/fbank_pitch/train/utt2spk scp:data/fbank_pitch/train/cmvn.scp ark:- ark:- | add-deltas --delta-order=2 ark:- ark:- | ark:copy-feats scp:exp/dbn_lstm_dnn/cv.scp ark:- | apply-cmvn --norm-means=true --norm-vars=true --utt2spk=ark:data/fbank_pitch/dev/utt2spk scp:data/fbank_pitch/dev/cmvn.scp ark:- ark:- | add-deltas --delta-order=2 ark:- ark:- | ark:ali-to-pdf exp/tri4b_ali/final.mdl "ark:gunzip -c exp/tri4b_ali/ali.*.gz |" ark:- | ali-to-post ark:- ark:- | ark:ali-to-pdf exp/tri4b_ali/final.mdl "ark:gunzip -c exp/tri4b_ali_cv/ali.*.gz |" ark:- | ali-to-post ark:- ark:- | exp/dbn_lstm_dnn

This part seems to be correct ,but when it goes to iter00.initial.log, I got this
nnet-train-frmshuff --cross-validate=true --randomize=false --verbose=1 --minibatch-size=256 --randomizer-size=32768 --randomizer-seed=777 --feature-transform=exp/dbn_lstm_dnn/final.feature_transform 'ark:copy-feats scp:exp/dbn_lstm_dnn/cv.scp ark:- | apply-cmvn --norm-means=true --norm-vars=true --utt2spk=ark:data/fbank_pitch/dev/utt2spk scp:data/fbank_pitch/dev/cmvn.scp ark:- ark:- | add-deltas --delta-order=2 ark:- ark:- |' 'ark:ali-to-pdf exp/tri4b_ali/final.mdl "ark:gunzip -c exp/tri4b_ali_cv/ali.*.gz |" ark:- | ali-to-post ark:- ark:- |' exp/dbn_lstm_dnn/nnet/nnet_iter19_learnrate9.76565e-08_tr1.5232_cv1.9353

Apparently,this nnet_iter19_learnrate9.76565e-08_tr1.5232_cv1.93.nnet doesn't exist and I have no idea where it comes from, it suppose to be the initialized nnet. Can anyone help me? Thanks a lot.

Daniel Povey

unread,
Jul 2, 2017, 2:55:29 PM7/2/17
to kaldi-help, Karel Vesely
Karel, maybe you can help?
> --
> Go to http://kaldi-asr.org/forums.html find out how to join
> ---
> You received this message because you are subscribed to the Google Groups
> "kaldi-help" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to kaldi-help+...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
Reply all
Reply to author
Forward
0 new messages