Using TIMIT recipe to prepare data

[Kento Inatomi]

Hello, I'm still new to Kaldi, so apologies if this question is trivial.

I am currently trying to use the recipe (egs/timit/s5/run.sh) to prepare my TIMIT corpus. However, when I try to run the shell script I get the following log:

============================================================================

                Data & Lexicon & Language Preparation

============================================================================

wav-to-duration --read-entire-file=true scp:train_wav.scp ark,t:train_dur.ark

LOG (wav-to-duration[5.5.453~3-6cdc49]:main():wav-to-duration.cc:92) Printed duration for 3696 audio files.

LOG (wav-to-duration[5.5.453~3-6cdc49]:main():wav-to-duration.cc:94) Mean duration was 3.06336, min and max durations were 0.91525, 7.78881

wav-to-duration --read-entire-file=true scp:dev_wav.scp ark,t:dev_dur.ark

LOG (wav-to-duration[5.5.453~3-6cdc49]:main():wav-to-duration.cc:92) Printed duration for 400 audio files.

LOG (wav-to-duration[5.5.453~3-6cdc49]:main():wav-to-duration.cc:94) Mean duration was 3.08212, min and max durations were 1.09444, 7.43681

wav-to-duration --read-entire-file=true scp:test_wav.scp ark,t:test_dur.ark

LOG (wav-to-duration[5.5.453~3-6cdc49]:main():wav-to-duration.cc:92) Printed duration for 192 audio files.

LOG (wav-to-duration[5.5.453~3-6cdc49]:main():wav-to-duration.cc:94) Mean duration was 3.03646, min and max durations were 1.30562, 6.21444

Data preparation succeeded

LOGFILE:/dev/null

Output file data/local/lm_tmp/lm_phone_bg.ilm.gz already exists! either remove or rename it.

inpfile: data/local/lm_tmp/lm_phone_bg.ilm.gz

outfile: /dev/stdout

loading up to the LM level 1000 (if any)

dub: 10000000

OOV code is 50

OOV code is 50

Saving in txt format to /dev/stdout

Dictionary & language model preparation succeeded

utils/prepare_lang.sh --sil-prob 0.0 --position-dependent-phones false --num-sil-states 3 data/local/dict sil data/local/lang_tmp data/lang

Checking data/local/dict/silence_phones.txt ...

--> reading data/local/dict/silence_phones.txt

--> text seems to be UTF-8 or ASCII, checking whitespaces

--> text contains only allowed whitespaces

--> data/local/dict/silence_phones.txt is OK

Checking data/local/dict/optional_silence.txt ...

--> reading data/local/dict/optional_silence.txt

--> text seems to be UTF-8 or ASCII, checking whitespaces

--> text contains only allowed whitespaces

--> data/local/dict/optional_silence.txt is OK

Checking data/local/dict/nonsilence_phones.txt ...

--> reading data/local/dict/nonsilence_phones.txt

--> text seems to be UTF-8 or ASCII, checking whitespaces

--> text contains only allowed whitespaces

--> data/local/dict/nonsilence_phones.txt is OK

Checking disjoint: silence_phones.txt, nonsilence_phones.txt

--> disjoint property is OK.

Checking data/local/dict/lexicon.txt

--> reading data/local/dict/lexicon.txt

--> text seems to be UTF-8 or ASCII, checking whitespaces

--> text contains only allowed whitespaces

--> data/local/dict/lexicon.txt is OK

Checking data/local/dict/lexiconp.txt

--> reading data/local/dict/lexiconp.txt

--> text seems to be UTF-8 or ASCII, checking whitespaces

--> text contains only allowed whitespaces

--> data/local/dict/lexiconp.txt is OK

Checking lexicon pair data/local/dict/lexicon.txt and data/local/dict/lexiconp.txt

--> lexicon pair data/local/dict/lexicon.txt and data/local/dict/lexiconp.txt match

Checking data/local/dict/extra_questions.txt ...

--> reading data/local/dict/extra_questions.txt

--> text seems to be UTF-8 or ASCII, checking whitespaces

--> text contains only allowed whitespaces

--> data/local/dict/extra_questions.txt is OK

--> SUCCESS [validating dictionary directory data/local/dict]

fstaddselfloops data/lang/phones/wdisambig_phones.int data/lang/phones/wdisambig_words.int

prepare_lang.sh: validating output directory

utils/validate_lang.pl data/lang

Checking existence of separator file

separator file data/lang/subword_separator.txt is empty or does not exist, deal in word case.

Checking data/lang/phones.txt ...

--> text seems to be UTF-8 or ASCII, checking whitespaces

--> text contains only allowed whitespaces

--> data/lang/phones.txt is OK

Checking words.txt: #0 ...

--> text seems to be UTF-8 or ASCII, checking whitespaces

--> text contains only allowed whitespaces

--> data/lang/words.txt is OK

Checking disjoint: silence.txt, nonsilence.txt, disambig.txt ...

--> silence.txt and nonsilence.txt are disjoint

--> silence.txt and disambig.txt are disjoint

--> disambig.txt and nonsilence.txt are disjoint

--> disjoint property is OK

Checking sumation: silence.txt, nonsilence.txt, disambig.txt ...

--> found no unexplainable phones in phones.txt

Checking data/lang/phones/context_indep.{txt, int, csl} ...

--> text seems to be UTF-8 or ASCII, checking whitespaces

--> text contains only allowed whitespaces

--> 1 entry/entries in data/lang/phones/context_indep.txt

--> data/lang/phones/context_indep.int corresponds to data/lang/phones/context_indep.txt

--> data/lang/phones/context_indep.csl corresponds to data/lang/phones/context_indep.txt

--> data/lang/phones/context_indep.{txt, int, csl} are OK

Checking data/lang/phones/nonsilence.{txt, int, csl} ...

--> text seems to be UTF-8 or ASCII, checking whitespaces

--> text contains only allowed whitespaces

--> 47 entry/entries in data/lang/phones/nonsilence.txt

--> data/lang/phones/nonsilence.int corresponds to data/lang/phones/nonsilence.txt

--> data/lang/phones/nonsilence.csl corresponds to data/lang/phones/nonsilence.txt

--> data/lang/phones/nonsilence.{txt, int, csl} are OK

Checking data/lang/phones/silence.{txt, int, csl} ...

--> text seems to be UTF-8 or ASCII, checking whitespaces

--> text contains only allowed whitespaces

--> 1 entry/entries in data/lang/phones/silence.txt

--> data/lang/phones/silence.int corresponds to data/lang/phones/silence.txt

--> data/lang/phones/silence.csl corresponds to data/lang/phones/silence.txt

--> data/lang/phones/silence.{txt, int, csl} are OK

Checking data/lang/phones/optional_silence.{txt, int, csl} ...

--> text seems to be UTF-8 or ASCII, checking whitespaces

--> text contains only allowed whitespaces

--> 1 entry/entries in data/lang/phones/optional_silence.txt

--> data/lang/phones/optional_silence.int corresponds to data/lang/phones/optional_silence.txt

--> data/lang/phones/optional_silence.csl corresponds to data/lang/phones/optional_silence.txt

--> data/lang/phones/optional_silence.{txt, int, csl} are OK

Checking data/lang/phones/disambig.{txt, int, csl} ...

--> text seems to be UTF-8 or ASCII, checking whitespaces

--> text contains only allowed whitespaces

--> 2 entry/entries in data/lang/phones/disambig.txt

--> data/lang/phones/disambig.int corresponds to data/lang/phones/disambig.txt

--> data/lang/phones/disambig.csl corresponds to data/lang/phones/disambig.txt

--> data/lang/phones/disambig.{txt, int, csl} are OK

Checking data/lang/phones/roots.{txt, int} ...

--> text seems to be UTF-8 or ASCII, checking whitespaces

--> text contains only allowed whitespaces

--> 48 entry/entries in data/lang/phones/roots.txt

--> data/lang/phones/roots.int corresponds to data/lang/phones/roots.txt

--> data/lang/phones/roots.{txt, int} are OK

Checking data/lang/phones/sets.{txt, int} ...

--> text seems to be UTF-8 or ASCII, checking whitespaces

--> text contains only allowed whitespaces

--> 48 entry/entries in data/lang/phones/sets.txt

--> data/lang/phones/sets.int corresponds to data/lang/phones/sets.txt

--> data/lang/phones/sets.{txt, int} are OK

Checking data/lang/phones/extra_questions.{txt, int} ...

--> text seems to be UTF-8 or ASCII, checking whitespaces

--> text contains only allowed whitespaces

--> 2 entry/entries in data/lang/phones/extra_questions.txt

--> data/lang/phones/extra_questions.int corresponds to data/lang/phones/extra_questions.txt

--> data/lang/phones/extra_questions.{txt, int} are OK

Checking optional_silence.txt ...

--> reading data/lang/phones/optional_silence.txt

--> data/lang/phones/optional_silence.txt is OK

Checking disambiguation symbols: #0 and #1

--> data/lang/phones/disambig.txt has "#0" and "#1"

--> data/lang/phones/disambig.txt is OK

Checking topo ...

Checking word-level disambiguation symbols...

--> data/lang/phones/wdisambig.txt exists (newer prepare_lang.sh)

Checking data/lang/oov.{txt, int} ...

--> text seems to be UTF-8 or ASCII, checking whitespaces

--> text contains only allowed whitespaces

--> 1 entry/entries in data/lang/oov.txt

--> data/lang/oov.int corresponds to data/lang/oov.txt

--> data/lang/oov.{txt, int} are OK

--> data/lang/L.fst is olabel sorted

--> data/lang/L_disambig.fst is olabel sorted

--> SUCCESS [validating lang directory data/lang]

Preparing train, dev and test data

utils/validate_data_dir.sh: Error: in data/train, utterance lists extracted from utt2spk and text

utils/validate_data_dir.sh: differ, partial diff is:

--- /tmp/kaldi.vkMb/utts 2019-09-26 18:45:07.000000000 +0900

+++ /tmp/kaldi.vkMb/utts.txt 2019-09-26 18:45:07.000000000 +0900

@@ -1,3696 +1,3696 @@

-/Users/inthetommi/timit/TIMIT/TRAIN/DR1/FCJF0/SI1027.WAV

-/Users/inthetommi/timit/TIMIT/TRAIN/DR1/FCJF0/SI1657.WAV

-/Users/inthetommi/timit/TIMIT/TRAIN/DR1/FCJF0/SI648.WAV

...

+/Users/inthetommi/timit/TIMIT/TRAIN/DR8/MTCS0/SI712.PHN

+/Users/inthetommi/timit/TIMIT/TRAIN/DR8/MTCS0/SX172.PHN

+/Users/inthetommi/timit/TIMIT/TRAIN/DR8/MTCS0/SX262.PHN

+/Users/inthetommi/timit/TIMIT/TRAIN/DR8/MTCS0/SX352.PHN

+/Users/inthetommi/timit/TIMIT/TRAIN/DR8/MTCS0/SX442.PHN

+/Users/inthetommi/timit/TIMIT/TRAIN/DR8/MTCS0/SX82.PHN

[Lengths are /tmp/kaldi.vkMb/utts=    3696 versus /tmp/kaldi.vkMb/utts.txt=    3696]

I've written the path to the corpus correctly, and I'm quite positive I've installed Kaldi as per the instructions. I can kind of understand that it stops at validate_data_dir.sh, and I think utt2spk and text are not formatted correctly as per Kaldi's tutorial on data preparation.

Does Kaldi provide utt2spk and text files when run.sh is executed? It looks like so, and if so, would I have to bypass file generation and write the files by hand?

I've also seen people say the TIMIT corpus is out of date and not suited for Kaldi. Why is this the case? What are the best alternatives that have phoneme transcriptions and non-native data?

[Daniel Povey]

I'm pretty sure the utterance id's should not be pathnames, they
should not have "/"'s in them.
But I have a policy of never touching TIMIT so I can't say for sure.

There are some sed commands used in data-prep and I suspect their
patterns may not be matching due to sed version differences. Just a
guess.
local/timit_data_prep.sh.

> --
> Go to http://kaldi-asr.org/forums.html find out how to join
> ---
> You received this message because you are subscribed to the Google Groups "kaldi-help" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to kaldi-help+...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/kaldi-help/33f75341-b9c2-4129-ae00-27d81068c044%40googlegroups.com.