error in G.fst

vinithaba...@gmail.com

unread,

Aug 14, 2018, 5:58:52 AM8/14/18

to kaldi-help

Hi all,
i am getting this error while running my run.sh file.
ERROR: data/lang_nosp_test_tgsmall/G.fst is empty

Thanks in advance,
vinitha B

Daniel Povey

unread,

Aug 14, 2018, 1:11:27 PM8/14/18

to kaldi-help

Likely an earlier error happened which you didn't notice. Or maybe
there is a mistake in your run.sh, e.g. you are referring to a 'lang'
directory you never created. If you do
set -e
at the top of the run.sh
you can make sure it exits on the first error.

> --
> Go to http://kaldi-asr.org/forums.html find out how to join
> ---
> You received this message because you are subscribed to the Google Groups
> "kaldi-help" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to kaldi-help+...@googlegroups.com.
> To post to this group, send email to kaldi...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/kaldi-help/dd14a1c0-bd3f-4631-9183-a38d9339ae7e%40googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.

vinitha baskaran

unread,

Aug 16, 2018, 12:36:25 AM8/16/18

to kaldi...@googlegroups.com

yes you are right,its my mistake i have not noticed the earlier error.The error which occured earlier is,
LOG (arpa2fst[5.4.140~1-1ab3d]:RemoveRedundantStates():arpa-lm-compiler.cc:359) Reduced num-states from 41784 to 0
ERROR (arpa2fst[5.4.140~1-1ab3d]:Check():arpa-lm-compiler.cc:365) Arpa file did not contain the beginning-of-sentence symbol <s>.

Help me to sort out it,

thanks in advance

Regards

vinitha

On 14 August 2018 at 22:41, Daniel Povey <dpo...@gmail.com> wrote:

Likely an earlier error happened which you didn't notice. Or maybe
there is a mistake in your run.sh, e.g. you are referring to a 'lang'
directory you never created. If you do
set -e
at the top of the run.sh
you can make sure it exits on the first error.

On Tue, Aug 14, 2018 at 2:58 AM, <vinithaba...@gmail.com> wrote:
> Hi all,
> i am getting this error while running my run.sh file.
> ERROR: data/lang_nosp_test_tgsmall/G.fst is empty
>
>
>
> Thanks in advance,
> vinitha B
>
> --
> Go to http://kaldi-asr.org/forums.html find out how to join
> ---
> You received this message because you are subscribed to the Google Groups
> "kaldi-help" group.
> To unsubscribe from this group and stop receiving emails from it, send an

> email to kaldi-help+unsubscribe@googlegroups.com.

> To post to this group, send email to kaldi...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/kaldi-help/dd14a1c0-bd3f-4631-9183-a38d9339ae7e%40googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.

--
Go to http://kaldi-asr.org/forums.html find out how to join
---
You received this message because you are subscribed to the Google Groups "kaldi-help" group.

To unsubscribe from this group and stop receiving emails from it, send an email to kaldi-help+unsubscribe@googlegroups.com.

To post to this group, send email to kaldi...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/kaldi-help/CAEWAuyTMhurvnpvo5mPEWi%2BYt9P_z4bPSFDwqfqJVw-E8E9nEA%40mail.gmail.com.

Shin XXX

unread,

Aug 16, 2018, 12:51:57 AM8/16/18

to kaldi...@googlegroups.com

the ERROR info is clean, "Arpa file did not contain <s>". Maybe the text you used to train the arpa lm didn't have <s> and </s> tags. You should add them to the beginning and end of a sentence respectively.

Shin

> email to kaldi-help+...@googlegroups.com.

> To post to this group, send email to kaldi...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/kaldi-help/dd14a1c0-bd3f-4631-9183-a38d9339ae7e%40googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.

--
Go to http://kaldi-asr.org/forums.html find out how to join
---
You received this message because you are subscribed to the Google Groups "kaldi-help" group.

To unsubscribe from this group and stop receiving emails from it, send an email to kaldi-help+...@googlegroups.com.

To post to this group, send email to kaldi...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/kaldi-help/CAEWAuyTMhurvnpvo5mPEWi%2BYt9P_z4bPSFDwqfqJVw-E8E9nEA%40mail.gmail.com.

For more options, visit https://groups.google.com/d/optout.

--
Go to http://kaldi-asr.org/forums.html find out how to join
---
You received this message because you are subscribed to the Google Groups "kaldi-help" group.

To unsubscribe from this group and stop receiving emails from it, send an email to kaldi-help+...@googlegroups.com.

To post to this group, send email to kaldi...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/kaldi-help/CAAOB9m72mV5Gm8Pe3ZY5U%3DTpS3_DHSbjyTsuL33Mxw52x2iAAg%40mail.gmail.com.

vinithaba...@gmail.com

unread,

Aug 16, 2018, 1:23:06 AM8/16/18

to kaldi-help

<s> and </s> is added already.

regards,
vinitha

vinitha baskaran

unread,

Aug 16, 2018, 1:14:27 PM8/16/18

to kaldi...@googlegroups.com

Any guess what would be the reason for my above error?

Regards vinitha

--

Go to http://kaldi-asr.org/forums.html find out how to join
---
You received this message because you are subscribed to the Google Groups "kaldi-help" group.
To unsubscribe from this group and stop receiving emails from it, send an email to kaldi-help+...@googlegroups.com.
To post to this group, send email to kaldi...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/kaldi-help/479d14c0-4207-4794-94e3-cf1b238dc5c3%40googlegroups.com.

Daniel Povey

unread,

Aug 16, 2018, 1:21:08 PM8/16/18

to kaldi-help

Likely it has to do with how you built the language model. You
didn't specify what tool you were using; different tools have
different requirements.

Dan

> https://groups.google.com/d/msgid/kaldi-help/CAAOB9m4YXnawuOEZRhpjnLB91V9WyZ5ZQiVvPXf2R2tTL3kL7A%40mail.gmail.com.

vinitha baskaran

unread,

Aug 16, 2018, 1:57:43 PM8/16/18

to kaldi...@googlegroups.com

I am using SRILM tool kit to develop my LM

Regards

Vinitha

To view this discussion on the web visit https://groups.google.com/d/msgid/kaldi-help/CAEWAuyQ-DKgveM3dV2GJe_xk8%3DowMKzD%3Dht%3DnCtdXbSqeTC82g%40mail.gmail.com.

Daniel Povey

unread,

Aug 16, 2018, 2:22:38 PM8/16/18

to kaldi-help

With SRILM you don't have to add those tags to the beginning and end
of each sentence, but if you are specifying the vocabulary to SRILM it
looks like you are supposed to add `<s>` and `</s>` to it. Look at
egs/wsj/s5/local/wsj_train_lms.sh.. the top of that file uses kaldi_lm
but if you search below for 'srilm', there are example commands for
using SRILM, after an "exit 0".

The ARPA file should definitely have `<s>` in it; you can check that.

On Thu, Aug 16, 2018 at 10:57 AM, vinitha baskaran

> https://groups.google.com/d/msgid/kaldi-help/CAAOB9m7Zew8Cx935HOULswkj1f_O%3D_x-67vrx%2BL5wwDoVvZ6uw%40mail.gmail.com.

vinitha baskaran

unread,

Aug 17, 2018, 12:57:25 AM8/17/18

to kaldi...@googlegroups.com

I am sorry.The tool used to create lm_tgsmall.arpa is CMU STATISTICAL language modelling tool kit.And the text file which is given as input to create lm_tgsmall.arpa is labed with <s> </s> for every line.

regards,

vinitha.

>> >> email to kaldi-help+unsubscribe@googlegroups.com.

>> >> To post to this group, send email to kaldi...@googlegroups.com.
>> >> To view this discussion on the web visit
>> >>
>> >> https://groups.google.com/d/msgid/kaldi-help/479d14c0-4207-4794-94e3-cf1b238dc5c3%40googlegroups.com.
>> >> For more options, visit https://groups.google.com/d/optout.
>> >
>> > --
>> > Go to http://kaldi-asr.org/forums.html find out how to join
>> > ---
>> > You received this message because you are subscribed to the Google
>> > Groups
>> > "kaldi-help" group.
>> > To unsubscribe from this group and stop receiving emails from it, send
>> > an

>> > email to kaldi-help+unsubscribe@googlegroups.com.

>> > To post to this group, send email to kaldi...@googlegroups.com.
>> > To view this discussion on the web visit
>> >
>> > https://groups.google.com/d/msgid/kaldi-help/CAAOB9m4YXnawuOEZRhpjnLB91V9WyZ5ZQiVvPXf2R2tTL3kL7A%40mail.gmail.com.
>> >
>> > For more options, visit https://groups.google.com/d/optout.
>>
>> --
>> Go to http://kaldi-asr.org/forums.html find out how to join
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "kaldi-help" group.
>> To unsubscribe from this group and stop receiving emails from it, send an

>> email to kaldi-help+unsubscribe@googlegroups.com.

>> To post to this group, send email to kaldi...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/kaldi-help/CAEWAuyQ-DKgveM3dV2GJe_xk8%3DowMKzD%3Dht%3DnCtdXbSqeTC82g%40mail.gmail.com.
>> For more options, visit https://groups.google.com/d/optout.
>
> --
> Go to http://kaldi-asr.org/forums.html find out how to join
> ---
> You received this message because you are subscribed to the Google Groups
> "kaldi-help" group.
> To unsubscribe from this group and stop receiving emails from it, send an

> email to kaldi-help+unsubscribe@googlegroups.com.

> To post to this group, send email to kaldi...@googlegroups.com.
> To view this discussion on the web visit

> https://groups.google.com/d/msgid/kaldi-help/CAAOB9m7Zew8Cx935HOULswkj1f_O%3D_x-67vrx%2BL5wwDoVvZ6uw%40mail.gmail.com.

>
> For more options, visit https://groups.google.com/d/optout.

--
Go to http://kaldi-asr.org/forums.html find out how to join
---
You received this message because you are subscribed to the Google Groups "kaldi-help" group.

To unsubscribe from this group and stop receiving emails from it, send an email to kaldi-help+unsubscribe@googlegroups.com.

To post to this group, send email to kaldi...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/kaldi-help/CAEWAuyQd0mU5AEi1QDqHO2CKgRUu4Z58RN7OoZyOwnpb6NUJBg%40mail.gmail.com.

Daniel Povey

unread,

Aug 17, 2018, 2:15:52 PM8/17/18

to kaldi-help

I'm not familar with that toolkit so I can't help much. The LM should
have `<s>` in it, for sure.

On Thu, Aug 16, 2018 at 9:57 PM, vinitha baskaran

>> >> >> email to kaldi-help+...@googlegroups.com.

>> >> >> To post to this group, send email to kaldi...@googlegroups.com.
>> >> >> To view this discussion on the web visit
>> >> >>
>> >> >>
>> >> >> https://groups.google.com/d/msgid/kaldi-help/479d14c0-4207-4794-94e3-cf1b238dc5c3%40googlegroups.com.
>> >> >> For more options, visit https://groups.google.com/d/optout.
>> >> >
>> >> > --
>> >> > Go to http://kaldi-asr.org/forums.html find out how to join
>> >> > ---
>> >> > You received this message because you are subscribed to the Google
>> >> > Groups
>> >> > "kaldi-help" group.
>> >> > To unsubscribe from this group and stop receiving emails from it,
>> >> > send
>> >> > an

>> >> > email to kaldi-help+...@googlegroups.com.

>> >> > To post to this group, send email to kaldi...@googlegroups.com.
>> >> > To view this discussion on the web visit
>> >> >
>> >> >
>> >> > https://groups.google.com/d/msgid/kaldi-help/CAAOB9m4YXnawuOEZRhpjnLB91V9WyZ5ZQiVvPXf2R2tTL3kL7A%40mail.gmail.com.
>> >> >
>> >> > For more options, visit https://groups.google.com/d/optout.
>> >>
>> >> --
>> >> Go to http://kaldi-asr.org/forums.html find out how to join
>> >> ---
>> >> You received this message because you are subscribed to the Google
>> >> Groups
>> >> "kaldi-help" group.
>> >> To unsubscribe from this group and stop receiving emails from it, send
>> >> an

>> >> email to kaldi-help+...@googlegroups.com.

>> >> To post to this group, send email to kaldi...@googlegroups.com.
>> >> To view this discussion on the web visit
>> >>
>> >> https://groups.google.com/d/msgid/kaldi-help/CAEWAuyQ-DKgveM3dV2GJe_xk8%3DowMKzD%3Dht%3DnCtdXbSqeTC82g%40mail.gmail.com.
>> >> For more options, visit https://groups.google.com/d/optout.
>> >
>> > --
>> > Go to http://kaldi-asr.org/forums.html find out how to join
>> > ---
>> > You received this message because you are subscribed to the Google
>> > Groups
>> > "kaldi-help" group.
>> > To unsubscribe from this group and stop receiving emails from it, send
>> > an

>> > email to kaldi-help+...@googlegroups.com.

>> > To post to this group, send email to kaldi...@googlegroups.com.
>> > To view this discussion on the web visit
>> >
>> > https://groups.google.com/d/msgid/kaldi-help/CAAOB9m7Zew8Cx935HOULswkj1f_O%3D_x-67vrx%2BL5wwDoVvZ6uw%40mail.gmail.com.
>> >
>> > For more options, visit https://groups.google.com/d/optout.
>>
>> --
>> Go to http://kaldi-asr.org/forums.html find out how to join
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "kaldi-help" group.
>> To unsubscribe from this group and stop receiving emails from it, send an

>> email to kaldi-help+...@googlegroups.com.

>> To post to this group, send email to kaldi...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/kaldi-help/CAEWAuyQd0mU5AEi1QDqHO2CKgRUu4Z58RN7OoZyOwnpb6NUJBg%40mail.gmail.com.
>> For more options, visit https://groups.google.com/d/optout.
>
>

> --
> Go to http://kaldi-asr.org/forums.html find out how to join
> ---
> You received this message because you are subscribed to the Google Groups
> "kaldi-help" group.
> To unsubscribe from this group and stop receiving emails from it, send an

> email to kaldi-help+...@googlegroups.com.

> To post to this group, send email to kaldi...@googlegroups.com.
> To view this discussion on the web visit

> https://groups.google.com/d/msgid/kaldi-help/CAAOB9m6wCPJpsDsS1XUnjv2vVmwDjiOL6vqkzhtLUM0fKz6iOw%40mail.gmail.com.

vinitha baskaran

unread,

Aug 17, 2018, 3:51:20 PM8/17/18

to kaldi...@googlegroups.com

Hi Daniel,

My error got resolved.thank you

Regards,

Vinitha

To view this discussion on the web visit https://groups.google.com/d/msgid/kaldi-help/CAEWAuyQgCT0m1PBihGGOi5ZjzUtSHQVh9noVLfHBwuzx%2BD4DWQ%40mail.gmail.com.

Kshitiz Yadav

unread,

Jan 11, 2021, 1:29:34 PM1/11/21

to kaldi-help

@vinitha,

I am having the same issue. can you help with the solution .

Thanks in advance.

Reply all

Reply to author

Forward