example dies

11 views
Skip to first unread message

hieuhoang

unread,
Jun 3, 2011, 7:30:23 PM6/3/11
to cdec users
hi chris et al

trying to run the downloaded example & it dies with the following
message
cdec v1.0 (c) 2009-2011 by Chris Dyer
Configuration file: cdec-mt03.ini
Reading weights from weights.tuned
Loaded 8 feature weights
feature: KLanguageModel (with config parameters 'en.
3gram.pruned.klm')
Abort trap

i suspect it's ken & his dastardly lm being slightly changed since
you've binarized it

Chris Dyer

unread,
Jun 3, 2011, 7:52:57 PM6/3/11
to cdec-...@googlegroups.com, Kenneth Heafield
thanks for pointing this out. i recompiled the LM and have posted a
new version of the file which corrected the problem.

Sascha Fendrich

unread,
Jun 7, 2011, 6:19:26 AM6/7/11
to cdec users
Hi,

thank you very much for updating the LM. I noticed that there are two
LMs shipped now. The .ini-file is pointing to the wrong LM, which is
still broken. This can be fixed by updating the KLanguageModel feature
in cdec-mt03.ini to

feature_function=KLanguageModel en.3gram.pruned.lm.gz

best
sascha

On Jun 4, 1:52 am, Chris Dyer <cd...@cs.cmu.edu> wrote:
> thanks for pointing this out. i recompiled the LM and have posted a
> new version of the file which corrected the problem.
>

Hieu Hoang

unread,
Jun 11, 2011, 4:51:56 AM6/11/11
to cdec-...@googlegroups.com
i think kenlm can load normal arpa formatted files
en.3gram.pruned.lm.gz
and its own binary format, which is faster/uses less memory
en.3gram.pruned.klm

i've rebinarized it to work with the current cdec
http://www.statmt.org/~s0565741/en.3gram.pruned.klm.gz


On 07/06/2011 17:19, Sascha Fendrich wrote:
> Hi,
>
> thank you very much for updating the LM. I noticed that there are two
> LMs shipped now. The .ini-file is pointing to the wrong LM, which is
> still broken. This can be fixed by updating the KLanguageModel feature
> in cdec-mt03.ini to
>
> feature_function=KLanguageModel en.3gram.pruned.lm.gz
>
> best
> sascha
>
> On Jun 4, 1:52 am, Chris Dyer<cd...@cs.cmu.edu> wrote:
>> thanks for pointing this out. i recompiled the LM and have posted a
>> new version of the file which corrected the problem.
>>
>> On Fri, Jun 3, 2011 at 7:30 PM, hieuhoang<hieuho...@gmail.com> wrote:
>>> hi chris et al

>>> trying to run the downloaded example& it dies with the following


>>> message
>>> cdec v1.0 (c) 2009-2011 by Chris Dyer
>>> Configuration file: cdec-mt03.ini
>>> Reading weights from weights.tuned
>>> Loaded 8 feature weights
>>> feature: KLanguageModel (with config parameters 'en.
>>> 3gram.pruned.klm')
>>> Abort trap

>>> i suspect it's ken& his dastardly lm being slightly changed since
>>> you've binarized it

Reply all
Reply to author
Forward
0 new messages