java.lang.NullPointerException

[James Johnson]

 COMMAND   :  $JOSHUA/bin/pipeline.pl --rundir experiments/1 --readme "Baseline Hoshua En-Hi Translation System" --corpus input/train --tune input/tune --test input/test --aligner berkeley  --lmfile train.lm.hi --no-corpus-lm  --source en --target hi

 

When i opened tail -f  tune/1/joshua.log


Input 347: Parse failure (either no derivations exist or pruning is too aggressive
Input 347: Translation took 0.002 seconds
Memory used after sentence 347 is 58.9 MB
Input 348: <s> he switched on the ridiculous little box by the window and tried in vain to find music you could dance a few steps to </s>
the goal_bin does not have exactly one item
Input 348: Parse failure (either no derivations exist or pruning is too aggressive
Input 348: Translation took 0.001 seconds
Memory used after sentence 348 is 59.9 MB
Input 349: <s> karma yoga </s>
* Decoder: fatal uncaught runtime exception on sentence 349: null
java.lang.NullPointerException
        at joshua.corpus.Vocabulary.isNonterminal(Vocabulary.java:203)
        at joshua.corpus.Vocabulary.getNonterminalIndices(Vocabulary.java:216)
        at joshua.decoder.chart_parser.NonterminalMatcher.getAllNonterminalIndicesExceptForGoalAndOOV(NonterminalMatcher.java:65)
        at joshua.decoder.chart_parser.NonterminalMatcher.createNonterminalMatcher(NonterminalMatcher.java:75)
        at joshua.decoder.chart_parser.Chart.<init>(Chart.java:136)
        at joshua.decoder.DecoderThread.translate(DecoderThread.java:116)
        at joshua.decoder.Decoder$DecoderThreadRunner.run(Decoder.java:225)


Can someone help me Please .

Questions
 
   1 . What is this Parse Failure and it happens in most of the line tune/1/joshua.log ? 
  
   2 . In my tune.en file   , the content at line no 350 is <s> karma yoga </s>  and at tune.hi file  the content at line no 350 is <s> karma yoga </s>  .  But in the log file , it is showing at input 349 . Can this be the problem for Null pointer Exception ?
       

[Matt Post]

The decoder is not producing any translations; likely, your model didn't build successfully. What is the file size of

1/lm.kenlm

1/grammar.gz

As for your second question, Joshua begins numbering sentences at 0.

matt

--
You received this message because you are subscribed to the Google Groups "Joshua Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email to joshua_suppor...@googlegroups.com.
To post to this group, send email to joshua_...@googlegroups.com.
Visit this group at http://groups.google.com/group/joshua_support.
For more options, visit https://groups.google.com/d/optout.

[James Johnson]

   You have given me a suggestion https://groups.google.com/forum/#!topic/joshua_support/ukCrJihdl6k . I have created a lm file from srilm

      FileName   Size        

 
  1 .   grammar.gz  0 bytes
  2 .   lm.hi            68.7 MB

[Matt Post]

It looks like creation of the grammar failed for some reason. You'll have to investigate that step. Do you have a Hadoop cluster?

Switch to Joshua 6.

matt