Hierarchical-Phrased Base pipeline options

[Reza Lesmana]

Dear devs,

Currently, I'm working on my thesis on the topic of creating a system that is able to translate English to Bahasa Indonesia (Indonesian language).
Joshua is chosen because of the both phrase-based and hierarchical feature, since the translation engine system in the backend will be
using hierarchical phrased-based decoding technique.

But, I don't see in the documentation how to use both of these technique in the pipeline. Is this by default? Or, should I use some options in the pipeline?
If yes, what would those options be?

It's said in the documentation (Installation),

"You will need to install Moses if either of the following applies to you:

- You wish to build phrase-based models ....
..............................
Follow the instructions for installing Moses here, and then define the $MOSES environment variable to point to the root of the Moses installation."

So, I'm currently installing Moses to be able to build the phrase-based models. However, I'm not seeing how to enable it on the pipeline documentation.
Or did I miss it? Or is it going to build the phrase-based models after defining the $MOSES environment variable?

Thanks a lot for your help. It means so much for me. Waiting for the answers while preparing my training data. I'm sorry that I ask a lot of questions.
Hopefully, after it is finished, I can contribute the language packs at least. :)

Regards,
Reza Lesmana

[Matt Post]

If you are building hierarchical models, you only need Moses if you want to tune with MIRA (--tuner mira), which you'd want to do if you need to use thousands of features. 

Building hiero models is the default (--type hiero). You can also build SAMT grammar (--type samt). You only need Moses for building models if you do phrase-based decoder (--type phrase) or build GHKM models using Phil Williams' tool (--type ghkm --ghkm-extractor moses).

I suggest you start without Moses: just build a hierarchical model using the default values.

matt

--
You received this message because you are subscribed to the Google Groups "Joshua Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to joshua_develop...@googlegroups.com.
To post to this group, send email to joshua_d...@googlegroups.com.
Visit this group at http://groups.google.com/group/joshua_developers.
For more options, visit https://groups.google.com/d/optout.