training steps in Nematus

[sas cam]

Dear All,

Could anybody please help me to get the steps required to train an NMT model using Nematus.

Expecting a help

Sascam

[Rico Sennrich]

Hello Sascam,

my recommendation is to start with the training scripts we prepared for WMT17: https://github.com/EdinburghNLP/wmt17-transformer-scripts

you will find scripts for preprocessing the data, training the model, and then evaluating it. You could directly adapt the scripts to your data, or just use them to get an idea about steps you need to take, and reasonable hyperparameter settings.

best wishes,

Rico

--
You received this message because you are subscribed to the Google Groups "Nematus Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email to nematus-suppo...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/nematus-support/ad34ed7e-8f8a-4762-8211-c9bf3df7f378n%40googlegroups.com.

[sas cam]

Dear Dr. Rico,

Thanks for the suggestion. I have gone through the WMT17 link. What I have understood is we have to run the scripts.

I was looking for precise training step commands (like moses training step commands are available for SMT ).

Could you please provide the list of step commands to train a new NMT model ?

Looking forward to hear from you

Thanking You

Sascam

To view this discussion on the web visit https://groups.google.com/d/msgid/nematus-support/19ab9486-fdba-da34-b103-115281ec1810%40gmx.ch.

[WILLIAMS Philip]

Hi Sascam,

You can find a tutorial on training an RNN model using Nematus here: https://github.com/EdinburghNLP/mtm19/blob/master/labs/lab1-nematus/part2.md

If you want to train a Transformer, you should be able to adapt the training step based on the WMT17 scripts.

Best wishes,

Phil

On 6 Jan 2021, at 10:27, sas cam <sasc...@gmail.com> wrote:

This email was sent to you by someone outside the University.

You should only click on links or attachments if you are certain that the email is genuine and the content is safe.

To view this discussion on the web visit https://groups.google.com/d/msgid/nematus-support/CAHZp2OvUM04QVVdz3hbst1LbuHnRi4e4PEYRmxGWCA%2BNF6o8-g%40mail.gmail.com.

The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.

[sas cam]

Thank you Philip for the details.