Multi-transformer

[Tzahi Sofer]

Hi,

I want to user the multi-transformer model type for automatic post editing task. I found little documentation on how to use this type of model (validation set format etc.), and I also wonder if and how to use marian-server for translation with the trained model.

Would appriciate any feedback on this.

Thanks,

Tzahi

[Roman Grundkiewicz]

We have a toy example for training a dual-source transformer model in our regression tests, which can show you options required for running it:

- https://github.com/marian-nmt/marian-regression-tests/blob/master/tests/training/models/multi-source/test_multi-transformer.sh

marian-server does not support decoding with dual-source models yet, but there is an active pull request for this:

- https://github.com/marian-nmt/marian-dev/pull/649

Some outdated tutorials for training APE models are available at our website, though likely not so useful anymore:

- https://marian-nmt.github.io/examples/postedit/

- https://marian-nmt.github.io/examples/exploration/

[Tzahi Sofer]

Thank you very much for the prompt response!

Can I conclude that there is no support in the marian-decoder as well? or am I wrong and still can make inference with the multi-transformer using the decoder?

[Roman Grundkiewicz]

marian-decoder does support multi-source models. You can use them with marian-server too if you pull the code from that pull request.

[Tzahi Sofer]

Tnx!