WMT21 Terminologies Task Update

35 views
Skip to first unread message

Antonis Anastasopoulos

unread,
Jul 19, 2021, 10:36:26 PM7/19/21
to Workshop on Statistical Machine Translation
Deal participants,

we are waiting on the annotators for the final annotations on the test set, so we will need to postpone the date of releasing the test sets for a few days.
The days of the final submissions have also been postponed accordingly.

Test set available: July 22, 2021
Submission of translations: July 26, 2021

Thank you for your patience!
Antonis Anastasopoulos,
on behalf of the Terminologies Task Team

Toms Bergmanis

unread,
Jul 20, 2021, 2:25:52 AM7/20/21
to wmt-...@googlegroups.com
Dear Antonis, 
Previously the period of submission was announced to be 5 working days, now it is 5 calendar days including the weekend. 
Could submission of translations be postponed so that we still have 5 working days to prepare our submissions as announced initially? 
Best regards, 

Dr. T.Bergmanis 

NLProc researcher @ Tilde MT




--
You received this message because you are subscribed to the Google Groups "Workshop on Statistical Machine Translation" group.
To unsubscribe from this group and stop receiving emails from it, send an email to wmt-tasks+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/wmt-tasks/03625be6-897b-4f68-9a29-366eb4a11d54n%40googlegroups.com.

Toms Bergmanis

unread,
Jul 20, 2021, 2:31:04 AM7/20/21
to wmt-...@googlegroups.com
Dear Antonis, 
Another thing you have not answered from my previous emails: 
What is happening with en-ko development sets? 
Are we supposed to submit test translations without having opportunity to validate them first? 


Dr. T.Bergmanis 

NLProc researcher @ Tilde MT



On Tue, 20 Jul 2021 at 05:36, Antonis Anastasopoulos <anastasop...@gmail.com> wrote:
--

Antonis Anastasopoulos

unread,
Jul 20, 2021, 11:27:20 AM7/20/21
to wmt-...@googlegroups.com
Hi Toms,
thanks for pointing out the inconsistency with the dates -- I have updated the translation submission date to July 29 to allow for 5 calendar days!

What is happening with en-ko development sets? 
Are we supposed to submit test translations without having opportunity to validate them first? 
Oof, due to a communication issue with the translation company they are treating the whole dev+test set as one big dataset, instead of first working on the dev set and then going on to the test set.
As a result, we have to wait for them to finish the annotation on the whole dataset in order to do the split and share dev and test with the participants.
I am hoping we will hear from them today so I'll be able to release the data by tonight. Otherwise we might have to do with a smaller dev+test set for the English-Korean language pair, which is not ideal :(

Best,
Antonis
 


Dr. T.Bergmanis 

NLProc researcher @ Tilde MT




On Tue, 20 Jul 2021 at 05:36, Antonis Anastasopoulos <anastasop...@gmail.com> wrote:
Deal participants,

we are waiting on the annotators for the final annotations on the test set, so we will need to postpone the date of releasing the test sets for a few days.
The days of the final submissions have also been postponed accordingly.

Test set available: July 22, 2021
Submission of translations: July 26, 2021

Thank you for your patience!
Antonis Anastasopoulos,
on behalf of the Terminologies Task Team

--
You received this message because you are subscribed to the Google Groups "Workshop on Statistical Machine Translation" group.
To unsubscribe from this group and stop receiving emails from it, send an email to wmt-tasks+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/wmt-tasks/03625be6-897b-4f68-9a29-366eb4a11d54n%40googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Workshop on Statistical Machine Translation" group.
To unsubscribe from this group and stop receiving emails from it, send an email to wmt-tasks+...@googlegroups.com.

Toms Bergmanis

unread,
Jul 20, 2021, 3:25:15 PM7/20/21
to wmt-...@googlegroups.com
Thanks for the update!
Let's hope for the best!
Cheers, 
Toms 

Reply all
Reply to author
Forward
0 new messages