Test data released! - 25/3/19

[BEA 2019 Shared Task Organisers]

Dear BEA19 Shared Task Participants,

We have now released the official shared task test data on codalab!

As a reminder, you may make up to 2 submissions on this test set from now until 23:59 UTC, Friday 29th March for each track you are participating in. You will not be able to see your results until after the test phase is over.

It is also important to make sure you submit to the right track, as we might not be able to move submissions between tracks after the test phase is over. If you have any doubts about whether any of your data is allowed in a particular track, you should contact us directly before you submit.

If you haven't already done so, we also encourage you to choose a team name that represents your institution/organisation; e.g. CAMB for University of Cambridge. Details on how to specify your team name are provided on codalab. 

Finally, we also updated the W&I+LOCNESS and FCE corpus downloads to v2.1. This was only a minor change to the code to handle multiple annotators (there are 5 in the test set) and does NOT affect the data. 

Otherwise, thanks for all your hard work and good luck!

BEA19 Shared Task Organisers

[tmu]

Hi,

Will the target side of the test data be released? 

Best regards

2019年3月25日月曜日 9時14分13秒 UTC+9 BEA 2019 Shared Task Organisers:

[BEA 2019 Shared Task Organisers]

Hi,

There are currently no plans to release the target side of the test data. 

We are deliberately keeping this hidden for now so people can continue to test their systems on codalab without being able to directly fit to the data.

Chris