BEA19 - System output released + dev request

BEA 2019 Shared Task Organisers

unread,

Apr 16, 2019, 3:00:10 PM4/16/19

to BEA 2019 Shared Task: Grammatical Error Correction

Hi all,

We have just released the system outputs for all tracks on the shared task website. You can find the download link at the top of the Results section: https://www.cl.cam.ac.uk/research/nl/bea2019st/#results

We would also like to ask teams to rerun their systems on the DEV set and upload the output to codalab. This will enable us to create an additional dataset that may help researchers qualitatively evaluate system performance and improve system evaluation in future. Note that the upload procedure is the same as for the test phase, except you must now press an additional button to force a specific submission to the leaderboard in the development phase.

We hope that you will consider rerunning your systems one last time to help us create this dataset. :)

BEA19 Shared Task Organisers

leshem....@mail.huji.ac.il

unread,

Apr 18, 2019, 2:50:57 AM4/18/19

to BEA 2019 Shared Task: Grammatical Error Correction

Where can the uploaded submissions to the dev be downloaded? or do you need to manually update it and share a link?

BEA 2019 Shared Task Organisers

unread,

Apr 18, 2019, 7:37:11 AM4/18/19

to BEA 2019 Shared Task: Grammatical Error Correction

We'll have to download and share them manually unfortunately. There is a download button on Codalab, but it turns out it's only visible to the competition admins.

Only 2 teams have submitted to the dev leaderboard so far, so we're hoping to get more submissions before we do this.

Chris

Reply all

Reply to author

Forward