Release of system outputs (predicted correct sentences) of participating systems

Abhijeet Awasthi

unread,

Apr 9, 2019, 1:37:16 PM4/9/19

to BEA 2019 Shared Task: Grammatical Error Correction

Hi,

It would be beneficial if system outputs (predicted correct sentences) of participating systems are released as well. This would allow for comparisons beyond the numbers provided by ERRANT.

Thanks

BEA 2019 Shared Task Organisers

unread,

Apr 9, 2019, 2:53:37 PM4/9/19

to BEA 2019 Shared Task: Grammatical Error Correction

Hey,

If you log in to Codalab, you actually should already be able to download the submissions from a link above the leaderboard. Specifically, the button appears next to the "Download CSV" button, but only if you are logged in to Codalab.

That said, the download also includes a lot of useless metadata files, so we are currently cleaning everything up and will release all the system output in a cleaner file soon. We'll let you know when it's ready!

Chris

leshem....@mail.huji.ac.il

unread,

Apr 15, 2019, 8:19:06 AM4/15/19

to BEA 2019 Shared Task: Grammatical Error Correction

Hey Chris,

Is it possible to gather also the results on the dev (and perhaps train) sets as well for publishing from anyone willing to share those, while everyone still have their systems working?

I believe it might benefit future research as well and might not be too hard to accumulate right now.