Max submissions total

wangw...@gmail.com

unread,

Mar 26, 2019, 9:34:13 PM3/26/19

to BEA 2019 Shared Task: Grammatical Error Correction

Hi,

The test phase description in CodaLab says that participants will be allowed to make a maximum of 5 submissions in total. However, it is also mentioned that the max submissions per day and in total are 2. Can you clarify which is accurate?

The test phase is the official evaluation phase of the shared task. Submissions will be evaluated on the official W&I+LOCNESS test set. Participants will only be allowed to make a maximum of 5 submissions in total during this phase. Out of these 5 submissions, only the best (in terms of span-based correction F0.5) will be shown on the leaderboard at the end of the test phase.

Max submissions per day: 2
Max submissions total: 2

regards,

WQ

BEA 2019 Shared Task

unread,

Mar 27, 2019, 7:59:07 AM3/27/19

to wangw...@gmail.com, BEA 2019 Shared Task: Grammatical Error Correction

Hi,

Thank you for pointing this out, it has now been fixed. The correct maximum number of submissions for the test phase is 2 (two).

From: "wangw...@gmail.com" <wangw...@gmail.com>
To: BEA 2019 Shared Task: Grammatical Error Correction <bea2...@googlegroups.com>
Sent: Wednesday, 27 March 2019, 1:34
Subject: Max submissions total

--
You received this message because you are subscribed to the Google Groups "BEA 2019 Shared Task: Grammatical Error Correction" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bea2019st+...@googlegroups.com.
To post to this group, send email to bea2...@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/bea2019st/b1254245-e209-4906-bebf-f46433880630%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

robin

unread,

Mar 28, 2019, 8:56:50 AM3/28/19

to BEA 2019 Shared Task: Grammatical Error Correction

2 submission per track every day ?

在 2019年3月27日星期三 UTC+8下午7:59:07，BEA 2019 Shared Task Organisers写道：

Hi,

Thank you for pointing this out, it has now been fixed. The correct maximum number of submissions for the test phase is 2 (two).

From: "wangw...@gmail.com" <wangw...@gmail.com>
To: BEA 2019 Shared Task: Grammatical Error Correction <bea2...@googlegroups.com>
Sent: Wednesday, 27 March 2019, 1:34
Subject: Max submissions total

Hi,

The test phase description in CodaLab says that participants will be allowed to make a maximum of 5 submissions in total. However, it is also mentioned that the max submissions per day and in total are 2. Can you clarify which is accurate?

The test phase is the official evaluation phase of the shared task. Submissions will be evaluated on the official W&I+LOCNESS test set. Participants will only be allowed to make a maximum of 5 submissions in total during this phase. Out of these 5 submissions, only the best (in terms of span-based correction F0.5) will be shown on the leaderboard at the end of the test phase.
Max submissions per day: 2
Max submissions total: 2

regards,
WQ

--
You received this message because you are subscribed to the Google Groups "BEA 2019 Shared Task: Grammatical Error Correction" group.

To unsubscribe from this group and stop receiving emails from it, send an email to bea2...@googlegroups.com.

BEA 2019 Shared Task

unread,

Mar 28, 2019, 9:03:01 AM3/28/19

to robin, BEA 2019 Shared Task: Grammatical Error Correction

In total, per track (as stated in Codalab).

From: robin <ruobi...@liulishuo.com>

To: BEA 2019 Shared Task: Grammatical Error Correction <bea2...@googlegroups.com>

Sent: Thursday, 28 March 2019, 12:56
Subject: Re: Max submissions total

To unsubscribe from this group and stop receiving emails from it, send an email to bea2019st+...@googlegroups.com.

To post to this group, send email to bea2...@googlegroups.com.

To view this discussion on the web, visit https://groups.google.com/d/msgid/bea2019st/172f266c-c04a-4efa-b33e-28d1076d43fa%40googlegroups.com.

robin

unread,

Mar 28, 2019, 9:55:55 AM3/28/19

to BEA 2019 Shared Task: Grammatical Error Correction

So tomorrow, one can submit 2 per track, totally 6 for 3 tracks. Am I right?

在 2019年3月28日星期四 UTC+8下午9:03:01，BEA 2019 Shared Task Organisers写道：

In total, per track (as stated in Codalab).

From: robin <ruob...@liulishuo.com>

To unsubscribe from this group and stop receiving emails from it, send an email to bea2...@googlegroups.com.

BEA 2019 Shared Task

unread,

Mar 28, 2019, 10:07:29 AM3/28/19

to robin, BEA 2019 Shared Task: Grammatical Error Correction

Yes, but this is the total limit, *not* per day. If you make your 2 submissions today for a given track, you will not be able to make another 2 submissions tomorrow.

From: robin <ruobi...@liulishuo.com>

To: BEA 2019 Shared Task: Grammatical Error Correction <bea2...@googlegroups.com>

Sent: Thursday, 28 March 2019, 13:55

To view this discussion on the web, visit https://groups.google.com/d/ msgid/bea2019st/172f266c-c04a- 4efa-b33e-28d1076d43fa% 40googlegroups.com.

For more options, visit https://groups.google.com/d/ optout.

--
You received this message because you are subscribed to the Google Groups "BEA 2019 Shared Task: Grammatical Error Correction" group.

To unsubscribe from this group and stop receiving emails from it, send an email to bea2019st+...@googlegroups.com.

To post to this group, send email to bea2...@googlegroups.com.

To view this discussion on the web, visit https://groups.google.com/d/msgid/bea2019st/9605eb0c-1e03-4b5f-8f82-0991c8db0781%40googlegroups.com.

Reply all

Reply to author

Forward