Test Phase: Existence and Extension

[Stephen Mayhew]

Hello all,

A couple announcements:

1. Existence: the test phase is now open! You can see the baseline scores for test here: https://competitions.codalab.org/competitions/23643#results Recall that you are allowed 3 submissions for test, and the dev phase remains open.
2. Extension: because of a few requests, we've decided to extend the test deadline by a week. The new deadline will be April 13th. The final results announcement and draft paper submission deadline will also be pushed back by a week, but we plan on returning system papers at the same time. Both Codalab and the website have been updated.

As always, please contact us with questions or concerns! Best of luck!

Stephen

[Burr Settles]

And just to clarify about the extension, teams can do both of the following, until Monday April 13:

• submit up to 5 prediction results per day against the DEV phase data set (to explore/tune models)
• submit up to 3 prediction results total against the TEST phase data set (for final evaluation)

--
You received this message because you are subscribed to the Google Groups "duolingo-sharedtask-2020" group.
To unsubscribe from this group and stop receiving emails from it, send an email to duolingo-sharedtas...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/duolingo-sharedtask-2020/d3ce5940-59c4-40b1-ad0a-5ad043f8e720%40googlegroups.com.

[Abhishek Pandit]

Thanks, Burr and Stephen (and the rest of the STAPLE task team).

The extension and your clarifications on the submission limits are both super helpful. :)

On Tuesday, March 31, 2020 at 12:30:40 PM UTC-5, Burr Settles wrote:

And just to clarify about the extension, teams can do both of the following, until Monday April 13:

• submit up to 5 prediction results per day against the DEV phase data set (to explore/tune models)
• submit up to 3 prediction results total against the TEST phase data set (for final evaluation)

On Tue, Mar 31, 2020 at 12:13 PM 'Stephen Mayhew' via duolingo-sharedtask-2020 <duolingo-sha...@googlegroups.com> wrote:

Hello all,

A couple announcements:

1. Existence: the test phase is now open! You can see the baseline scores for test here: https://competitions.codalab.org/competitions/23643#results Recall that you are allowed 3 submissions for test, and the dev phase remains open.
2. Extension: because of a few requests, we've decided to extend the test deadline by a week. The new deadline will be April 13th. The final results announcement and draft paper submission deadline will also be pushed back by a week, but we plan on returning system papers at the same time. Both Codalab and the website have been updated.

As always, please contact us with questions or concerns! Best of luck!

Stephen

--
You received this message because you are subscribed to the Google Groups "duolingo-sharedtask-2020" group.

To unsubscribe from this group and stop receiving emails from it, send an email to duolingo-sharedtask-2020+unsub...@googlegroups.com.