Groups
Groups
Sign in
Groups
Groups
duolingo-sharedtask-2020
Conversations
About
Send feedback
Help
duolingo-sharedtask-2020
Contact owners and managers
1–30 of 32
Mark all as read
Report group
0 selected
Stephen Mayhew
6/26/20
Presentations at WNGT
Hello all, I wanted to give an update of our latest understanding of the organization. You should all
unread,
Presentations at WNGT
Hello all, I wanted to give an update of our latest understanding of the organization. You should all
6/26/20
Zhenhao Li
,
Stephen Mayhew
2
6/16/20
Poster for the workshop
Hi Zhenhao, Thanks for checking in -- we're still working out the details with the organizers of
unread,
Poster for the workshop
Hi Zhenhao, Thanks for checking in -- we're still working out the details with the organizers of
6/16/20
Stephen Mayhew
5/26/20
Shared Task Overview Paper and Full Data Release
Hello all, We are pleased to announce two things: The shared task overview paper is finished! Read it
unread,
Shared Task Overview Paper and Full Data Release
Hello all, We are pleased to announce two things: The shared task overview paper is finished! Read it
5/26/20
Stephen Mayhew
, …
Zhenhao Li
9
5/19/20
Official Results
Hi Stephen, Thanks for the answer, and again thanks for organizing this great shared task! Cheers,
unread,
Official Results
Hi Stephen, Thanks for the answer, and again thanks for organizing this great shared task! Cheers,
5/19/20
Stephen Mayhew
5/18/20
Camera-Ready Due Today
Hello all, Sorry that it's late, but just a friendly reminder that the camera-ready papers are
unread,
Camera-Ready Due Today
Hello all, Sorry that it's late, but just a friendly reminder that the camera-ready papers are
5/18/20
Jacob Leo Bremerman
,
Stephen Mayhew
3
5/12/20
Releasing full Dev and/or Test data
Great, thanks so much! On Monday, May 11, 2020 at 5:12:26 PM UTC-4, stephen wrote: Hi Jake, Yes, we
unread,
Releasing full Dev and/or Test data
Great, thanks so much! On Monday, May 11, 2020 at 5:12:26 PM UTC-4, stephen wrote: Hi Jake, Yes, we
5/12/20
Stephen Mayhew
5/4/20
Reviews are out!
Hello everyone, The paper reviews are finished! Every reviewer was instructed to give a score of 5,
unread,
Reviews are out!
Hello everyone, The paper reviews are finished! Every reviewer was instructed to give a score of 5,
5/4/20
Stephen Mayhew
4/22/20
Reminder for the New Final Deadline (v2)
Reminder that today is the last day to submit your system description! We will start reviewing papers
unread,
Reminder for the New Final Deadline (v2)
Reminder that today is the last day to submit your system description! We will start reviewing papers
4/22/20
Stephen Mayhew
4/20/20
Submission Deadline Extended
Hello all, Due to a few requests to have the system description deadline extended, we have decided to
unread,
Submission Deadline Extended
Hello all, Due to a few requests to have the system description deadline extended, we have decided to
4/20/20
Moatez
, …
Stephen Mayhew
4
4/20/20
Deadline
Hello all, Thanks for contacting us about this, and sorry for the delay. We will extend the deadline
unread,
Deadline
Hello all, Thanks for contacting us about this, and sorry for the delay. We will extend the deadline
4/20/20
hu...@jhu.edu
,
Stephen Mayhew
3
4/20/20
START submission link?
Hi Stephen, Thanks for the clarification! Best, Huda From: 'Stephen Mayhew' via duolingo-
unread,
START submission link?
Hi Stephen, Thanks for the clarification! Best, Huda From: 'Stephen Mayhew' via duolingo-
4/20/20
Stephen Mayhew
4/15/20
Wrapping Up
Hello all, The shared task has officially wrapped up! Thanks for your hard work! We are pleased to
unread,
Wrapping Up
Hello all, The shared task has officially wrapped up! Thanks for your hard work! We are pleased to
4/15/20
Moatez
,
Stephen Mayhew
5
4/15/20
Test results submission
Thanks !! Le mercredi 15 avril 2020 à 11:33:09 UTC-7, ste...@duolingo.com a écrit : Hi Moatez, We
unread,
Test results submission
Thanks !! Le mercredi 15 avril 2020 à 11:33:09 UTC-7, ste...@duolingo.com a écrit : Hi Moatez, We
4/15/20
Zhenhao Li
,
Stephen Mayhew
3
4/13/20
Duplicate submissions on test set.
Thanks a lot, Stephen! On Tuesday, April 14, 2020 at 1:21:11 AM UTC+8, stephen wrote: Done. Stephen
unread,
Duplicate submissions on test set.
Thanks a lot, Stephen! On Tuesday, April 14, 2020 at 1:21:11 AM UTC+8, stephen wrote: Done. Stephen
4/13/20
Stephen Mayhew
4/13/20
Crunch Time
Hello STAPLERs, We're excited to see a lot of submissions! This is a quick note to say that
unread,
Crunch Time
Hello STAPLERs, We're excited to see a lot of submissions! This is a quick note to say that
4/13/20
Ollie Benson
,
Stephen Mayhew
2
4/13/20
How is eveyone doing?
Hi Ollie, There's been a lot of exciting activity! Take a look at the CodaLab leaderboards to see
unread,
How is eveyone doing?
Hi Ollie, There's been a lot of exciting activity! Take a look at the CodaLab leaderboards to see
4/13/20
Yasmin Moslem
, …
Jacob Leo Bremerman
4
4/11/20
Error "sorry failed to upload file"
Thanks, Jacob! Yes, this happens here as well, and I do not think it is related to Internet
unread,
Error "sorry failed to upload file"
Thanks, Jacob! Yes, this happens here as well, and I do not think it is related to Internet
4/11/20
Rahul Mayuranath
,
Stephen Mayhew
2
4/11/20
New Registration
Done! Good luck! Stephen On Sat, Apr 11, 2020 at 4:42 AM Rahul Mayuranath <rahu...@gmail.com>
unread,
New Registration
Done! Good luck! Stephen On Sat, Apr 11, 2020 at 4:42 AM Rahul Mayuranath <rahu...@gmail.com>
4/11/20
Rakesh Chada
,
Stephen Mayhew
4
4/9/20
Mistakenly submitted dev results to the test leaderboard
Thanks Stephen! On Thu, Apr 9, 2020, 06:22 Stephen Mayhew <ste...@duolingo.com> wrote: No
unread,
Mistakenly submitted dev results to the test leaderboard
Thanks Stephen! On Thu, Apr 9, 2020, 06:22 Stephen Mayhew <ste...@duolingo.com> wrote: No
4/9/20
Stephen Mayhew
4/6/20
Final Week and Virtual ACL!
Hello all, Two notes: 1. This is the final week for the testing phase. The deadline is next Monday,
unread,
Final Week and Virtual ACL!
Hello all, Two notes: 1. This is the final week for the testing phase. The deadline is next Monday,
4/6/20
Anton Voronov
,
Stephen Mayhew
2
4/1/20
Can be low score caused by bad format?
Hi Anton, It looks like the text is still tokenized, while the evaluation files are detokenized. For
unread,
Can be low score caused by bad format?
Hi Anton, It looks like the text is still tokenized, while the evaluation files are detokenized. For
4/1/20
Stephen Mayhew
, …
Abhishek Pandit
3
3/31/20
Test Phase: Existence and Extension
Thanks, Burr and Stephen (and the rest of the STAPLE task team). The extension and your
unread,
Test Phase: Existence and Extension
Thanks, Burr and Stephen (and the rest of the STAPLE task team). The extension and your
3/31/20
Junsu Park
,
Stephen Mayhew
2
3/31/20
Unable to find any appropriately-named submission files
Hi! Thanks for your interest! It looks like you have had some successful submissions -- is this still
unread,
Unable to find any appropriately-named submission files
Hi! Thanks for your interest! It looks like you have had some successful submissions -- is this still
3/31/20
amardeep kumar
,
Stephen Mayhew
2
3/30/20
to increase Bar on maximum number of submission per day
Hi Amardeep, Thanks for the feedback! We were trying to discourage probing of the eval sets, but for
unread,
to increase Bar on maximum number of submission per day
Hi Amardeep, Thanks for the feedback! We were trying to discourage probing of the eval sets, but for
3/30/20
Abhishek Pandit
,
Stephen Mayhew
9
3/30/20
(Possibly Basic) Question on (Lack of) Alternative Translations in the Dev Set
Hi Abe, I believe what you're seeing are markers for wordpieces, probably coming out of fairseq-
unread,
(Possibly Basic) Question on (Lack of) Alternative Translations in the Dev Set
Hi Abe, I believe what you're seeing are markers for wordpieces, probably coming out of fairseq-
3/30/20
Stephen Mayhew
3/26/20
Clarifications on Dev/Test phases
Hello all, Some clarifications/updates: The test phase will allow a *total* of 3 submissions with no
unread,
Clarifications on Dev/Test phases
Hello all, Some clarifications/updates: The test phase will allow a *total* of 3 submissions with no
3/26/20
Stephen Mayhew
,
Tadashi Nomoto
2
3/25/20
Test Phase starts next week!
Hi, I have trouble signing in for the submission. Stuck in the approval pending status. What's
unread,
Test Phase starts next week!
Hi, I have trouble signing in for the submission. Stuck in the approval pending status. What's
3/25/20
Stephen Mayhew
3/19/20
Small update to code in repo
Hello all, The JHU team pointed out an issue with punctuation that could affect the scoring script (
unread,
Small update to code in repo
Hello all, The JHU team pointed out an issue with punctuation that could affect the scoring script (
3/19/20
Kalyan Gvs
,
Chris Brust
2
3/18/20
Unable to submit predictions
Hello! Thank you for your interest in our shared task! Our evaluation script is a bit particular in
unread,
Unable to submit predictions
Hello! Thank you for your interest in our shared task! Our evaluation script is a bit particular in
3/18/20
Stephen Mayhew
, …
Terry Daniels
4
3/14/20
Dev data release and CodaLab!
Have you encountered any individuals interested in ML for language learning in virtual environments?
unread,
Dev data release and CodaLab!
Have you encountered any individuals interested in ML for language learning in virtual environments?
3/14/20