to increase Bar on maximum number of submission per day

16 views
Skip to first unread message

amardeep kumar

unread,
Mar 30, 2020, 3:24:40 AM3/30/20
to duolingo-sharedtask-2020
Hi organizers, 
Thanks for organizing this awesome shared task, which promotes multilingual aspects of NLP. It would be much better if you could increase the limit on maximum submission in a day. IMO only one submission in a day is a very tough constraint, and in DL many times our result depends on finetuning. I am not asking to increase daily limit to unlimited, 3 or 5 would be fine, as the contest is also going to end soon. Imagine waiting for two days only to come to know that your format of submission is wrong.

Thanks
-AD

Stephen Mayhew

unread,
Mar 30, 2020, 11:49:48 AM3/30/20
to amardeep kumar, duolingo-sharedtask-2020
Hi Amardeep, 

Thanks for the feedback! We were trying to discourage probing of the eval sets, but for the development set, we agree that a higher submission limit makes sense. We have changed it to 5 submissions per day. No change has been made to the test set.

Stephen

--
You received this message because you are subscribed to the Google Groups "duolingo-sharedtask-2020" group.
To unsubscribe from this group and stop receiving emails from it, send an email to duolingo-sharedtas...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/duolingo-sharedtask-2020/83f365ed-e6f4-4444-a23a-118d82d52f3b%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages