DeftEval 2020

Hi Dian, We left the original set of labels in the evaluation set so that folks who wanted to

Hi everyone, The SemEval system description paper deadline has been extended to 15 May 2020 (from 1

Hi Adis, Yes, SemEval has extended the paper deadline to 15 May 2020. Sasha From: <semeval-2020-

Hi everyone, Because of the complications of the COVID pandemic, the COLING conference dates have

Hi there, Certainly, dev and test sets are to be used for exactly what they say: You are more than

Hello all, Thank you to everyone who participated in DeftEval! I am including the final results of

Dear Organizers, I have a few questions: 1- when is the deadline for submitting the paper to the

Hi, Sasha! When will the results of task 3 be released? Best, Adis суббота, 29 февраля 2020 г., 5:04:

Hi Sasha, I have made a submission for subtask 1 under the tab Subtask 1&2. My account name on

Oh, ok then. Thank you very much for your help! On Thursday, 12 March 2020 00:39:37 UTC+2, Sasha

Hi there, The Codalab phase closing was unintentional – I have opened it back up until tomorrow

Hi all, I am aware that many of you were planning on submitting today but were unable to because of

Dear organizers of deft eval task, I submitted a high scoring submission and forgot to submit it to

when will the results of the first phase being released?

Hi there, This should all be fixed now. Please use the updated version from github. Sasha From: <

Hi Sasha, I forgot to submit the best submission to the leaderboard. Will the best submission be

Hi Hector, Looks like you have too many rows in your submission file. Unfortunately the submission

Hi, Sasha! When I was trying to join best subtask 1 and 2 results, I accidentally rewrote best

Looks like you've predicted a definition fragment, though we are not evaluating on any fragments.

Hi, I have registered to the DeftEval 2020, but the state of Participate on the new page is still

And the problem is solved with this way.

Hiya, Please disregard the ordering on the leaderboard. We will announce the official ranking next

Hi, I have now submitted subtask1 4 times and subtask2 1 time. May I get additional submission

When i submit mu results on codalab, the status is "submitted". There is no error occuring,

Thx 在 2020年2月27日星期四 UTC+8下午8:57:28，Адис Давлетов写道： https://groups.google.com/forum/#!topic/semeval-

Adis is correct – failed submission attempts do not count towards your 5 allowed submissions. As for

It was like that from the start of evaluation period вторник, 25 февраля 2020 г., 1:07:38 UTC+3

Looks like you're trying to predict a secondary definition, but Codalab (or your config file if

I'll take a look at this when I'm free later today. In the meantime you should be able to run

Hi Amr, Codalab's leaderboard required us to populate all fields when we report a score. Because