About number of submissions if submitting for subtask 1 & 2 seperately?

[michae...@gmail.com]

I wonder... If submitting for subtask 1 & 2 seperately, do i have to ask for extra 5 times of submissions from the organizer?

[michae...@gmail.com]

And also, why are someone with more than 10 times of submissions?

在 2020年2月26日星期三 UTC+8上午10:09:18，michae...@gmail.com写道：

[Адис Давлетов]

There was an email from organizers:

Hi all,

I realize the combining of the subtask 1 and 2 tabs may have caused some confusion. To clarify, you may still submit results files for either sub task individually.   Our evaluation script is set up to provide a non-score (-1) for any task you did not provide files for. Both sub tasks will still be treated separately for the competition, though on Codalab they will share a leaderboard. If you are trying to submit both for subtask 1 AND 2, you may submit both files at the same time. If you chose to submit your subtask 1 and 2 files separately and run out of allowed submissions, please send me an email and we will make sure you get the chance to submit.

Best,
Sasha

About second question, I think there are also the number of failed submission attempts.

Best,

Adis

среда, 26 февраля 2020 г., 11:17:44 UTC+3 пользователь michae...@gmail.com написал:

[Sasha Spala]

Adis is correct – failed submission attempts do not count towards your 5 allowed submissions.

As for combined submissions, we prefer you submit your subtask 1 and 2 submissions together (requires less messing with Codalab’s framework), but if you do run out of submissions I can help you make sure you get the chance to use your 5 submissions.

 

Best,
Sasha

--
You received this message because you are subscribed to the Google Groups "DeftEval 2020" group.
To unsubscribe from this group and stop receiving emails from it, send an email to semeval-2020-task...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/semeval-2020-task-6-all/88796bc4-670a-472e-8b08-c25230d44eda%40googlegroups.com.