Failed to submit test reult of taskB

13 views
Skip to first unread message

吴俣

unread,
Jan 23, 2017, 9:51:22 PM1/23/17
to semev...@googlegroups.com
Hi,
    I submitted test result of testB SemEval2017 yesterday, but it always failed. And the system did not give me a explicit reason that why I failed on the submission. The error log is None but the submission is failed. I have test it using the format checker, and passed. Besides, Does it count a number if I failed on the submission? (as far as I know, each team has only 3 chances). 

Thanks,
Yu.


 

Preslav Nakov

unread,
Jan 24, 2017, 12:39:35 AM1/24/17
to 吴俣, SemEval-2016 Task 3 CQA
Unsuccessful submits do not count.

We will have a look and see what the oroblem is.

--
Task website: http://alt.qcri.org/semeval2016/task3/
---
You received this message because you are subscribed to the Google Groups "SemEval-2017 Task 3 CQA" group.
To unsubscribe from this group and stop receiving emails from it, send an email to semeval-cqa+unsubscribe@googlegroups.com.
To post to this group, send email to semev...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/semeval-cqa/1cccec07.1709.159ce61b907.Coremail.wumark%40126.com.
For more options, visit https://groups.google.com/d/optout.

吴俣

unread,
Jan 24, 2017, 12:48:05 AM1/24/17
to Preslav Nakov, SemEval-2016 Task 3 CQA
I made a successful submission just now. It looks like that the last column must be "true" or "false" in lowercase. Any character in uppercase will cause the error, but none error description is shown in the log.

Thanks,
Yu.
To unsubscribe from this group and stop receiving emails from it, send an email to semeval-cqa...@googlegroups.com.

To post to this group, send email to semev...@googlegroups.com.

Doris Hoogeveen

unread,
Jan 24, 2017, 1:29:50 AM1/24/17
to SemEval-2017 Task 3 CQA, presla...@gmail.com
Hello Yu,

Good to hear you found the solution.

Failed submissions should not count towards the 3 submission limit, but unfortunately Codalab does not offer a way to not count them. I will discuss with you in a separate email how we can get around this problem.

Kind regards,
Doris

Doris Hoogeveen

unread,
Jan 26, 2017, 7:02:19 PM1/26/17
to SemEval-2017 Task 3 CQA, presla...@gmail.com
I have spoken to Yu, who got things working, but just for everyone else:

Sorry, Preslav is right, failed submissions do not count.
Reply all
Reply to author
Forward
0 new messages