About retest results

44 views
Skip to first unread message

Jing Ling

unread,
Jan 31, 2021, 10:42:39 PM1/31/21
to NLPContributionGraph Shared Task at SemEval 2021
Dear Organizers:
Hello, the retest result score of our evaluation phase 2 part1 on the website is not our highest score. I would like to ask if this will affect our final ranking?

Best wishes,
Alice

Jennifer D'Souza

unread,
Feb 1, 2021, 2:23:36 AM2/1/21
to NLPContributionGraph Shared Task at SemEval 2021
Dear Alice,

Could you please inform us your team name? And the timestamp of your submission which you think is the highest score. We can look into it. Ideally, the competition site is set up so that it automatically picks the highest scores from all your submissions. Because of which, just for that phase we had to delete participants' old submissions if they looked problematic to enable the competition site to use the rerun.

Best wishes,
Jennifer

Jing Ling

unread,
Feb 1, 2021, 7:05:13 AM2/1/21
to NLPContributionGraph Shared Task at SemEval 2021
Dear Organizers:
Thank you for your answer! Our team name is ecnuica. Due to unable to send pictures, I copied our submission record for your reference. Here is our submission record:
# SCORE FILENAME SUBMISSION DATE STATUS
1 0.6637607446 submission.zip 01/22/2021 13:50:16 Finished
2 0.7140480664 submission.zip 01/23/2021 09:47:51 Finished
3 0.7081772347 submission.zip 01/24/2021 14:40:49 Finished
4 0.6960111623 submission.zip 01/24/2021 17:43:32 Finished
5 0.7161840756 submission.zip 01/24/2021 18:02:12 Finished
6 0.6912757976 submission.zip 01/24/2021 20:30:37 Finished
7 0.7167110568 submission.zip 01/24/2021 20:51:09 Finished
8 0.7113050682 submission.zip 01/28/2021 10:16:23 Finished
9 0.6913675929 submission.zip 01/28/2021 10:16:24 Finished
10 0.7108203587 submission.zip 01/28/2021 10:16:24 Finished
11 0.6960663273 submission.zip 01/28/2021 10:16:24 Finished
12 0.7031810103 submission.zip 01/28/2021 10:16:24 Finished
13 0.7083814042 submission.zip 01/28/2021 10:16:25 Finished
14 0.6596561147 submission.zip 01/28/2021 10:16:25 Finished (This is the score shown on the list)

Best wishes,
Alice

Official Task

unread,
Feb 1, 2021, 9:23:50 AM2/1/21
to Jing Ling, NLPContributionGraph Shared Task at SemEval 2021
Dear Alice,

Thank you for the information. The Leaderboard should now reflect your submission top score after re-evaluation.

Best wishes,
Jennifer

--
You received this message because you are subscribed to a topic in the Google Groups "NLPContributionGraph Shared Task at SemEval 2021" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/ncg-task-semeval-2021/mJb2s4puoZ0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to ncg-task-semeval...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/ncg-task-semeval-2021/86e863d3-3f28-4c96-a0a1-0845bb9fbeefn%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages