Clarification Regarding Competition Ranking

38 views
Skip to first unread message

בתיה ברזל

unread,
Feb 23, 2026, 1:07:58 AM (9 days ago) Feb 23
to semeval-2026-t...@googlegroups.com, Sarah Barzel

Hello,

Please find attached a screenshot of the list published on the website. We would appreciate some clarification regarding the meaning of this table.

In addition, we are team JST_SB and would like to confirm whether we are considered to be in 3rd or 4th place in the competition. Is the Baseline counted as an official ranking position?

Thank you in advance for your clarification.

Best regards,
JST_SB

image.png


Santiago Castro

unread,
Feb 23, 2026, 1:42:26 AM (9 days ago) Feb 23
to semeval-2026-task-1-humor-gen
Hello. As we explained before, the "Results" shown on the CodaBench page aren't actual results, and we don't use them for anything (and we weren't able to disable them; that's why that tab still exists). They only reflect if each submission passes some basic sanity checks.

We used CodaBench only to let participants sign up, share the input data files, and receive their submissions. We didn't use CodaBench to share the results. The actual results were shared today via this Google Group.

The team "jct_sb" is considered 1st along with 8 other systems (including the baseline), as its ranking falls within their confidence intervals. Yes, the baseline is officially counted.
Reply all
Reply to author
Forward
0 new messages