Clarification Regarding Competition Ranking

[בתיה ברזל‎]

Hello,

Please find attached a screenshot of the list published on the website. We would appreciate some clarification regarding the meaning of this table.

In addition, we are team JST_SB and would like to confirm whether we are considered to be in 3rd or 4th place in the competition. Is the Baseline counted as an official ranking position?

Thank you in advance for your clarification.

Best regards,

JST_SB

[Santiago Castro]

Hello. As we explained before, the "Results" shown on the CodaBench page aren't actual results, and we don't use them for anything (and we weren't able to disable them; that's why that tab still exists). They only reflect if each submission passes some basic sanity checks.

We used CodaBench only to let participants sign up, share the input data files, and receive their submissions. We didn't use CodaBench to share the results. The actual results were shared today via this Google Group.

The team "jct_sb" is considered 1st along with 8 other systems (including the baseline), as its ranking falls within their confidence intervals. Yes, the baseline is officially counted.