About the system description paper

[Evan Centopani]

Dear Organizers:

Hello, I have a question about the evaluation phase is over, but whether there will be a final ranking officially, which is very important for us to write the paper

Best wishes,

Centopani

[Jennifer D'Souza]

Dear Centopani,

We will rely on the Codalab leaderboard rankings per evaluation phase. Please note also that just for Evaluation Phase 1, there is one team that is not on the leaderboard since they were evaluated offline. Including all teams with submissions for Evaluation Phase 1 by the deadline, the rankings for Evaluation phase 1 are.

happy team = Avg F1 0.4701

BioNLP = Avg F1 0.3828

KnowGraph@IITK = Avg F1 0.3783

ecnuica = Avg F1 0.3335

INNOVATORS = Avg F1 0.3205

Duluth Grad = Avg F1 0.2838

DFKI-SLT = Avg F1 0.2651

single_dog = Avg F1 0.1449

The remaining phases should be accurately reflected on the leaderboard itself. If you would like to aggregate team ranks across all three evaluation phases to obtain a single rank, please feel free to do so. But this aggregated rank would be a valid comparison only for teams that submitted to all three evaluation phases.

With best wishes,

Jennifer