Human evaluation eligibility not displayed

[Yulia Panchenko]

Hi! A few hours ago I added an explanation column to my best model. The score came out eligible for jury review (explanation rate 100 + same metrics as my best no-explanation submission), but the public leaderboard still displays the explanation rate 0 and no jury eligibility star. The leaderboard has been updated twice since my last submission, so I just want to check that it doesn't somehow get missed! Thank you:)

[Eduardo Sánchez]

Hi Yulia,

What's your username? 

[Yulia Panchenko]

cabanosss :)

[Julia Kreutzer]

Thanks for reaching out and congrats for your great submission! 
Just to quickly check, have you selected this new model in your submission overview? 

--
Has recibido este mensaje porque estás suscrito al grupo "iolai" de Grupos de Google.
Para cancelar la suscripción a este grupo y dejar de recibir sus mensajes, envía un correo electrónico a iolai+un...@googlegroups.com.
Para ver este debate, visita https://groups.google.com/d/msgid/iolai/b87e4674-457a-4fab-a794-2a73ab748be1n%40googlegroups.com.

[Yulia Panchenko]

Thank you! Yes, ~3h ago I selected two submissions in the overview and they both have an explanation rate of 100 and the score identical to that on the leaderboard.

[Julia Kreutzer]

Thanks, we're looking into it! 

Para ver este debate, visita https://groups.google.com/d/msgid/iolai/0765ad4a-30f4-4264-8164-3947456e1021n%40googlegroups.com.

[Eduardo Sánchez]

Hi Yulia,

Your submission was correct, the issue was an edge case we didn't control on our side: your best submission without explanation has the same score as your best submission with explanation, so the individual leaderboard was using the submission date to un-tie. We have changed it so that explanation rate has preference over submission date, so now your submission correctly displays a 100% explanation rate!

[Yulia Panchenko]

Great, thank you!