Clarification on the Aug 15 deadline and leaderboard ranking

[Maksim Silchenko]

Dear organisers,

I hope this email finds you well!

Two quick questions:

1. The Important Dates table lists August 15 for test output, code, and system papers. Could you confirm the intended timezone (AoE, UTC, or CEST)?
2. The Codabench test phase has no end date set and is still accepting submissions. Will the final ranking be taken from the leaderboard as it stands at announcement, or restricted to entries submitted by the August 15 deadline?

Kind regards,

Maksim Silchenko 

team thylinao 

[Simon Razniewski]

Dear Maksim,

1. The deadline was meant AoE.

2. The final ranking of the AKBC 2026 shared task will be taken from the leaderboard as of now. At the same time, it is common that leaderboards stay open for future research, we haven't discussed the options internally yet, but I hope ours can also remain available and open long-term.

Cheers,

Simon

--
You received this message because you are subscribed to the Google Groups "akbc2026-shared-task" group.
To unsubscribe from this group and stop receiving emails from it, send an email to akbc2026-shared-...@googlegroups.com.
To view this discussion, visit https://groups.google.com/d/msgid/akbc2026-shared-task/CAAM68DeHa85rV%3Dj_%3DdJAQxYWFas9qS458zXH_PVSgU_Od79zmw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

[Maksim Silchenko]

Dear Simon,

Thank you again for your clarification. I just wanted to follow up, as I am still a little confused about how the deadline is being applied.

1) The current top-ranked submission appears to have been submitted after the deadline you indicated in your email.

2) You stated that the deadline was 15 August, AoE, while also saying that all submissions are valid based on the leaderboard as of now. Since your email was sent after that deadline, could you please clarify how these two statements fit together? In particular, are submissions made after the 15 August AoE deadline considered valid?

I had been working according to the deadline stated on the website, which you also confirmed and, as I understand it, the deadline applied to the required deliverables as well, including the paper and public code.

However, several hours after the deadline, the public repository for the current first-ranked entry still appears to reflect an earlier submission rather than the code corresponding to its current score. My paper and repository, meanwhile, reflect the state of my submission and the overall board result at the deadline.

Could you please clarify how the deadline and deliverable requirements are being applied here? I just want to make sure I understand which submissions are valid and that everything is assessed in accordance with the stated rules.

Kind regards,
Maksim Silchenko
team thylinao

[Simon Razniewski]

Dear Maksim,

Thanks for asking!

The leaderboard stores submission timestamps, and we will use the scores as they were available August 15, 23:59:59 AoE.

For the papers, the same cutoff applies.

For the code, we will mainly use it to verify that a solution did not violate rules, hence the exact timestamp is less critical (but Github stores history, so in critical cases we can also go back).

I hope this helps!

Cheers,

Simon

On Mon, 17 Aug 2026 at 02:42, Maksim Silchenko <maks.sil...@gmail.com> wrote:

Dear Simon,

Thank you again for your clarification. I just wanted to follow up, as I am still a little confused about how the deadline is being applied.

1) The current top-ranked submission appears to have been submitted after the deadline you indicated in your email.

2) You stated that the deadline was 15 August, AoE, while also saying that all submissions are valid based on the leaderboard as of now. Since your email was sent after that deadline, could you please clarify how these two statements fit together? In particular, are submissions made after the 15 August AoE deadline considered valid?

I had been working according to the deadline stated on the website, which you also confirmed and, as I understand it, the deadline applied to the required deliverables as well, including the paper and public code.

However, several hours after the deadline, the public repository for the current first-ranked entry still appears to reflect an earlier submission rather than the code corresponding to its current score. My paper and repository, meanwhile, reflect the state of my submission and the overall board result at the deadline.

Could you please clarify how the deadline and deliverable requirements are being applied here? I just want to make sure I understand which submissions are valid and that everything is assessed in accordance with the stated rules.

Kind regards,
Maksim Silchenko
team thylinao

On Mon, 17 Aug 2026 at 03:59, Simon Razniewski <simon.ra...@tu-dresden.de> wrote: