[Announcement] Intermediate Submission Deadline Closed – Evaluation Results by 18 June (AoE)

[LLMs4OL Challenge]

Dear Participants,

The intermediate submission deadline has now passed, and we will no longer accept intermediate submissions. For the final submission, please feel free to use the same form, but check the submission type as a final.

Please expect the evaluation results by the end of 18 June (AoE). If you do not receive your results by then, please feel free to contact us.

Best regards,
Hamed
On behalf of the LLMs4OL Challenge Organizing Team

[LLMs4OL Challenge]

Dear Participants,

Please expect a delay in receiving the results emails until 22 June due to several issues affecting the evaluation process. In addition to inconsistencies in the submitted files (some submissions are in JSON format, while others contain nested ZIP files) and a large number of submissions, we have also encountered file encoding issues within submitted files that require additional processing before the evaluations can be completed. 

To ensure that no one is disadvantaged, we will extend the submission deadline for the missing days. We appreciate your patience and understanding as we work through these issues and complete the evaluations.

Please, for the final submission, make sure your submissions adhere to the formatting guidelines. Thank you for your cooperation.

Best Regards

Hamed

On behalf of the LLMs4OL challenge organization team.

[LLMs4OL Challenge]

Dear Participants,

We are pleased to announce that the intermediate evaluation results are now available. You should have received an email containing your team's evaluation results.

To ensure transparency and reproducibility, we have kept the evaluation metrics as straightforward as possible. The evaluation scripts are publicly available in the challenge repository:
https://github.com/sciknoworg/LLMs4OL-Challenge/tree/main/2026/metrics

Due to the delay in releasing the intermediate results, we have extended the submission deadlines to provide participants with additional time to prepare their final submissions. The updated schedule can be found on the challenge website:
https://sites.google.com/view/llms4ol2026/important-dates

We would also like to remind all participants of an important submission note: each team is allowed to make up to two final submissions per dataset. If more than two submissions are made for a dataset, only the last two submissions received before the deadline will be considered for the final evaluation.

Please ensure that your submissions follow the required format described in the challenge guidelines.  

Thank you for your participation and continued interest in the challenge. We look forward to receiving your final submissions and wish you the best of luck.

Kind regards,

Hamed,
On behalf of the LLMs4OL 2026 Organizing Committee