Call for Participation: IslamicEval 2026
Walid Magdy
Assalamu Alaykum Everyone,
Registration is now open for IslamicEval 2026: Fine-Grained Hallucination Detection in Arabic Islamic Content, which will be held as part of the ArabicNLP 2026 Conference, co-located with EMNLP 2026 in Budapest, Hungary.
The shared task focuses on detecting, verifying, and correcting Qur'an and Hadith citations in LLM-generated Arabic text. Building on IslamicEval 2025, this edition takes a finer-grained approach across four independent subtasks.
Subtasks
* Subtask 1: Span Detection — locate claimed citation fragments and label each as Ayah, Hadith matn, isnad, or claimed
source
* Subtask 2: Hallucination Identification — judge whether each fragment is correct or incorrect
* Subtask 3: Hallucination Correction — restore the canonical text of incorrect verses and hadiths
* Subtask 4: Answer Relevance — decide whether a citation is relevant to the question
Each subtask is independent with its own dataset, so teams may enter any subset. Participating systems are limited to models of 13B parameters or fewer.
Important Dates
- 01 July 2026: Training and development data release
- 20 July 2026: Registration deadline (Register HERE)
- 23 July 2026: Test set release
- 01 August 2026: System submission - final evaluation
- 08 August 2026: System description papers due
Website:
link
Registration:
link
Prizes:
Please make the right intention while participating in this task, so you get your reward from Allah in this Dunia and the Hereafter 😊
We look forward to your participation.
The IslamicEval 2026 Organizers
https://sites.google.com/view/islamiceval2026/