📢 Call for Participation — QIAS Shared Task @ ArabicNLP 2025

[Bouchekif Abdessalam]

🌍     Qias Shared Task @ArabicNLP 2025   - Evaluating LLMs for Islamic Knowledge

📅      Register by 20 July 2025: Register here

We are pleased to invite you to participate in QIAS 2025, held as part of ArabicNLP 2025, co-located with EMNLP 2025 in Suzhou, China.  

🕌 QIAS 2025 focuses on evaluating Large Language Models (LLMs) on complex reasoning and knowledge tasks in classical Islamic sciences .

  🧠 Task Overview

We have 2 sub-tasks. Participants can choose to work on one or both, each consisting exclusively of MCQs. These MCQs are organized into three levels of difficulty—beginner, intermediate, and advanced
Subtask 1: Islamic Inheritance Reasoning  (ʿilm al-mawārīth)

Evaluate LLMs on applying juristic logic to real-world inheritance  cases using multiple-choice questions. 

📌 Example  

توفي عن أب، وأخوين شقيقين، وابن أخ شقيق، وعمين شقيقين،  وأم، وبنتين، و زوجة، فما نصيب الأم؟

☐    الثلث

☐    الربع

☒    السدس

☐    الثمن

☐   النصف

☐   لا شيء

💾 We provide rich training and validation datasets (20k MCQs) for fine-tuning LLMs on real-world mirāth cases.

📘 Subtask 2: Islamic Knowledge Assessment

Evaluate LLMs on their understanding of core Islamic sciences (Fiqh, Tafsīr, Ḥadīth, Uṣūl al-Fiqh, etc.). 

📌 Example

 ما مدة المسح على الخفين للمقيم؟

☒ يوم وليلة

☐ ثلاثة أيام بلياليهن

☐ أسبوع كامل 

☐ يومان وليلتان
📚   We provide both questions and source texts that contain the correct answers, enabling participants to implement Retrieval-Augmented Generation (RAG) techniques.  

✨ Why Participate?

✅  Access high-quality datasets for Arabic Islamic Question Answering, suitable for both fine-tuning (Subtask 1) and retrieval-augmented generation (RAG) approaches (Subtask 2).  

✅  Advance the state-of-the-art methods in Islamic sciences   

✅  Present your work at ArabicNLP 2025 @ EMNLP and be part of the growing Islamic AI community.

🚀 How to Participate?

1.  Register! Check all the details on the shared task Website (https://sites.google.com/view/qias2025)!
2. Join our Discussion Group (https://groups.google.com/g/qias2025_shared_task) to follow the discussions and pose any questions about the task.
3. Participation as an academic, industrial, and independent researcher - everyone is welcome!

--
Best regards, 
Qias 2025 Organizing Team