Second Call for Participation: ImageEval 2026 Shared Task at ArabicNLP 2026

23 views

Skip to first unread message

Firoj Alam

unread,

Jul 22, 2026, 12:28:48 PM (7 days ago) Jul 22

to ml-...@googlegroups.com

Dear Colleagues,

Apologies for cross posting!

We are pleased to invite researchers and practitioners to participate in ImageEval 2026: Cultural Grounding in Arabic Multimodal Generation and Understanding, a shared task organized as part of ArabicNLP 2026, co-located with EMNLP 2026.

ImageEval 2026 focuses on Arabic language varieties and culturally specific visual content from the MENA region. The shared task provides dedicated tracks for building, evaluating, and comparing multimodal systems on culturally grounded Arabic image understanding and generation.

The shared task includes two tracks:

Task 1: Culturally Grounded Arabic Visual Question Answering and Hallucination Detection
Task 2: Cultural Accuracy Evaluation for Text-to-Image Generation

Participants are invited to develop systems, submit predictions, and write system description papers for inclusion in the ArabicNLP 2026 proceedings.

Registration:
- Spoken VQA (1a) English: https://www.codabench.org/competitions/17049/

- Spoken VQA (1a) MSA: https://www.codabench.org/competitions/17048/

- Hallucination (1b) English: https://www.codabench.org/competitions/17051/

- Hallucination (1b) MSA: https://www.codabench.org/competitions/17050/

- CRAI-Bench: https://www.codabench.org/competitions/16944/

Website: http://imageeval2026.github.io/
Data/Code and baseline scripts: https://github.com/ImageEval2026/ImageEval2026-tasks

Join on slack channel: https://join.slack.com/t/mm-eval/shared_invite/zt-3bnucib8h-YSHi512GQ9cvQUhiQe2Z4w

Extended deadlines

August 2, 2026 Registration deadline and beginning of the evaluation cycle (test sets release).
August 7, 2026 End of the evaluation cycle (run submission).
August 9, 2026 Release leaderboard.
August 19, 2026 Shared task papers due date.
August 30, 2026 Notification of acceptance.
September 10, 2026 Camera-ready papers due.
October 24–29, 2026 ArabicNLP conference.

We warmly encourage participation from the NLP, multimodal AI, computer vision, and Arabic language technology communities.

Please feel free to share this call with colleagues, students, and researchers who may be interested.