Last call: ImageEval 2026 shared task at ArabicNLP

10 views

Skip to first unread message

hunzalah

unread,

Aug 2, 2026, 7:41:30 AM (4 days ago) Aug 2

to SIGARAB: Special Interest Group on Arabic Natural Language Processing

Assalamoalikum, Hello SIGARAB,

A final call to join ImageEval 2026: Cultural Grounding in Arabic Multimodal Generation and Understanding, a shared task at ArabicNLP 2026. Individual participants and teams are both welcome.

Task 1, AynVQA. 18 MENA countries, English and MSA:

1a, spoken image QA: answer culturally grounded questions that are asked aloud about an image
1b, hallucination in image QA: Spot which statements about an image are actually grounded

Task 2, CRAI-Bench. Evaluate AI-generated Arabic text-to-image outputs across five cultural dimensions, scored against human ratings.

Dates (AoE)
Test phase closes: 7 August 2026
System papers due: 19 August 2026

Website: https://imageeval2026.github.io/

Data | Baselines and scorers

Codabench 1a EN · 1a MSA · 1b EN · 1b MSA · Task 2
Slack

Colab baselines are ready to run, so a first submission takes very little setup.

Feel free to email me for any questions.

Best regards,
The ImageEval 2026 organizers