First call for papers: The fourth Generation, Evaluation & Metrics Workshop

[Simon Mille]

Dear GEM enthusiasts,

The fourth iteration of the GEM workshop will be held as part of ACL, July 27–August 1st, 2025. This year we’re planning a major upgrade to the workshop, which we dub GEM2, through the introduction of a large dataset of 1B model predictions together with prompts and gold standard references, encouraging researchers from all backgrounds to submit work on meaningful, efficient and robust evaluation of LLMs. Please check the GEM website for more details! 

Important Dates

• April 11: Direct paper submission deadline (ARR).

• May 5: Pre-reviewed (ARR) commitment deadline.

• May 19: Notification of acceptance.

• June 6: Camera-ready paper deadline.

• July 7: Pre-recorded videos due.

• July 31 - August 1: Workshop at ACL in Vienna.

best,

simon

ADAPT Research Centre / Ionaid Taighde ADAPT

School of Computing, Dublin City University, Glasnevin Campus / Scoil na Ríomhaireachta, Campas Ghlas Naíon, Ollscoil Chathair Bhaile Átha Cliath