Invitation to the First AI for Finance Lab at CLEF – FinMMEval 2026 Training Set Now Available

21 views

Skip to first unread message

Jimin Huang

unread,

Dec 15, 2025, 9:29:10 AM (4 days ago) Dec 15

to AI in Finance Worldwide

Dear colleagues,

We are delighted to announce the launch of FinMMEval Lab 2026, the first AI for Finance lab ever introduced at CLEF. This marks a significant milestone for the community. CLEF has a long history of multilingual and multimodal evaluation campaigns, but until now there has not been a dedicated benchmark designed specifically to evaluate AI systems operating in financial domains. FinMMEval fills that gap by providing a unified, carefully curated evaluation suite that reflects real-world financial reasoning challenges.

Why This Lab Matters

Financial environments are multilingual, information rich, and decision driven. Systems must integrate knowledge from regulatory filings, corporate disclosures, evolving news cycles, and market context. FinMMEval addresses this need by introducing three interconnected tasks that stress test AI models across reasoning, comprehension, and decision-making ability.

What Is Included

The training set is now available, and teams may begin developing systems immediately. The released datasets include:

• Exam-style financial MCQ across multiple languages, covering accounting, valuation, ethics, and regulation
• Multilingual Q&A over regulatory filings and news, integrating high-context, multi-source financial text
• Buy / Hold / Sell daily decision making, using BTC and TSLA with real market fluctuations

Each dataset comes with detailed documentation, consistent formatting, licensing guidance, and recommended citation practices. Splits are designed to support robust, comparable experiments.

Why You Are Invited

As the inaugural CLEF AI for Finance lab, FinMMEval aims to set a foundation for how we evaluate financial AI systems moving forward. Your participation will help shape the standards, methodologies, and research directions for this emerging area. We warmly welcome academic labs, industry research groups, student teams, and independent researchers.

Where to Begin

Official website (task descriptions, data access, registration):
https://mbzuai-nlp.github.io/CLEF-2026-FinMMEval-Lab/

Community Discord (technical questions, clarifications, discussion):
https://discord.gg/Neb8MGCB

We hope you will join us for this first edition and contribute to building the future of AI for Finance evaluation.