[CFP] ML Reproducibility Challenge 2025

[Koustuv Sinha]

Hi all,

We are excited to announce the 8th iteration of the Machine Learning Reproducibility Challenge, MLRC 2025, which will also be the first, in-person conference, hosted at Princeton University, New Jersey, USA on August 21st, 2025. The Machine Learning Reproducibility Challenge (MLRC 2025) encourages the community to investigate the reproducibility, replicability and generalisability of published claims in top conferences in the literature.

We are now inviting submissions which conduct novel, unpublished research of reproducibility of machine learning methods and literature, including but not limited to :

• Methods and tools to foster reproducibility research in Machine Learning
• Generalisability of published claims: novel insights and results beyond what was presented in the original paper, from any paper (or set of papers) published in top ML conferences and journals.
• Meta-reproducibility studies on a set of related papers.
• Meta analysis on the state of reproducibility in various subfields in Machine Learning.

Submissions must be first accepted at TMLR to be considered in the MLRC 2025 Proceedings. Please read the author guidelines and submission guidelines from TMLR to get the submission format and to understand more about the reviewing process. Existing papers related to the scope (with reproducibility certification) already published at TMLR are also welcome for the consideration of the committee. Please read our announcement blog post for more information.

Important Dates

• Deadline to share your intent to submit a TMLR paper to MLRC: February 21st, 2025
• Cutoff deadline for receiving TMLR decisions: June 20th, 2025
• Deadline for announcing accepted papers: June 27th, 2025
• Conference day: August 21st, 2025 at Princeton University, NJ, USA

Please follow our website and social media (Twitter-X , BlueSky) for updates regarding the conference agenda, registration, invited talks etc.

Best regards,

Koustuv Sinha
General Chair, MLRC 2025