2025 NIST GenAI Code Evaluation Launch

[TrojAI TrojAI]

We are excited to announce the launch of the 2025 NIST GenAI Code Pilot Evaluation! 

This evaluation assesses AI systems’ ability to test the correctness of basic Python code. The goal is to advance Generative AI technologies including Large Language Models (LLMs) in writing effective software tests. More information is available (https://ai-challenges.nist.gov/code). 

We look forward to your participation. Registration and Submissions open on Wednesday July 23, and for more key dates, please see the Schedule (https://ai-challenges.nist.gov/code#tab_schedule).

Contact: gena...@nist.gov