Thanks to everyone and congrats to the winners!

[SaTML 2024 LLMs CTF Announcements]

Dear LLMs CTF participants,

We just published the list of winners on our website. The final results can be seen on the leaderboard.

We hope everyone had fun and learned something about LLM red-teaming. Thanks to all teams for competing!

Attack track:
As expected, all defenses were broken, and most were broken by many teams.

• 1st place: Team WreckTheLine with 42 defenses broken (all but their own);
• 2nd place: Team ¯\_(ツ)_/¯ with 41 defenses broken;
• 3rd place: Team Hestia with 42 defenses broken (all but their own), but with a higher number of interactions.

WreckTheLine prepared well during the Reconnaissance phase, got an early lead by breaking 30+ defenses in the first day of the attack phase, broke all defenses in the first week, and other teams never managed to catch up. Hestia was second for a long time, but ¯\_(ツ)_/¯ made a huge effort to break enough defenses in the last 24 hours of the competition to take the second place.

We’d also like to give honorable mentions to CC Weiss-blau and QCavalry for their late pushes, and Defenseless for a strong start.

Defense track:

• 1st place: Team Hestia with their defenses taking the first and second place, broken a total of 3 times;
• 2nd place: Team RSLLM with their Llama-2-70b-chat defense broken by 5 teams;
• 3rd place: Team WreckTheLine with their Llama-2-70b-chat defense broken by 6 teams.
  

FZI also had their defense broken by 6 teams, but missed the third place on a tie-breaker.
We also thank all other defenses for making the Attack Phase possible!


Teams that won prizes should have received emails from us. We’re organizing an event at SaTML 2024 in Toronto; if anyone’s attending, feel free to come by! Details will be announced soon.