TDC 2023 Update: Test phase leaderboards are now available (and other information)

14 views
Skip to first unread message

Mantas Mazeika

unread,
Dec 18, 2023, 1:59:47 AM12/18/23
to tdc2023-updates
Hello,

The test phase leaderboards and winning teams are now available at https://trojandetection.ai/leaderboards

The CodaLab leaderboards have also been made public (for the Trojan Detection Track, the ranking is the same as on the competition website; for the Red Teaming Track, the leaderboards on the website use the manual evaluation scores to determine the final rankings for the top-10 teams).

If you would like a team name to be added to the CodaLab leaderboards, you can do so in the settings page for your CodaLab account. If you would like a team name to be added to the website leaderboards (or if you would like to change your team name), please email the organizers.

Competition Workshop and Summary Publication
The competition workshop was held on December 16 at NeurIPS and included talks from the first-place teams describing their methods. We will share the recording of the competition workshop as soon as it's available (hopefully in the next month). Descriptions of winning methods will also be in the competition summary publication, which will be in the NeurIPS 2024 proceedings.

Data Release
We plan to release the held-out data and classifiers (ground-truth triggers and behavior classifiers) in the next week.

All the best,
Mantas (TDC co-organizer)
Reply all
Reply to author
Forward
0 new messages