Round6 Is Now Live

Skip to first unread message


Mar 22, 2021, 4:28:30 PM3/22/21
to trojai-community
Hello TrojAI participants,

Round6 is now open on the leaderboard:

Links to the data download will be posted to
over the coming week.

Round6 (like Round5) is based on the natural language processing task Sentiment Classification. The source datasets have changed slightly, and there is an expanded pool of model architecture configurations.

Refer to the Round 6 data page for more details.

If you have not submitted a container to the TrojAI evaluation system in awhile, please consider doing so.

We look forward to seeing everyone's performance on the Round5 data.

Good luck trojan finding.

The TrojAI Team


Mar 22, 2021, 7:23:38 PM3/22/21
to trojai-community, TrojAI .
A bug in the Round6 dataset has been discovered. While it is being fixed the leaderboard has been taken back offline. The STS has been left live to allow debugging solutions against the test server.

The fix has been identified, and new models are being generated right now. So hopefully the Round6 delay will be minimal.

An announcement will be posted here when Round6 is once again live on the leaderboard.


Mar 24, 2021, 12:30:27 PM3/24/21
to trojai-community, TrojAI .
The Round6 dataset bug has been fixed. New versions of the training dataset have been released and the evaluation dataset on the leaderboard has been updated.

The Leaderboard is once again live for Round6.
Reply all
Reply to author
0 new messages