Round6 Is Now Live

[TrojAI]

Hello TrojAI participants,

Round6 is now open on the leaderboard:
https://pages.nist.gov/trojai/

Links to the data download will be posted to
https://pages.nist.gov/trojai/docs/data.html#round-6
over the coming week.

Round6 (like Round5) is based on the natural language processing task Sentiment Classification. The source datasets have changed slightly, and there is an expanded pool of model architecture configurations.

Refer to the Round 6 data page for more details.

If you have not submitted a container to the TrojAI evaluation system in awhile, please consider doing so.

We look forward to seeing everyone's performance on the Round5 data.

Good luck trojan finding.

Regards,
The TrojAI Team

[TrojAI]

A bug in the Round6 dataset has been discovered. While it is being fixed the leaderboard has been taken back offline. The STS has been left live to allow debugging solutions against the test server.

The fix has been identified, and new models are being generated right now. So hopefully the Round6 delay will be minimal.

An announcement will be posted here when Round6 is once again live on the leaderboard.

[TrojAI]

The Round6 dataset bug has been fixed. New versions of the training dataset have been released and the evaluation dataset on the leaderboard has been updated.

The Leaderboard is once again live for Round6.