what is the relationship between http://visualcommonsense.com/explore/?im=2518 and https://leaderboard.allenai.org/vcr/submissions/get-started

39 views
Skip to first unread message

牛国成

unread,
May 10, 2021, 9:44:25 AM5/10/21
to Visual Commonsense Reasoning
what is the relationship between http://visualcommonsense.com/explore/?im=2518 and https://leaderboard.allenai.org/vcr/submissions/get-started ?
 
Is it the same dataset?

Rowan Zellers

unread,
May 10, 2021, 10:44:14 AM5/10/21
to Visual Commonsense Reasoning
hey! Sorry for the confusion, visualcommonsense.com/leaderboard is the official VCR leaderboard, and https://leaderboard.allenai.org/vcr/submissions/get-started is the leaderboard for the DARPA Machine Commonsense Program (which requires a separate leaderboard). The test sets are disjoint. If you're submitting I'd recommend the visualcommonsense.com/leaderboard leaderboard. thanks!

Rowan
Reply all
Reply to author
Forward
0 new messages