Q-A accuracy

47 views

Skip to first unread message

Ali TT

unread,

Jun 19, 2020, 8:33:31 AM6/19/20

to Visual Commonsense Reasoning

Hi,

I tried to run the code again. I didn't change anything except I used one GPU and one CPU, I got final accuracy 61.9%, I checked the paper, the result is 63.8%. I use different version of torchvision and allennlp. I'm not sure is this the reason why I got a different result? But if I downloade your best.th and I got evaluation result 64.0%.

Thanks

Xuejiao

rowan....@gmail.com

unread,

Jun 19, 2020, 11:45:48 PM6/19/20

to Visual Commonsense Reasoning

hey Xuejiao,

I think the issue might be if you use one GPU (rather than the three I used), your batch size might be lower. hope that helps! thanks,