Eval on dev set via codalab: 'Invalid bundle_spec' ?

29 views
Skip to first unread message

sherman...@gmail.com

unread,
Mar 11, 2020, 1:45:02 PM3/11/20
to SQuAD - The Stanford Question Answering Dataset
Hi there. I'm following the tutorial for codalab submission (https://worksheets.codalab.org/worksheets/0x8212d84ca41c4150b555a075b19ccc05/), however when I try to run the command, cl macro squad-utils/dev-evaluate-v2.0 <name-of-your-uploaded-prediction-bundle>
I get the following message within the codalab in-browser terminal:  b' Invalid bundle_spec: <sherman6-bertsquad1>'

I also tried uploading the robinjia example, and I got the same message.  
I also tried 'cl wperm . squad all', to add all permissions for 'squad', and 'cl macro squad-utils/dev-evaluate-v2.0 <submission.json>' (the name of the json file, instead of the worksheet, which is 'sherman6-bertsquad1'), but I got the same message. 

Can you help?

Thanks,
Sherman

...


Reply all
Reply to author
Forward
0 new messages