How to access the fact sheet responses in the scorer?

6 views
Skip to first unread message

Johann Petrak

unread,
Apr 5, 2024, 7:39:59 AMApr 5
to codalab-competitions
I have a codabench project where people are supposed to upload
a simple file with predictions which then gets scored by our scorer program.
In addition to the uploaded data, people also have to fill out the
data specified in the fact sheet.
However, when the scorer is run, I cannot see the fact sheet information
being available anywhere ... how can the scorer access this information ?

Also, is there no way to allow participants to upload just a single
non-zip file, e.g. a small tsv file? Having to zip that up looks a bit like
an unnecessary additional step in some situations where there is just
a single small file to be uploaded?
I tried this with a small file.tsv file and the upload seemed to hang and
never complete in the "my submissions" tab. Nothing shows up under
"Submissions" for the project afterwards and there is no error report
or other feedback.

Cheers,
   Johann
Reply all
Reply to author
Forward
0 new messages