Re: [codalab-competitions] scoring program

[Adrien Pavao]

Hello Jessica,

The scoring program is flexible, and you can simply update it to compute F1 score or another metric.

In order to understand why your submission is failing, you can click on it and explore the different log files, like "error from scoring step", etc.

Example of scoring program:

https://github.com/codalab/competition-examples/blob/master/codabench/mini-automl/bundle/scoring_program/scoring.py

More information about how to update it:

https://github.com/codalab/codabench/wiki/Resource-Management

Tutorial for organizers

https://github.com/codalab/codabench/wiki/Getting-started-with-Codabench

https://github.com/codalab/codabench/wiki/Advanced-Tutorial

If you need more help, please open a Github issue or contact us at in...@codalab.org. The Google group is meant to receive announcements about competitions, benchmarks, conferences and about the platform.

Best regards,

Adrien Pavão

CodaLab Team

On Wed, Apr 30, 2025 at 12:11 AM Jessica Barco <jessb...@gmail.com> wrote:

  Hello everyone!
I'm pretty new to using Codabench, and I don't understand the required format or how I should upload my scoring program for the F1 score. When I tried to test it by submitting a sample, it keeps saying 'Failed', and I don't understand why. My program works fine outside of Codabench.
I'm really sorry if this is an amateurish mistake, but I'm feeling a bit desperate.
Thank you in advance!  

--
You received this message because you are subscribed to the Google Groups "codalab-competitions" group.
To unsubscribe from this group and stop receiving emails from it, send an email to codalab-competit...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/codalab-competitions/4636912a-be49-4edc-998a-abc8563ec84bn%40googlegroups.com.