No results
25 views
Skip to first unread message
Bouchekif Abdessalam
May 25, 2025, 12:59:41 PMMay 25
to codalab-competitions
Dear Codabench team,
I'm encountering a critical issue with my competition setup on Codabench.
Initially, my submissions were instantly marked as Finished, without any logs (stdout, stderr) or scores appearing — as if the scoring script wasn't executed at all.
To debug, I modified my score.py to include this forced error at the top:
raise RuntimeError("🔥 This is a test error to check if Codabench runs this script.")
After this change, submissions no longer go straight to Finished, but instead remain indefinitely in the Scoring state — and still no logs are shown.
This strongly suggests that the scoring environment is either not launching, or silently failing to execute the script.
To summarize:
- score.py is correctly placed under scoring_program/
- competition.yaml includes scoring_program: under each task, not in the phase
- The script works fine locally and produces valid output (scores.txt)
- Leaderboard keys match (accuracy_task1, accuracy_task2)
- Submission is a valid .xlsx file named task1_exemple.xlsx
Could you please check if the sandbox is stuck or failing silently during execution?
Thank you for your help,
Abdesselam Bouchekif
I'm encountering a critical issue with my competition setup on Codabench.
Initially, my submissions were instantly marked as Finished, without any logs (stdout, stderr) or scores appearing — as if the scoring script wasn't executed at all.
To debug, I modified my score.py to include this forced error at the top:
raise RuntimeError("🔥 This is a test error to check if Codabench runs this script.")
After this change, submissions no longer go straight to Finished, but instead remain indefinitely in the Scoring state — and still no logs are shown.
This strongly suggests that the scoring environment is either not launching, or silently failing to execute the script.
To summarize:
- score.py is correctly placed under scoring_program/
- competition.yaml includes scoring_program: under each task, not in the phase
- The script works fine locally and produces valid output (scores.txt)
- Leaderboard keys match (accuracy_task1, accuracy_task2)
- Submission is a valid .xlsx file named task1_exemple.xlsx
Could you please check if the sandbox is stuck or failing silently during execution?
Thank you for your help,
Abdesselam Bouchekif
Reply all
Reply to author
Forward
This conversation is locked
You cannot reply and perform actions on locked conversations.
0 new messages