Error & 0.0 Score

16 views
Skip to first unread message

Tahere Abbasi

unread,
Jan 29, 2026, 11:23:16 AM (13 days ago) Jan 29
to semeval-2026-task-1-humor-gen

,

I am writing on behalf of Team [AZ] regarding our submission for Task A.

We are consistently receiving a score of 0.0 on CodaBench, despite our best efforts to match the required ID format (e.g., en_0001) and file structure.

Critically, our team is based in Iran. We are currently dealing with severe internet instability and restricted access, which makes iterative debugging and re-uploading extremely difficult and slow for us.

Given these connection constraints, could you please:

  1. Check the attached file and advise why it might be triggering a zero score?

  2. Or consider granting us a short extension to finalize the upload?

We have attached our correct submission file (submission_CORRECTED_IDs.zip) to this email.

Thank you for your understanding.

Luis Chiruzzo - Inco

unread,
Jan 29, 2026, 11:44:55 AM (13 days ago) Jan 29
to Tahere Abbasi, semeval-2026-task-1-humor-gen
Hi,

Have you seen that you can obtain information about what went wrong in the evaluation by looking at the logs of the submission?

Here's an example of one of your logs, in this case the log for task-a-en:
image.png

It seems that you are submitting a file with 1200 entries while the expected is 300 entries. It probably means that you are submitting jokes generated for the "evaluation trial" phase, instead of the evaluation phase which only has 300 entries per task.

Please let me know if that helps you fix the problem.

Regards,
Luis


--
You received this message because you are subscribed to the Google Groups "semeval-2026-task-1-humor-gen" group.
To unsubscribe from this group and stop receiving emails from it, send an email to semeval-2026-task-1-...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/semeval-2026-task-1-humor-gen/a3a80fc5-f433-4156-8831-de5711b41b91n%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages