Error on tagging

25 views
Skip to first unread message

hecto...@gmail.com

unread,
Feb 29, 2020, 7:28:09 PM2/29/20
to DeftEval 2020
Hello Sasha!

When I uploaded my answers for the task 2 I got this error message:
  File "/tmp/codalab/tmpcPs3rA/run/program/semeval2020_06_evaluation_main.py", line 68, in main
    task_2_report = task_2_eval_main(ref_path, res_path, output_dir, cfg['task_2']['eval_labels'])
  File "/tmp/codalab/tmpcPs3rA/run/program/evaluation_sub2.py", line 192, in task_2_eval_main
    temp_y_gold, temp_y_pred = get_gold_and_pred_labels(ref_path.joinpath(child.name), child)
  File "/tmp/codalab/tmpcPs3rA/run/program/evaluation_sub2.py", line 135, in get_gold_and_pred_labels
    validate_data(gold_rows, pred_rows)
  File "/tmp/codalab/tmpcPs3rA/run/program/evaluation_sub2.py", line 111, in validate_data
    validate_length(gold_rows, pred_rows)
  File "/tmp/codalab/tmpcPs3rA/run/program/evaluation_sub2.py", line 50, in validate_length
    raise ValueError("Row length mismatch: Pred {} Gold {}".format(len(pred_rows), len(gold_rows)))
ValueError: Row length mismatch: Pred 469 Gold 441

What does this message mean?
is there any way I can submit my answer?

Best,
Héctor.

Sasha Spala

unread,
Feb 29, 2020, 7:32:15 PM2/29/20
to hecto...@gmail.com, DeftEval 2020
Hi Hector,

Looks like you have too many rows in your submission file. Unfortunately the submission window for subtask 1 and 2 closed about 30min ago. Certainly if you’re interested in the task still, you can try your model out on the test set on your own after the evaluation period ends and we release the official results.

Best,
Sasha

On Feb 29, 2020, at 7:28 PM, "hecto...@gmail.com" <hecto...@gmail.com> wrote:


--
You received this message because you are subscribed to the Google Groups "DeftEval 2020" group.
To unsubscribe from this group and stop receiving emails from it, send an email to semeval-2020-task...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/semeval-2020-task-6-all/d3c5b3fa-fb69-43ba-9cec-65581b71bb83%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages