Error during evaluation for Subtask1

[alia...@gmail.com]

Hey dear organizers,

We are trying to submit our result for subtask1, but we got this error twice.

"""

WARNING: Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap.
Traceback (most recent call last):
  File "/tmp/codalab/tmprS_RZF/run/program/semeval2020_06_evaluation_main.py", line 83, in <module>
    main(cfg)
  File "/tmp/codalab/tmprS_RZF/run/program/semeval2020_06_evaluation_main.py", line 62, in main
    task_1_report = task_1_eval_main(ref_path, res_path, output_dir, cfg['task_1']['eval_labels'])
  File "/tmp/codalab/tmprS_RZF/run/program/evaluation_sub1.py", line 184, in task_1_eval_main
    temp_y_gold, temp_y_pred = get_gold_and_pred_labels(ref_path.joinpath(child.name), child)
  File "/tmp/codalab/tmprS_RZF/run/program/evaluation_sub1.py", line 117, in get_gold_and_pred_labels
    validate_data(gold_rows, pred_rows)
  File "/tmp/codalab/tmprS_RZF/run/program/evaluation_sub1.py", line 96, in validate_data
    validate_sents(gold_rows, pred_rows)
  File "/tmp/codalab/tmprS_RZF/run/program/evaluation_sub1.py", line 68, in validate_sents
    raise ValueError("Sentence mismatch row {}: Pred {} Gold {}".format(row_index, pred_sent, gold_sent))
ValueError: Sentence mismatch row 2: Pred  As temperatures and average energies decrease with expansion , the universe reaches the stage where average particle separations are large enough to see differences between the strong and electroweak forces ( at about 10 − 35 s 10 − 35 s size 12 {  10 " rSup { size 8 { - " 35 " } } ` s } { } ) ." Gold  As temperatures and average energies decrease with expansion , the universe reaches the stage where average particle separations are large enough to see differences between the strong and electroweak forces ( at about 10 − 35 s 10 − 35 s size 12 { " 10 " rSup { size 8 { - " 35 " } } ` s } { } ) .

"""

Above pred and gold sentence different with just a double quote, as we see.
And below is our output line for this sentence.
" As temperatures and average energies decrease with expansion , the universe reaches the stage where average particle separations are large enough to see differences between the strong and electroweak forces ( at about 10 − 35 s 10 − 35 s size 12 { " 10 " rSup { size 8 { - " 35 " } } ` s } { } ) ."	"0"

Sincerely,
Ali

[alia...@gmail.com]

And this is the sentence's place:

"task_1_t3_physics_2_202.deft"

Thx

[Shelan Sabah]

Hi Ali,

Have you managed to solve this error? as I have got it right now and don't know how to fix it.

Regards,

Shelan

[alia...@gmail.com]

Hey Shelan,

As Sasha suggest via e-mail, we removed quotes which before and after the sentence.

Hope it works for you too.

Sincereley,
Ali

[alia...@gmail.com]

And the problem is solved with this way.