Errors at Codalab submissions for the test tests

[Денис Кокосинский]

Hello!

I was trying to submit predictions for the test sets, but consistently get the following error

WARNING: Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap. /tmp/codalab/tmptO98Hc/run/program/scorer_track1.py:7: DeprecationWarning: Pyarrow will become a required dependency of pandas in the next major release of pandas (pandas 3.0), (to allow more performant data types, such as the Arrow string type, and better interoperability with other libraries) but was not found to be installed on your system. If this would cause problems for you, please provide us feedback at https://github.com/pandas-dev/pandas/issues/54466 import pandas as pd 2024-04-08 13:54:59,965 : INFO : Expecting files named ('track1_test_ru.tsv', 'track1_test_fi.tsv', 'track1_test_surprise.tsv') Traceback (most recent call last): File "/tmp/codalab/tmptO98Hc/run/program/scorer_track1.py", line 52, in assert ( AssertionError

We have double checked that the filenames in the submitted .zip archive (we submit predictions on all 3 languages) are correct. We have also submitted dev set predictions without any issues. The output of the script in Codalab is quite limited, could you please check what is wrong? What filenames are actually used? I'm from team "deep-change".

Best regards,
Denis Kokosinskii

[Mariia Fedorova]

Hello Denis,

sorry for the misleading error message, in fact the error is produced by the check that the examples in the gold and predicted data are equal (its purpose is to ensure that everyone uses the most recent data version). Did you pull the updates we made today?

With kind regards,

Maria

---

From: axolo...@googlegroups.com <axolo...@googlegroups.com> on behalf of Денис Кокосинский <deniskok...@gmail.com>
Sent: 08 April 2024 16:15:36
To: AXOLOTL-24
Subject: [axolotl] Errors at Codalab submissions for the test tests

 

--
You received this message because you are subscribed to the Google Groups "AXOLOTL-24" group.
To unsubscribe from this group and stop receiving emails from it, send an email to axolotl-24+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/axolotl-24/21c13255-7807-4d23-b287-62439226f112n%40googlegroups.com.

[Mariia Fedorova]

(To be precise: expected filenames are always logged, if some of them are not found, this language is just skipped).

---

From: axolo...@googlegroups.com <axolo...@googlegroups.com> on behalf of Денис Кокосинский <deniskok...@gmail.com>
Sent: 08 April 2024 16:15:36
To: AXOLOTL-24
Subject: [axolotl] Errors at Codalab submissions for the test tests

 

[Денис Кокосинский]

Yes, the recent updates to the Russian test set were indeed the cause of the issue, thank you!

Best regards,
Denis Kokosinskii

пн, 8 апр. 2024 г. в 17:41, Mariia Fedorova <mar...@ifi.uio.no>:

To view this discussion on the web visit https://groups.google.com/d/msgid/axolotl-24/b6d8b6894be644bf8ff3de59a3d1fbf8%40ifi.uio.no.