Clarification submission format & deadline inquiry

[Tony Santiago Montes Buitrago]

Hello!

I wanted to double-check the submission format for both tasks, to see if I'm right about the required columns for each file, as the sample_predictions_track1.tsv seems to have all columns filled.

Subtask1:

- Are the only required columns "usage_id", "word" and "sense_id" ?

Subtask2:

- Are the only required columns "usage_id", "word" and "gloss" ?

Also, I wanted to inquire about the possibility of extending the deadline. After discussing with my team, we realized about the shared task only a couple of weeks ago and we are eager to participate. Extending the deadline would really facilitate our involvement in the shared task. Looking forward to your response.

Thanks in advance!

Tony

[Mariia Fedorova]

Hello Tony,

The required columns for the subtask1 are not only "usage_id", "word" and "sense_id", but also "period" and "example" (used for sanity checks).

The example has all columns filled only because the example baseline simply modifies its input file. The columns orth, gloss, indices_target_token and date are not used for the evaluation of the subtask1.

 

The only required columns for the subtask2 are "usage_id", "word" and "gloss". (It is enough to have one gloss per word sense, no matter how many examples were there in the test data).

As for the deadline, unfortunately, the AXOLOTL'24 timeline is pretty tight, and we cannot extend the deadline any more.

However, after April 9, the Codalab competitions will still technically

remain open for submissions, so you will be able to evaluate your system.

You also can submit a paper describing your system to the LChange'24

workshop (https://www.changeiskey.org/event/2024-acl-lchange/,

submission deadline May 10), but you will have to specify that you

participated in the post-evaluation phase only.

Thanks for your interest!

With kind regards, 

Maria.

---

From: axolo...@googlegroups.com <axolo...@googlegroups.com> on behalf of Tony Santiago Montes Buitrago <santiago...@gmail.com>
Sent: 09 April 2024 06:54:48
To: AXOLOTL-24
Subject: [axolotl] Clarification submission format & deadline inquiry

 

--
You received this message because you are subscribed to the Google Groups "AXOLOTL-24" group.
To unsubscribe from this group and stop receiving emails from it, send an email to axolotl-24+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/axolotl-24/bf296745-fc78-417a-b525-9d09627c3244n%40googlegroups.com.

[Tony Santiago Montes Buitrago]

Dear Mariia,

Thanks for your confirmation! I believe we can still deliver our solution by today's deadline.

Best regards,

Tony

To view this discussion on the web visit https://groups.google.com/d/msgid/axolotl-24/8ea1e61741ea4c868e092dfeeafe4584%40ifi.uio.no.