Gold Standard of Testset

[Leixin Zhang]

Dear organisers,

Could you update the dataset with the test-set gold standard released on the GitHub repo? We tried more methods and the results will be interesting to show method comparison in the system description paper.  Could we have your support on it?

Thanks a lot in advance.

Best,

Leixin

[Andrey Kutuzov]

Dear Leixin,

Yes, the gold test sets will be published in the next few days.

> --
> You received this message because you are subscribed to the Google
> Groups "AXOLOTL-24" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to axolotl-24+...@googlegroups.com
> <mailto:axolotl-24+...@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/axolotl-24/CAFaFujF78wT3VUw2tDXMDPa1SAs%3DGZPjAmYUMpBd-dZLZ9T24A%40mail.gmail.com <https://groups.google.com/d/msgid/axolotl-24/CAFaFujF78wT3VUw2tDXMDPa1SAs%3DGZPjAmYUMpBd-dZLZ9T24A%40mail.gmail.com?utm_medium=email&utm_source=footer>.

--
Andrey
Language Technology Group (LTG)
University of Oslo

[Mariia Fedorova]

Dear participants,

we have created post-evaluation competition instances:

- https://codalab.lisn.upsaclay.fr/competitions/18570 for the 1st subtask

- https://codalab.lisn.upsaclay.fr/competitions/18572 for the 2nd subtask

So it is possible again to evaluate your predictions on the test dataset, the results will be kept separately from those obtained before the deadline.

We will also publish the gold answers this week.

With kind regards,

Maria F.

---

From: axolo...@googlegroups.com <axolo...@googlegroups.com> on behalf of Andrey Kutuzov <and...@ifi.uio.no>
Sent: 15 April 2024 17:33:53
To: axolo...@googlegroups.com
Subject: Re: [axolotl] Gold Standard of Testset

 

To unsubscribe from this group and stop receiving emails from it, send an email to axolotl-24+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/axolotl-24/360ce23c-173f-4b07-a5ba-bb8aa8829d4b%40ifi.uio.no.

[Mariia Fedorova]

Dear participants, 

The gold answers are now added to the corresponding language directories at https://github.com/ltgoslo/axolotl24_shared_task/tree/main/data  (we have also updated the data README by double checking numbers of new and old usages in each dataset and adding data source citations). 

With kind regards,

Maria

---

From: axolo...@googlegroups.com <axolo...@googlegroups.com> on behalf of Andrey Kutuzov <and...@ifi.uio.no>
Sent: 15 April 2024 17:33:53
To: axolo...@googlegroups.com
Subject: Re: [axolotl] Gold Standard of Testset

 

To unsubscribe from this group and stop receiving emails from it, send an email to axolotl-24+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/axolotl-24/360ce23c-173f-4b07-a5ba-bb8aa8829d4b%40ifi.uio.no.