Results ranking

24 views
Skip to first unread message

MRL 2022

unread,
Aug 30, 2022, 12:38:07 PM8/30/22
to The 1st Shared Task on Multilingual Clause-level Morphology 2022
Dear participants,

We are happy to share the ranking of the systems submitted to the MRL shared task.
As a reminder, for the inflection and reinflection tasks the metric edit distance, and for analysis the metric is averaged F1 score with the lemma being treated as an upweighted feature.

Task 1 - inflection:
  1. KUIS-AI - 0.266
  2. UBC - 0.496
  3. mT5 baseline - 2.577
  4. transformer baseline - 3.278
Task 2 - reinflection:
  1. KUIS-AI - 0.560
  2. UBC - 0.982
  3. mT5 baseline - 2.826
  4. transformer baseline - 4.642
Task 3 - analysis
  1. KUIS-AI - 0.950
  2. Göttingen - 0.940
  3. UBC - 0.914
  4. mT5 baseline - 0.845
  5. transformer baseline - 0.800
Reply all
Reply to author
Forward
0 new messages