Scorer

[Maarten van Gompel]

Hi Els, Veronique,

I was wondering whether the scorer for the cross-lingual WSD task has
been released already? I have not been able to find it yet. I assume
that the scorer will be a slightly different one from the one used in
the cross-lingual lexical substitution task, considering the small
subtle differences between the output formats?

Regards,

--

Maarten van Gompel (Proycon),
Induction of Linguistic Knowledge research group, University of Tilburg

pro...@anaproy.nl
pro...@unilang.org

--------------------------------------------------------------------------
Personal Homepage: http://proycon.anaproy.nl
UniLang Language Community: http://www.unilang.org
--------------------------------------------------------------------------
JABBER: maar...@luon.net, AIM: proycon, YAHOO: proycon
MSN: pro...@anaproy.nl
--------------------------------------------------------------------------

[Els]

Hi Maarten,

thanks for your email.
The scorer will indeed be a modified version of the one that is used
for the cross-lingual lexical substitution task.
I will release a first version of it one of the following days
(one that uses the same evaluation metrics as for the lexical
substitution,
but can handle our input format).

A second release of the scorer (planned for february)
will also contain a part that evaluates the gold standard clusters
(and not only the gold standard translations that have been
chosen by the annotators).

I will post a message as soon as the first version
of the scorer is available.

Best regards,
Els

On Jan 13, 12:05 pm, Maarten van Gompel <proy...@anaproy.nl> wrote:
> Hi Els, Veronique,
>
> I was wondering whether the scorer for the cross-lingual WSD task has
> been released already? I have not been able to find it yet. I assume
> that the scorer will be a slightly different one from the one used in
> the cross-lingual lexical substitution task, considering the small
> subtle differences between the output formats?
>
> Regards,
>
> --
>
> Maarten van Gompel (Proycon),
>   Induction of Linguistic Knowledge research group, University of Tilburg
>

> proy...@anaproy.nl
> proy...@unilang.org

>
> --------------------------------------------------------------------------
> Personal Homepage:        http://proycon.anaproy.nl
> UniLang Language Community:    http://www.unilang.org
> --------------------------------------------------------------------------

> JABBER: maarte...@luon.net, AIM: proycon, YAHOO: proycon
> MSN: proy...@anaproy.nl
> --------------------------------------------------------------------------