Release evaluation script and updated gold standard data files

1 view
Skip to first unread message

Els

unread,
Jan 20, 2010, 7:50:43 AM1/20/10
to SemEval2010_Cross-Lingual Word Sense Disambiguation
Hi all,

you can find at
http://lt3.hogent.be/semeval/Trial/

- evaluation script for the task: ScorerTask3.pl
The command for running this script:

perl ScorerTask3.pl system_file gold_standard_file -t [best / oof] -
t v

There is more detailed information about the evaluation and use
of the script in the updated version of the documentation
(Task3_doc.pdf).

- You also need to use the updated version of the gold standard files,
that are now split up by language (trial_gold_<language>.zip).

All the best,
Els

Maarten van Gompel

unread,
Jan 20, 2010, 10:28:36 AM1/20/10
to cross-li...@googlegroups.com
Els a �crit :

> Hi all,
>
> you can find at
> http://lt3.hogent.be/semeval/Trial/
>
> - evaluation script for the task: ScorerTask3.pl

Hi Els,

Thanks for the scorer and gold standards! Will a baseline against which
the trial data can be tested be published as well?

Regards,

--

Maarten van Gompel (Proycon)
Induction of Linguistic Knowledge Research Group, University of Tilburg

pro...@anaproy.nl
pro...@unilang.org

--------------------------------------------------------------------------
Personal Homepage: http://proycon.anaproy.nl
UniLang Language Community: http://www.unilang.org
--------------------------------------------------------------------------
JABBER: maar...@luon.net, AIM: proycon, YAHOO: proycon
MSN: pro...@anaproy.nl
--------------------------------------------------------------------------

Reply all
Reply to author
Forward
0 new messages