Error in gold standard bundled with the scorer

11 views
Skip to first unread message

Ravi Sinha

unread,
Feb 28, 2012, 11:42:10 AM2/28/12
to SemEval2012_LexicalSimplification
Hi all,
I would like to point out that I was getting an error using the
scorer, if I used the gold standard that comes bundled up with the
scorer, and the error was a key-error, saying 'ascertain' wasn't found
in the gold. I checked, and indeed on line 79 ascertain is spelled as
'ascertail'. However, the other gold standard that's packaged with the
trial data does not have this problem, and works.

This might be related to the spelling mistakes pointed out earlier,
but it wasn't pointed out that the gold file in the test-script
package was still the older one.

Thanks,
Ravi

Lucia Specia

unread,
Mar 2, 2012, 11:01:04 AM3/2/12
to semeval2012_lexi...@googlegroups.com
Dear Ravi,

We had corrected these and other spelling issues in the 'official'
gold-standard file, but not in the example gold-standard file
distributed with the scorer (which is in fact the same data, but the
old version of it). I've uploaded a new test-script.zip with the
correct version of the gold-standard, please use that one.

Best,

Lucia

Reply all
Reply to author
Forward
0 new messages