Question about gold standard of track4b?

40 views
Skip to first unread message

Jérémy Ferrero

unread,
Feb 14, 2017, 10:15:21 AM2/14/17
to STS SemEval
Dear STS Organizers,

Thank you for releasing the gs.
but I have a question: why the gold standard of the track4b are integers while those of the other tracks are decimals?

Thank you.

Eneko

unread,
Feb 14, 2017, 10:22:43 AM2/14/17
to STS SemEval

The gold standard of 4b had a single annotator. The rest of the gold standards had more annotators, and the gold standard number is the mean of the annotators.
Reply all
Reply to author
Forward
0 new messages