Subtask 2 submission error

29 views
Skip to first unread message

Aadarsh Singh

unread,
Feb 29, 2020, 3:58:25 PM2/29/20
to semeval-202...@googlegroups.com
What do we have to do with the unevaluated tags for the subtask 2? The submission throws an exception if there are any unevaluated tags in the submission files. - ValueError: Encountered unknown or unevaluated label: B-Definition-frag

Thanks and Regards.
User Id - paradoxlover

Sasha Spala

unread,
Feb 29, 2020, 4:15:50 PM2/29/20
to Aadarsh Singh, semeval-202...@googlegroups.com
Looks like you’ve predicted a definition fragment, though we are not evaluating on any fragments. You will need to rerun your model to only predict the evaluated labels.

Best,
Sasha


On Feb 29, 2020, at 3:58 PM, Aadarsh Singh <asingh...@outlook.com> wrote:


What do we have to do with the unevaluated tags for the subtask 2? The submission throws an exception if there are any unevaluated tags in the submission files. - ValueError: Encountered unknown or unevaluated label: B-Definition-frag

Thanks and Regards.
User Id - paradoxlover

--
You received this message because you are subscribed to the Google Groups "DeftEval 2020" group.
To unsubscribe from this group and stop receiving emails from it, send an email to semeval-2020-task...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/semeval-2020-task-6-all/SL2PR01MB2842FCACDB5633114588DF19CFE90%40SL2PR01MB2842.apcprd01.prod.exchangelabs.com.
Reply all
Reply to author
Forward
0 new messages