Model Descriptions Before Paper Submission

48 views
Skip to first unread message

Reinald Kim Amplayo

unread,
Feb 10, 2019, 9:48:49 AM2/10/19
to SemEval 2019: Task 9
Dear Task Organizers,

Are we able to get hold of all model descriptions before we submit the paper? I am specifically curious on how teams performed much better on Task B than on Task A, especially since we are only given training data for Task A and none for Task B.

It would help in the paper writing if we know beforehand (A) how many of the teams used external data as additional training data in an allowed manner (e.g. machine-annotated suggestions training data for the hotels domain), (B) how complicated or simple are the team models, and so on.

Thanks!

Sincerely,
Reinald Kim

Sapna Negi

unread,
Feb 10, 2019, 10:47:51 AM2/10/19
to Reinald Kim Amplayo, SemEval 2019: Task 9
Hi Reinald

We will make an effort to provide this information before the system papers' deadline. 
This kind of analysis is typical in the task description papers and not so common in individual system papers. We will include it in the task description paper anyways, and there is an option to add it in your camera ready versions later.

Regards
Organisers

--
You received this message because you are subscribed to the Google Groups "SemEval 2019: Task 9" group.
To unsubscribe from this group and stop receiving emails from it, send an email to semeval-2019-ta...@googlegroups.com.
To post to this group, send email to semeval-2...@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/semeval-2019-task-9/c702aa62-1182-4ffa-a383-eb50e9573c9e%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply all
Reply to author
Forward
0 new messages