Test dataset labels and submission guidelines

[Sapna Negi]

Dear participants

We will be providing an on-demand access to test datasets labels, restricted to the teams/participants who have made submissions to the evaluation phase, and have registered on softconf.

If you would like to be included in the list of recipients,  please reply to this email providing the following details:

1. Your team name, and the account name with which you made the evaluation phase submission on CodaLab.

2. Make a 'Trial' system description paper submission to the track and provide us the Softconf id of the lead /submitting author.

http://alt.qcri.org/semeval2019/index.php?id=papers

Paper submission guidelines

The generic semeval guidelines and template are posted here:

http://alt.qcri.org/semeval2019/index.php?id=papers

- You will be asked to review other system description papers between Feb 24 and Mar 16, like other participants will review yours. 

We will be adding you to the program committee as reviewers, after the submission deadline.

- You can use the below reference to cite the task description paper. A more accurate citation would be available before the camera ready deadline:

@inproceedings{negi2019semeval, title={SemEval-2019 Task 9: Suggestion Mining from Online Reviews and Forums}, author={Negi, Sapna and Daudert, Tobias and Buitelaar, Paul}, booktitle={Proceedings of the 13th International Workshop on Semantic Evaluation (SemEval-2019)}, pages={}, year={2019} }

- You can include additional results/systems than the ones submitted, but it should be clearly indicated that these results are not valid for the competition ranking. 

However, you will have to fit it within the permissible page limit.

- Paper title should be:

"<Team name or Organisation Acronym> at SemEval-2019 Task 9: <Title of your choice>”

If you change your team name to make it more formal, please notify us and change it on Codalab as well.

See sample titles and papers here:

https://aclanthology.info/events/semeval-2018

- Please check the leaderboard and confirm your submission rank once again, before submitting the paper. 

- Your paper will be published in SemEval proceedings without any requirements to pay the conference fees or travel to the venue.

 - Please make sure all the authors (team members) have a softconf account and can access this link http://alt.qcri.org/semeval2019/index.php?id=papers

New softconf users can register for an account by following the new user link: https://www.softconf.com/naacl2019/SemEval/

Regards

Organisers

[junyi li]

Dear organizers

I need the test datasets labels. My team name is lijunyi and my account name aslo is lijunyi. Then my softconf ID is ljy. Finally I want to change my team name from the' lijunyi ' to the 'Lijunyi'

Regards

Participant

在 2019年2月10日星期日 UTC+8下午11:52:28，Sapna Negi写道：

[zqm...@gmail.com]

Dear organizers

I need the test datasets labels to write a system describe papaer. My team name is ZQM and my account name is zqm. Then my softconf ID is zhouqimin. And I want to know how to  make a 'Trial' system description paper submission to the track before I submit my paper.

Regards

Participant

在 2019年2月10日星期日 UTC+8下午11:52:28，Sapna Negi写道：

Dear participants

[Usman Ahmed]

Dear organizers

I need the test datasets labels to write a system describe paper. My team name is "UOL Artificial Intelligence Research Group" and my account name is "usmanahmed189". Then my softconf ID is usman_ahmed.

--
You received this message because you are subscribed to the Google Groups "SemEval 2019: Task 9" group.
To unsubscribe from this group and stop receiving emails from it, send an email to semeval-2019-ta...@googlegroups.com.
To post to this group, send email to semeval-2...@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/semeval-2019-task-9/762678E2-5EE2-44D7-9E76-A165EB3760B4%40insight-centre.org.
For more options, visit https://groups.google.com/d/optout.

--

Usman Ahmed

[Sapna Negi]

Dear participants

In order to subscribe for the test dataset labels, please reply privately to this thread.

Answers to some common queries:

- By 'Softconf id of the lead /submitting author’, we meant the username of the lead/submitting author.

- Trial submission can be any version (empty, dummy, preliminary) of the paper you intend to write, which you can update with your final submission near the deadline.

For any specific queries, please reply privately.

Regards

Organisers

[Sapna Negi]

Apologies for posting a wrong paper submission link the first email.

Please follow these instructions to upload your trial/final paper:

Log in to https://www.softconf.com/naacl2019/SemEval/, click "make a new submission", then in "submission categories" select "**system description**" as the submission type and your task number as the task.

Regards

Organisers

[Tobias C]

Dear organizers

can you confirm that it is possible to write two separate papers for each subtask, like stated on http://alt.qcri.org/semeval2019/index.php?id=papers ?

Should then the title contain the subtask, like "<Team name or Organisation Acronym> at SemEval-2019 Task 9 Subtask A: <Title of your choice>” ?

Regards

Participant

[Sapna Negi]

Hi Tobias

No, it has to be one paper but the page limit for the content is extended to 6 instead of 4 (as stated in http://alt.qcri.org/semeval2019/index.php?id=papers)

The title remains same as stated in the previous email, you do not need to mention the subtasks in the title.

Regards

Organisers

--
You received this message because you are subscribed to the Google Groups "SemEval 2019: Task 9" group.
To unsubscribe from this group and stop receiving emails from it, send an email to semeval-2019-ta...@googlegroups.com.
To post to this group, send email to semeval-2...@googlegroups.com.

To view this discussion on the web, visit https://groups.google.com/d/msgid/semeval-2019-task-9/4394fff2-9c44-4e72-a9d8-394b059fbd57%40googlegroups.com.