[IMPORTANT] Final information on both subtasks

178 views
Skip to first unread message

tobias daudert

unread,
Jan 30, 2017, 5:40:44 AM1/30/17
to SemEval 2017: Task 5
Hi all,

since the deadline is approaching, we want to make you aware of some final points:

1) The deadlines for both subtasks have been extended to 31.01. 23:59:59 UTC.
2) Make sure to include at least the fields 'id', 'sentiment score' and 'cashtag' in your submissions. 
3) You can still request the complete training and test data for subtask 1 (with messages) if you didn't do so yet (email to semeval...@mail.com).
4) All of you have 2 submissions per subtask available. We would recommend you to submit twice since we take only the best of your two submissions into consideration for the final ranking.
5) Since we are interested in your approach, we would appreciate information regarding the following:
  • Approach adopted: 
    • Pre-processing (e.g., tokenization, stemming, lemmatization, POS tagging, emoticon removal, etc.)
    • Techniques used (e.g., hybrid, machine learning based, rule based, ontology-based, etc.)
    • External sources, data sets and/or lexicons used (if any)
    • Tools used (if off the shelf or ones implemented for the scope of the task/s)
  • Why did you choose this approach and if it is: (i) multilingual/cross-lingual, (ii) domain dependent/independent 
  • Issues encountered (if any) and how they were tackled and potentially solved
Please send your information to semeval...@mail.com and use as subject "Subtask X - Approach of team TEAMNAME". Please replace X and TEAMNAME with the proper information.

Best,
Tobias

tobias daudert

unread,
Jan 30, 2017, 5:42:25 AM1/30/17
to SemEval 2017: Task 5
Point 2) applies of course only to subtask 1.

vglo...@gmail.com

unread,
Jan 30, 2017, 5:54:27 AM1/30/17
to SemEval 2017: Task 5
Hello,

this is a bit embarrassing but what should I do if I have forgotten the team name?

tobias daudert

unread,
Jan 30, 2017, 5:59:05 AM1/30/17
to SemEval 2017: Task 5, vglo...@gmail.com
Your Codalab name is fine as well.

tiag...@gmail.com

unread,
Jan 30, 2017, 6:18:02 AM1/30/17
to SemEval 2017: Task 5
Hi,

I have a doubt  about the required field at submission in the case of subtask 2, about headlines. For this subtask 2, one of the required fields in the item 2 would be still "cashtag" or must be "company" instead?

Tiago,

seawo...@gmail.com

unread,
Jan 30, 2017, 6:20:44 AM1/30/17
to SemEval 2017: Task 5
Come on. Your websites for subtask 1 is already closed. :-(

tobias daudert

unread,
Jan 30, 2017, 6:21:44 AM1/30/17
to SemEval 2017: Task 5, tiag...@gmail.com
Hi Tiago,


Best,
Tobias

tobias daudert

unread,
Jan 30, 2017, 6:24:35 AM1/30/17
to SemEval 2017: Task 5
No?
Message has been deleted
Message has been deleted

tiag...@gmail.com

unread,
Jan 30, 2017, 10:21:35 AM1/30/17
to SemEval 2017: Task 5
Hi Tobias,

I did all about submission of healine subtask that is informed until now but I  always receive this answer: "Please select a valid file. Only ZIP files are accepted."
I zipped the json file like competition site explaned( "zip -jr submission.zip submission.json") and I am sending this file by upload field but this error continues to be showed for me.
I sent you a email with more details.
I wondering if you have any clue about this problem.

Best Regards,

Tiago



Em segunda-feira, 30 de janeiro de 2017 08:40:44 UTC-2, tobias daudert escreveu:

tobias daudert

unread,
Jan 30, 2017, 10:26:49 AM1/30/17
to SemEval 2017: Task 5, tiag...@gmail.com
Hi Tiago,

I already replied to your personal email.
As the error says, it looks like your creating a corrupted archive. Are you sure that you're zipping the file correctly? Please check that again.
Btw.: the file you have sent to me is not the subtask 2 submission.

Best,
Tobias

Nadia Felix

unread,
Jan 31, 2017, 5:30:24 PM1/31/17
to SemEval 2017: Task 5
We are receiving the error: unexpected error occurred. What is mean?

Keith Cortis

unread,
Feb 16, 2017, 8:02:28 PM2/16/17
to SemEval 2017: Task 5, tobias daudert
Dear Task 5 participants,

This is a reminder about the following information that we need from each participant about their system/s. 
  • Approach adopted: 
    • Pre-processing (e.g., tokenization, stemming, lemmatization, POS tagging, emoticon removal, etc.)
    • Techniques used (e.g., hybrid, machine learning based, rule based, ontology-based, etc.)
    • External sources, data sets and/or lexicons used (if any)
    • Tools used (if off the shelf or ones implemented for the scope of the task/s)
  • Why did you choose this approach and if it is: (i) multilingual/cross-lingual, (ii) domain dependent/independent 
  • Issues encountered (if any) and how they were tackled and potentially solved
Please also send the mentioned information to semeval...@mail.com by Mon 27th Feb (i.e. the paper deadline) and use as subject "Subtask X - Approach of team TEAMNAME". Please replace X and TEAMNAME with the proper information.

Kind regards,
Keith


--
You received this message because you are subscribed to the Google Groups "SemEval 2017: Task 5" group.
To unsubscribe from this group and stop receiving emails from it, send an email to semeval-2017-task-5+unsub...@googlegroups.com.
To post to this group, send email to semeval-2017-task-5@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/semeval-2017-task-5/4d19dcfc-77e9-47f3-b2ff-635f8f424ed1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply all
Reply to author
Forward
0 new messages