gold labels and system outputs released

[Preslav Nakov]

Dear SemEval-2017 Task 4 participants,

We have released the gold labels and the system outputs.

http://alt.qcri.org/semeval2017/task4/index.php?id=results

We have also generated a PDF file with all results and some baselines.

Let us know if you see any issues.

-- The SemEval-2017 Task 4 organizers

[Christos Baziotis]

For Task A you said that you would replace F1pn with macroaveraged recall as the official score. http://alt.qcri.org/semeval2017/task4/.

You should update the results.

[Preslav Nakov]

You are right. Update coming.

On Sun, Feb 19, 2017 at 1:54 AM, Christos Baziotis <christos...@gmail.com> wrote:

For Task A you said that you would replace F1pn with macroaveraged recall as the official score. http://alt.qcri.org/semeval2017/task4/.

You should update the results.

--
You received this message because you are subscribed to the Google Groups "SEMEVALTWEET" group.
To unsubscribe from this group and stop receiving emails from it, send an email to semevaltweet+unsubscribe@googlegroups.com.
To post to this group, send email to semeva...@googlegroups.com.
Visit this group at https://groups.google.com/group/semevaltweet.
For more options, visit https://groups.google.com/d/optout.

[Preslav Nakov]

This is now fixed and reposted on the website.

Subtask A is now ranked by Average Recall instead of F1_PN, as originally promised. This does not change the ranking much.

Preslav

[Athanasia Kolovou]

In subtask A you have 2 teams with ranking 1 , but then the ranking continues to number 3, and not number 2 (see Table 1 , first column)

On Sunday, February 19, 2017 at 8:19:12 AM UTC+2, Preslav Nakov wrote:

This is now fixed and reposted on the website.

Subtask A is now ranked by Average Recall instead of F1_PN, as originally promised. This does not change the ranking much.

Preslav

On Sun, Feb 19, 2017 at 1:57 AM, Preslav Nakov <presla...@gmail.com> wrote:

You are right. Update coming.

On Sun, Feb 19, 2017 at 1:54 AM, Christos Baziotis <christos...@gmail.com> wrote:

For Task A you said that you would replace F1pn with macroaveraged recall as the official score. http://alt.qcri.org/semeval2017/task4/.

You should update the results.

--
You received this message because you are subscribed to the Google Groups "SEMEVALTWEET" group.

To unsubscribe from this group and stop receiving emails from it, send an email to semevaltweet...@googlegroups.com.

[Preslav Nakov]

Yes, this is on purpose. The team at rank 3 is behind two other teams, so it is third.

We have followed the exact same numbering in previous years. Nothing has changed.