Fwd: [SemEval] Task 12: formal check of papers

Skip to first unread message

Deniz Yuret

May 7, 2010, 5:00:43 AM5/7/10
to semeval-pete
Dear all,

We have briefly checked the papers for formatting, title etc. and
found the following problems. Please consider these in your final

5, 23: titles are not in correct format.
5, 24, 29, 49, 79: does not identify task number (#12)
5, 23, 24, 29, 49, 79: does not have reference to the task description paper


> ---------- Forwarded message ----------
> From: Katrin Erk <katri...@mail.utexas.edu>
> Date: Tue, May 4, 2010 at 2:55 AM
> Subject: [SemEval] Task 12: formal check of papers
> To: Deniz Yuret <deniz...@gmail.com>
> Cc: Carlo Strapparava <str...@fbk.eu>
> Dear organizers of task 12,
> please take one quick look at the papers for your task, attached to
> this mail. If there are any problems with papers for your task, we'd
> need to know about it by May 5.
> We would like you to check the following things:
> * Do the papers identify the task number correctly, and give their
> system name that you also use in the overview paper?
> * Do they present the system performance in a way that coincides with
> the measures and the scoring system that you gave them?
> * Is the paper compliant with the instructions you gave to participants, if any?
> * Is there anything else missing that needs to be included in the
> camera-ready version, such as full reference of the task description
> paper?
> Please _only_ notify us of any papers that have a problem. If a paper
> is fine, you don't need to let us know.
> It is possible that you have already reviewed some of the papers we
> are now sending you. So if you have already checked a paper for the
> problems  we list above, you don't need to re-check them.
> We are sending the papers to all organizers for your task of which we
> have the email address. That doesn't mean that you would all have to
> look at the papers individually. It is completely sufficient if one of
> you takes a quick look to make sure everything is alright. And as we
> said above, all we are asking you to do is to take a quick look (5
> minutes' worth of looking) to check that the paper is formally okay.
> We are not looking for another general review.
> Many thanks, and all the best,
> Katrin and Carlo
> --
> Katrin Erk, Department of Linguistics
> The University of Texas at Austin
> http://comp.ling.utexas.edu/people/katrin_erk

Laura Rimell

May 7, 2010, 5:45:08 AM5/7/10
to semeva...@googlegroups.com
Hi Deniz,

Are these the confirmation numbers from when we submitted the papers? And
can you please provide the reference for the task description paper?


Laura Rimell
Research Assistant
University of Cambridge Computer Laboratory

Deniz Yuret

May 7, 2010, 10:49:16 AM5/7/10
to semeva...@googlegroups.com
Hi Laura,

The reference for the task paper is:

author={Deniz Yuret and Ayd{\i}n Han and Zehra Turgut},
title={SemEval-2010 Task 12: Parser Evaluation using Textual Entailments},
booktitle={Proceedings of the SemEval-2010 Evaluation Exercises on
Semantic Evaluation},

The numbers were the ones that were sent to us by the organizers
(Katrin and Carlo). I think they should be the same as confirmation
numbers you mention but I am not sure. If you just check the points
in Katrin's email for your paper and follow the instructions online
about the title etc. that should be sufficient.

Reply all
Reply to author
0 new messages