Test data available

[Lucia Specia]

Dear all,

Just to let you know that the test set is available for download on
that task's website:

http://www.cs.york.ac.uk/semeval-2012/task1/

Later today we will upload a few baseline systems as well.

Best,

Lucia, Sujay and Rada

[Jill Burstein]

Hi Lucia,

 

Can you let me know when you anticipate posting the baselines? Also, where can we find the Important Dates for this task. We had been using the main SEMEVAL site, but not sure that's the right thing to do.

 

Thanks,

Jill

[Lucia Specia]

Hi Jill and all,

We'll upload the baselines soon, we just didn't have the time to write
a proper readme file explaining them yet. If you want to start having
a look at the results, I'm attaching the rankings for the trial data
as given by the 3 baselines, the readme file will follow soon.

As for the important dates, we are following the semeval timetable,
except that we got the test set ready way ahead of time and made it
available already. But the system submission date remains the same:

October 26, 2011 Call for participation
December 10, 2011 onwards Full Training Data + Test scripts
available for participants [task dependent]
February 10, 2012 Test set ready
March 15, 2012 onwards Start of evaluation period
April 1, 2012 End of Evaluation Period (results due)
April 11, 2012 Paper submission deadline
April 23, 2012 Reviews due
May 4, 2012 Camera Ready

Lucia

[Sowmya V.B.]

Hi Lucia

Thanks for the baseline files.
There seem to be some spelling mistakes in both the gold standard rankings as well as in the baselines/test data set files.
The scorer script seems to throw some errors with baseline files (atleast for me), for this very reason.

Sowmya.

--
----
Sowmya.