Training set cleansing, Evaluation framework and deadlines postponed

33 views
Skip to first unread message

#Microposts2014 Chairs

unread,
Feb 18, 2014, 6:43:18 AM2/18/14
to #Microposts2014 Challenge group
Dear #Microposts2014 NEEL Challenge participants,

We have taken all your feedback into account and we have done a thorough
cleansing and harmonization process on the training set. We have also
worked on the evaluation framework, that is going to be released by
today. We do plan to answer the emails explaining each decision taken.

We propose an extension for all the next deadlines. Deadlines are
*Hawaii Time 23:59 PM*.

Release of the evaluation framework: 18 February
Release of the training set v1.7: 19 February
Release of test set: 21 Feb 2014
Challenge Submission deadline: 26 Feb 2014 (hard)

We wish you good work for producing great submissions.

Best regards,
#Microposts2014 NEEL Challenge crew

Mena Badieh Habib Morgan

unread,
Feb 18, 2014, 7:02:36 AM2/18/14
to micropo...@googlegroups.com
Dear Challenge crew
Isn't it possible to release the test set earlier?
I think it is just plane text tweets. You could do fixing the ground truth for it later.
I planed a holiday on next week based on the deadlines provided in the beginning and I really want to participate in this challenge.
Thanks for your understanding

Mena

#Microposts2014 Chairs

unread,
Feb 18, 2014, 11:09:18 AM2/18/14
to micropo...@googlegroups.com
Dear Mena,

> Isn't it possible to release the test set earlier?
> I think it is just plane text tweets. You could do fixing the ground
> truth for it later.
> I planed a holiday on next week based on the deadlines provided in the
> beginning and I really want to participate in this challenge.

We are sorry for messing up your plans.

But, the submission we are expecting for the 26th of February is about:
- two pages paper, basically the work you have done for tuning your
system. In other words how you have built the model upon the training
set we have created. You can start writing it already now.
- up to 3 runs of the annotated test set. Once you will have the system
already tuned, it will take not more than 1 day we believe, hence
receiving the test set the 21st, it should be annotated for the 22nd.

Having said this, we are not inclined to release the test set much
beforehand to avoid any human cleansing process.
This is just a precaution, but we believe in a fair mood of all the NEEL
challenge participants.

Good luck with your submission. We are looking forward to welcoming your
system in the competition!

Cheers,
#Microposts2014 NEEL Challenge crew
Reply all
Reply to author
Forward
0 new messages