Call for Participation: Shared Task @DiSCo'2011 - TEST DATA AVAILABLE
Eugenie Giesbrecht
____________________________
CALL FOR PARTICIPATION: Shared Task on Distributional Semantics and Compositionality (@DiSCo'2011)
http://disco2011.fzi.de/#SharedTask
** TEST DATA AVAILABLE NOW at http://disco2011.fzi.de/
_____________________________
== THE TASK ==
The organizers extracted candidate phrases from two large-scale freely available web-corpora, UkWaC and DeWaC (cf. http://wacky.sslmit.unibo.it/), containing respectively English and German POS tagged text. These data have been manually evaluated for compositionality with Amazon Turk. Workers were presented a sentence with a bolded target phrase and were asked to score how literal the phrase was between 0 and 10. 4-5 different, randomly sampled sentences from the WaCKy corpora for UK English and German were presented to 4 workers each.
Phrases consist of two lemmas and come in three grammatical relations:
ADJ_NN: adjective modifying a noun
V_SUBJ: noun as a subject of a verb
V_OBJ: noun as an object of a verb
Phrases were extracted semi-automatically. The relations were assigned by patterns and manually checked for validity.
* Please note, we've updated the training data so that the phrases like "EN_V_SUBJ name come" are avoided.
** More information is available at DiSCo'2011 website ( http://disco2011.fzi.de/#SharedTask ) as well as at our Google group ( http://groups.google.com/group/disco2011-workshop- )
== THE DATES ==
Test data release: March 31, 2011
Test data submission and system description deadline: April 8, 2011
Notification of acceptance: Apr 25, 2011
Camera-ready deadline: May 06, 2011
Post-ACL Workshop: June 24 , 2011
== TASK ORGANIZERS ==
- Chris Biemann, UKP lab, TU Darmstadt, Germany
- Eugenie Giesbrecht, FZI Research Center for Information Technology at the University of Karlsruhe, Germany
Looking forward to your submissions!
The DiSCo-Team