Ranking results available

Daniel Sanchez

unread,

Aug 31, 2011, 2:24:13 PM8/31/11

to DDIExtraction2011

Dear all,
the ranking of the results of the task is available in the summary
paper, in page 7. Check it out in here (http://labda.inf.uc3m.es/
DDIExtraction2011/paper0.pdf).

Best regards,
Committee organization

Santiago M. Mola

unread,

Aug 31, 2011, 3:50:12 PM8/31/11

to ddiextra...@googlegroups.com

Thank you Daniel!

Is it possible to publish the raw results as submitted by each
participant? It would be interesting to perform a deeper inspection of
results given other performance measures. That might give us some more
interesting insights.

Best,
Santiago

--
Santiago M. Mola
Jabber ID: cool...@gmail.com

Santiago M. Mola

unread,

Aug 31, 2011, 3:55:19 PM8/31/11

to ddiextra...@googlegroups.com

On Wed, Aug 31, 2011 at 9:50 PM, Santiago M. Mola <cool...@gmail.com> wrote:
> Thank you Daniel!
>
> Is it possible to publish the raw results as submitted by each
> participant? It would be interesting to perform a deeper inspection of
> results given other performance measures. That might give us some more
> interesting insights.
>

Sorry, I didn't remember that submissions didn't include confidence
thresholds. So we can't really go beyond the measures presented in the
overview.

Best,

Aaron Munger

unread,

Sep 7, 2011, 6:50:05 PM9/7/11

to ddiextra...@googlegroups.com

Is the labelled test data available so further experimentation can be evaluated against these scores?

thanks,
Aaron

Isabel Segura

unread,

Sep 9, 2011, 6:59:28 AM9/9/11

to ddiextra...@googlegroups.com

We are going to organize a new edition of the DDIExtraction task in SEMEVAL 2013 (http://www.cs.york.ac.uk/semeval/)
We will send you the new training dataset as soon as we can do.

--
Isabel Segura Bedmar
Despacho 2.2.A.10, Telf: 91 624 99 88
Departamento de Informática, Universidad Carlos III de Madrid,