Regarding non-gold chunk evaluation

[Mishal Kazmi]

Hello,

I have a query regarding the non-gold chunks evaluation. Even if the non-gold chunks provide a .wa file which is wellformed the evalF1.pl script does not provide me with any scores for it.

Could you let me know how to tackle this issue?

Best,

Mishal Kazmi

PhD Student in Electronics Engineering
Human Language and Speech Technologies Lab

Sabanci University

[eneko]

Hi Mishal,

you mean you produced a .wa file for the test and cannot evaluate? Note that you do not have the evaluation file for the test set yet, so this is normal. We will be producing the results ourselves when the competition period is finished.

Otherwise, please send me (privately) all your relevant files, so we can replicate and understand what is going on.

best

eneko

--
You received this message because you are subscribed to the Google Groups "Interpretable STS Semeval Task" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ists-semeval...@googlegroups.com.
Visit this group at https://groups.google.com/group/ists-semeval.
To view this discussion on the web visit https://groups.google.com/d/msgid/ists-semeval/CAO2C32EvVe-Di2bHos0Y-0iWJW1103LhwMSbXJwUyP9yuX8yhg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

--

Eneko Agirre
Euskal Herriko Unibertsitatea
University of the Basque Country
http://ixa2.si.ehu.eus/eneko

[Mishal Kazmi]

Hello,

Yes I have generated .wa files but they cannot be evaluated for the evalF1.pl file.

I am not yet using the test set so the evaluation of that is not the issue.

Best,

--