Updates file and evaluation for TREC TS 2014

[Cristina Garbacea]

For the TREC TS 2014 collection, which is the difference between the updates_sampled.tsv file and updates_sampled.extended.tsv? The file with matches.tsv is just one. 
Also, which out of these two files has been used for the official evaluation? The official evaluation script used was tseval.py or tseval2014_mod.py?

Thanks,

Cristina

[Matthew Ekstrand-Abueg]

extended (including exact matches between pooled and unpooled submitted updates) and the unmodified evaluation script were used for the official evaluation metrics, but the modified method is more similar to that which will be used this year.

Cheers,
Matthew

--
You received this message because you are subscribed to the Google Groups "temporalsummarization" group.
To unsubscribe from this group and stop receiving emails from it, send an email to trec-ts+u...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.