TREC 2013 FedWeb topic results available

[Thomas Demeester]

Dear FedWeb 2013 participants,

thank you for your contributions to the resource selection task! 

To facilitate your preparation for the results merging task (which is due September 15th, see http://www.snipdex.org/fedweb), the search results for the test topics are now available for download, from the same servers and with the same credentials as when you obtained the collection itself.

Good luck, and if you have any questions, do not hesitate to contact us.

Best wishes,  

Thomas

[Mustafa Zengin]

Hi,

I could not find the baseline(resource selection) run on the servers where we downloaded the collections. Can you help me to locate it?

Thanks,

Mustafa

[Thomas Demeester]

Hi all,

I already provided the baseline results to Mustafa, but maybe some of you would like to test your system on the baseline run as well (in total you can submit up to three runs for the results merging task). 

This baseline is not the gold truth; it was generated based on the *snippet* judgments for only three out of 10 results per search engine and per topic (whereas the resource selection gold truth contains all the *page* judgments for the considered topics).

The baseline file (RS_baseline.txt) is available on the ftp server with the collection, but for your convenience I've attached it to this message as well. 

Best,

Thomas