TREC 2013 FedWeb topic results available

67 views
Skip to first unread message

Thomas Demeester

unread,
Aug 12, 2013, 9:25:13 AM8/12/13
to trec-...@googlegroups.com
Dear FedWeb 2013 participants,

thank you for your contributions to the resource selection task! 

To facilitate your preparation for the results merging task (which is due September 15th, see http://www.snipdex.org/fedweb), the search results for the test topics are now available for download, from the same servers and with the same credentials as when you obtained the collection itself.

Good luck, and if you have any questions, do not hesitate to contact us.

Best wishes,  
Thomas

Mustafa Zengin

unread,
Sep 9, 2013, 3:21:07 PM9/9/13
to trec-...@googlegroups.com
Hi,

I could not find the baseline(resource selection) run on the servers where we downloaded the collections. Can you help me to locate it?

Thanks,

Mustafa

Thomas Demeester

unread,
Sep 12, 2013, 6:21:23 AM9/12/13
to trec-...@googlegroups.com
Hi all,

I already provided the baseline results to Mustafa, but maybe some of you would like to test your system on the baseline run as well (in total you can submit up to three runs for the results merging task). 
This baseline is not the gold truth; it was generated based on the *snippet* judgments for only three out of 10 results per search engine and per topic (whereas the resource selection gold truth contains all the *page* judgments for the considered topics).
The baseline file (RS_baseline.txt) is available on the ftp server with the collection, but for your convenience I've attached it to this message as well. 

Best,
Thomas
RS_baseline.txt
Reply all
Reply to author
Forward
0 new messages