official RS baseline available
17 views
Skip to first unread message
Thomas Demeester
Aug 26, 2014, 4:22:10 AM8/26/14
to trec-...@googlegroups.com
Dear FedWeb participants,
as indicated in the guidelines on the Results Merging (RM) task, this year we expect each valid run to be directly linked to a resource selection (RS) run, either your own previously submitted run (if you participated in the RS task), or the baseline provided by us. At submission, you will be asked to provide the run tag of that corresponding RS run. The maximum number of RM runs per team is again 7 in total.
For each query, the RM run should contain the properly ranked results from at most the top 20 resources (according to the corresponding RS run).
To ensure a fair comparison between participants, we require that each team submits at least one run based on our official RS baseline.
The official baseline run (FW14base) can be obtained from the FedWeb site.
Good luck,
Thomas
as indicated in the guidelines on the Results Merging (RM) task, this year we expect each valid run to be directly linked to a resource selection (RS) run, either your own previously submitted run (if you participated in the RS task), or the baseline provided by us. At submission, you will be asked to provide the run tag of that corresponding RS run. The maximum number of RM runs per team is again 7 in total.
For each query, the RM run should contain the properly ranked results from at most the top 20 resources (according to the corresponding RS run).
To ensure a fair comparison between participants, we require that each team submits at least one run based on our official RS baseline.
The official baseline run (FW14base) can be obtained from the FedWeb site.
Good luck,
Thomas
Reply all
Reply to author
Forward
0 new messages