track median

19 views
Skip to first unread message

Jeroen Vuurens

unread,
Oct 11, 2015, 12:37:41 PM10/11/15
to temporalsummarization
Hi,

Thanks for processing the results and giving out the preliminary result files.

Is it possible to get the median for this years track? Preferably per topic, so we can get an estimation on which topics we did relatively good or bad.

Thanks, Jeroen

Fernando Diaz

unread,
Oct 11, 2015, 12:51:50 PM10/11/15
to Jeroen Vuurens, temporalsummarization

The mean performance per topic is included in the results.  Let me see about distributing an update with median information as well.




From: tre...@googlegroups.com <tre...@googlegroups.com> on behalf of Jeroen Vuurens <jbpvu...@gmail.com>
Sent: Sunday, October 11, 2015 12:37 PM
To: temporalsummarization
Subject: [TREC-TS] track median
 
--
You received this message because you are subscribed to the Google Groups "temporalsummarization" group.
To unsubscribe from this group and stop receiving emails from it, send an email to trec-ts+u...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Jeroen Vuurens

unread,
Oct 11, 2015, 1:00:29 PM10/11/15
to Fernando Diaz, temporalsummarization
Hi Fernando,

Thanks for the fast reply. The mean is also fine, but is it possible to give this on a per-topic basis?

Thanks, Jeroen

Fernando Diaz

unread,
Oct 11, 2015, 1:07:36 PM10/11/15
to Jeroen Vuurens, temporalsummarization


Those should be included in your results files.  


From: Jeroen Vuurens <jbpvu...@gmail.com>
Sent: Sunday, October 11, 2015 1:00 PM
To: Fernando Diaz
Cc: temporalsummarization
Subject: Re: [TREC-TS] track median
 

Jeroen Vuurens

unread,
Oct 11, 2015, 1:46:07 PM10/11/15
to Fernando Diaz, temporalsummarization
just to verify, is that for each topic the line that has AVG as the system name?

Fernando Diaz

unread,
Oct 11, 2015, 1:58:21 PM10/11/15
to Jeroen Vuurens, temporalsummarization


If the runID is AVG, that is the average across submitted runs.  Unless you actually had a runID named AVG, in which case we may have a problem.  




From: Jeroen Vuurens <jbpvu...@gmail.com>
Sent: Sunday, October 11, 2015 1:46 PM
Reply all
Reply to author
Forward
0 new messages