TREC Car

Contact owners and managers

1–30 of 68

0 selected

2/3/21

Papers written with the TREC-CAR dataset?

Dear TREC CAR participants! I am working on an overview article that discusses research conducted

unread,

Papers written with the TREC-CAR dataset?

Dear TREC CAR participants! I am working on an overview article that discusses research conducted

2/3/21

7/22/20

trec-car.cs.unh.edu is back online

Dear all, our webserver [1] had to undergo some maintenance today -- if you were trying to access the

unread,

trec-car.cs.unh.edu is back online

Dear all, our webserver [1] had to undergo some maintenance today -- if you were trying to access the

7/22/20

7/8/20

Evaluation Results from TREC CAR Y3 evaluation

Dear all, the evaluation results from the TREC CAR Y3 evaluation are available publicly online. We

unread,

Evaluation Results from TREC CAR Y3 evaluation

Dear all, the evaluation results from the TREC CAR Y3 evaluation are available publicly online. We

7/8/20

7/3/20

Releases: 2020 Wiki Dump / Entity Id conversion

Dear all, two good news: 1) We released a WIkipedia dump from 01/01/2020 in CAR format. This time all

unread,

Releases: 2020 Wiki Dump / Entity Id conversion

Dear all, two good news: 1) We released a WIkipedia dump from 01/01/2020 in CAR format. This time all

7/3/20

10/22/19

Participating Team results

Dear all, A few weeks ago I sent our the evaluation data to all participating teams (using the email

unread,

Participating Team results

Dear all, A few weeks ago I sent our the evaluation data to all participating teams (using the email

10/22/19

7/31/19

Reminder: submission deadline August 1

Dear TREC CAR participants, I would like to remind you that the submission deadline is August 1st

unread,

Reminder: submission deadline August 1

Dear TREC CAR participants, I would like to remind you that the submission deadline is August 1st

7/31/19

7/22/19

TREC 2019 CAR track submission system open; you must validate your run file before submitting

Dear TREC 2019 CAR track participants, The TREC runs submission system is now open for CAR track runs

unread,

TREC 2019 CAR track submission system open; you must validate your run file before submitting

Dear TREC 2019 CAR track participants, The TREC runs submission system is now open for CAR track runs

7/22/19

7/20/19

Available input rankings for passage/entity ranking

Dear all, If you want to participate in TREC CAR, but you don't have a search index available,

unread,

Available input rankings for passage/entity ranking

Dear all, If you want to participate in TREC CAR, but you don't have a search index available,

7/20/19

7/9/19

TREC CAR Y3 submission details, validation code, and code to convert rankings into populated pages

Dear CAR folks, The validation code for TREC CAR Y3 submission is ready (I hope everything works, let

unread,

TREC CAR Y3 submission details, validation code, and code to convert rankings into populated pages

Dear CAR folks, The validation code for TREC CAR Y3 submission is ready (I hope everything works, let

7/9/19

6/28/19

benchmarkY3train vs benchmarkY2test --- and the mythical compatibility file

Dear TREC CAR participants, This question came up, and I want to share the answer with you. I am

unread,

benchmarkY3train vs benchmarkY2test --- and the mythical compatibility file

Dear TREC CAR participants, This question came up, and I want to share the answer with you. I am

6/28/19

6/27/19

Common Mistakes queryId.split("/")

Dear CAR participants, I see many of you making the same mistake when getting the PageId from a Query

unread,

Common Mistakes queryId.split("/")

Dear CAR participants, I see many of you making the same mistake when getting the PageId from a Query

6/27/19

Laura Dietz, … Yutao Zeng9

6/21/19

TREC CAR 2018 submission deadline: August 1 / pre-announcement of passage ordering task.

Laura, Thanks for your reply. It helps a lot! Best, Yutao

unread,

TREC CAR 2018 submission deadline: August 1 / pre-announcement of passage ordering task.

Laura, Thanks for your reply. It helps a lot! Best, Yutao

6/21/19

6/19/19

benchmarkY3train/test topics released

Dear TREC CAR fans, the data for benchmarkY3 is released, see http://trec-car.cs.unh.edu/datareleases

unread,

benchmarkY3train/test topics released

Dear TREC CAR fans, the data for benchmarkY3 is released, see http://trec-car.cs.unh.edu/datareleases

6/19/19

Sebastian Arnold, Laura Dietz3

5/6/19

Document assignments for paragraphCorpus

I forgot to mention: For the past benchmarks (benchmarkY1train/Y1test/Y2test) we also provide the

unread,

Document assignments for paragraphCorpus

I forgot to mention: For the past benchmarks (benchmarkY1train/Y1test/Y2test) we also provide the

5/6/19

Rohan Chhokra, Laura Dietz3

4/6/19

How to set up the trec car java tools on macOS?

Rohan, You cannot call a library method from the command line, especially when you are not setting

unread,

How to set up the trec car java tools on macOS?

Rohan, You cannot call a library method from the command line, especially when you are not setting

4/6/19

Rodrigo Nogueira

1/30/19

Code for BERT + TREC-CAR

Step-by-step instructions to train and evaluate BERT on TREC-CAR: https://github.com/nyu-dl/dl4marco-

unread,

Code for BERT + TREC-CAR

Step-by-step instructions to train and evaluate BERT on TREC-CAR: https://github.com/nyu-dl/dl4marco-

1/30/19

1/18/19

FYI: Signup question for new members.

Dear all, When new members sign up for this mailinglist, they are required to answer a "security

unread,

FYI: Signup question for new members.

Dear all, When new members sign up for this mailinglist, they are required to answer a "security

1/18/19

11/12/18

CAR planning lunch: Thursday lunch break

Dear TREC CAR participants, I am looking forward to see many of you this week at TREC. Nine teams

unread,

CAR planning lunch: Thursday lunch break

Dear TREC CAR participants, I am looking forward to see many of you this week at TREC. Nine teams

11/12/18

10/15/18

Dear TREC CAR folks, Good news: TREC decided to run Complex Answer Retrieval track for another year.

unread,

Dear TREC CAR folks, Good news: TREC decided to run Complex Answer Retrieval track for another year.

10/15/18

8/30/18

Fwd: [trec2018] TREC 2018: conference registration open

Please register for TREC! Laura -------- Forwarded Message -------- Subject: [trec2018] TREC 2018:

unread,

Fwd: [trec2018] TREC 2018: conference registration open

Please register for TREC! Laura -------- Forwarded Message -------- Subject: [trec2018] TREC 2018:

8/30/18

8/16/18

Confirmations sent

I have sent confirmation messages for the CAR track runs NIST successfully received. The message was

unread,

Confirmations sent

I have sent confirmation messages for the CAR track runs NIST successfully received. The message was

8/16/18

Laura Dietz, … xuesiy...@gmail.com5

8/16/18

Meta information for each run

The file submitted for run `TUA1TEAM2' contains a different run tag (`Diptera‚y '). The run-

unread,

Meta information for each run

The file submitted for run `TUA1TEAM2' contains a different run tag (`Diptera‚y '). The run-

8/16/18

Laura Dietz, … Rafael Glater10

8/10/18

Clarification regarding DBpedia

Hi Rafael, The goal is to develop a system that can fill query-outlines that do not already exist on

unread,

Clarification regarding DBpedia

Hi Rafael, The goal is to develop a system that can fill query-outlines that do not already exist on

8/10/18

ellen.voorhees, … Zhengyang SONG3

8/8/18

TREC 2018 submission system now open for CAR track runs

Hello, I want to ask whether there is any chance that I can participate in this activity now? Since I

unread,

TREC 2018 submission system now open for CAR track runs

Hello, I want to ask whether there is any chance that I can participate in this activity now? Since I

8/8/18

Widad Machmouchi, Laura Dietz4

8/6/18

Article Titles in BenchmarkY2

Hi Widad, yes, you retrieve paragraphs from the paragraphCorpus. By IR standards this is not a large

unread,

Article Titles in BenchmarkY2

Hi Widad, yes, you retrieve paragraphs from the paragraphCorpus. By IR standards this is not a large

8/6/18

Laura Dietz, Rodrigo Nogueira3

7/28/18

Rankings for internal sections: Tree qrels and new trec-car-tools

On 07/28/2018 11:48 AM, Rodrigo Nogueira wrote: > Hello TREC CAR organizers, > > Could you

unread,

Rankings for internal sections: Tree qrels and new trec-car-tools

On 07/28/2018 11:48 AM, Rodrigo Nogueira wrote: > Hello TREC CAR organizers, > > Could you

7/28/18

7/25/18

Test queries for TREC CAR 2018 (year 2) released!

Dear all, Of course there was a last oopsie in the dataset. (One page had two sections with the same

unread,

Test queries for TREC CAR 2018 (year 2) released!

Dear all, Of course there was a last oopsie in the dataset. (One page had two sections with the same

7/25/18

6/5/18

Voluntary Evaluation / Annotation Cycles for June 2018

Here your monthly reminder. You can submit runs to me until June 20. (please send as web links, not

unread,

Voluntary Evaluation / Annotation Cycles for June 2018

Here your monthly reminder. You can submit runs to me until June 20. (please send as web links, not

6/5/18

6/4/18

Qrels for 2017 evaluation released

Dear TREC CAR fans, The ground truth for benchmarkY1test are released. You find several new packages

unread,

Qrels for 2017 evaluation released

Dear TREC CAR fans, The ground truth for benchmarkY1test are released. You find several new packages

6/4/18

Lakshmanan Arumugam, Laura Dietz3

6/4/18

Results from Manual assessment of TREC 2017 Benchmark Test set

Hi Dr.Dietz, Dr.Dalton, Any updates on this one? On Fri, Jun 1, 2018 at 10:46 AM Laura Dietz <

unread,

Results from Manual assessment of TREC 2017 Benchmark Test set

Hi Dr.Dietz, Dr.Dalton, Any updates on this one? On Fri, Jun 1, 2018 at 10:46 AM Laura Dietz <

6/4/18

Search

Clear search

Close search

Google apps

Main menu