TREC-IS

Contact owners and managers

1–30 of 89

Welcome to the TREC Incident Streams track mailing list!

This mailing list will provide updates from the track organisers about tne track and is a place where you can ask questions about the track.

0 selected

Cody Buntain, Reza Barati3

Sep 30

Submission Deadline, 1 Sept, 11:59PM AoE

We should have results back out soon. We just finished manual assessment and need to collate results.

unread,

Submission Deadline, 1 Sept, 11:59PM AoE

We should have results back out soon. We just finished manual assessment and need to collate results.

Sep 30

Jayr Alencar Pereira

Aug 21

Submission Limit and Slack

Hi, Everyone, Is there any limit to the number of submissions we can do? I am unable to access the

unread,

Submission Limit and Slack

Hi, Everyone, Is there any limit to the number of submissions we can do? I am unable to access the

Aug 21

Cody Buntain

May 19

Guidelines and Data for CrisisFACTS 2023!

Hi, everyone! We've released the guidelines for 2023 as well as the datasets for 10 new events,

unread,

Guidelines and Data for CrisisFACTS 2023!

Hi, everyone! We've released the guidelines for 2023 as well as the datasets for 10 new events,

May 19

Amit Yadav M.Tech., Computer Science & Engineering, IIT(BHU), Richard Mccreadie2

Apr 3

TREC CrisisFACTS Track 2023 Dataset Access

Hi Amit, The notebook seems to be working ok for me: https://colab.research.google.com/github/

unread,

TREC CrisisFACTS Track 2023 Dataset Access

Hi Amit, The notebook seems to be working ok for me: https://colab.research.google.com/github/

Apr 3

Cody Buntain

Jan 9

CrisisFACTS Automatic Evaluation Code Available and ISCRAM Reminder

Good morning/afternoon, everyone! I've just returned for the winter break, and we've made the

unread,

CrisisFACTS Automatic Evaluation Code Available and ISCRAM Reminder

Good morning/afternoon, everyone! I've just returned for the winter break, and we've made the

Jan 9

Cody Buntain

12/1/22

Reminder about ISCRAM Deadline on December 15

Hi, everyone! A quick reminder that ISCRAM has an open call for research papers and work-in-progress

unread,

Reminder about ISCRAM Deadline on December 15

Hi, everyone! A quick reminder that ISCRAM has an open call for research papers and work-in-progress

12/1/22

Cody Buntain

11/9/22

CrisisFACTS Plenary Agenda at TREC, Thursday, Nov. 17

Good afternoon, all! I am excited to share the agenda for our plenary session at TREC next week. We

unread,

CrisisFACTS Plenary Agenda at TREC, Thursday, Nov. 17

Good afternoon, all! I am excited to share the agenda for our plenary session at TREC next week. We

11/9/22

Cody Buntain

10/28/22

TREC Notebook Papers --> Call for Papers at ISCRAM

Hi, everyone! I wanted to highlight that ISCRAM has an open call for research papers and work-in-

unread,

TREC Notebook Papers --> Call for Papers at ISCRAM

Hi, everyone! I wanted to highlight that ISCRAM has an open call for research papers and work-in-

10/28/22

Cody Buntain2

9/26/22

Today is the CrisisFACTS Submission Deadline

My mistake! Deadline should be "effectively Sept. *26*, 11:59 PM AoE" (not Sept. 27). On

unread,

Today is the CrisisFACTS Submission Deadline

My mistake! Deadline should be "effectively Sept. *26*, 11:59 PM AoE" (not Sept. 27). On

9/26/22

Md Nazmul Hasan, Richard Mccreadie2

9/23/22

Submission of the CrisisFACTS

Hi Nazmul Here: https://ir.nist.gov/trecsubmit/crisis.html Best Regards, RIchardM From: trec-is@

unread,

Submission of the CrisisFACTS

Hi Nazmul Here: https://ir.nist.gov/trecsubmit/crisis.html Best Regards, RIchardM From: trec-is@

9/23/22

Cody Buntain

9/9/22

Fixing an Inconsistency Between Baseline Output, Check Script, and Guidelines

Hi, all. I just found an inconsistency between the GitHub code and the CrisisFACTS guidelines. The

unread,

Fixing an Inconsistency Between Baseline Output, Check Script, and Guidelines

Hi, all. I just found an inconsistency between the GitHub code and the CrisisFACTS guidelines. The

9/9/22

Nathaniel Weeks Rollings, Cody Buntain3

9/8/22

Sharing Simple Evaluation Scripts

Cody, Great! Again, they are not terribly complex, but hopefully other teams will also find them

unread,

Sharing Simple Evaluation Scripts

Cody, Great! Again, they are not terribly complex, but hopefully other teams will also find them

9/8/22

Douglas William Oard, Richard Mccreadie3

7/29/22

Question about manual runs

Great -- thanks for the quick reply Richard -- we can definitely work with that guidance. If you are

unread,

Question about manual runs

Great -- thanks for the quick reply Richard -- we can definitely work with that guidance. If you are

7/29/22

Cody Buntain

7/18/22

CrisisFACTS Baseline Released

Hi, everyone! I just pushed a baseline system to the CrisisFACTS GitHub repository. You can use it as

unread,

CrisisFACTS Baseline Released

Hi, everyone! I just pushed a baseline system to the CrisisFACTS GitHub repository. You can use it as

7/18/22

Cody Buntain

6/17/22

CrisisFACTS Guidelines Released

Hello, everyone! We are excited to release the guidelines and data for this first run of the

unread,

CrisisFACTS Guidelines Released

Hello, everyone! We are excited to release the guidelines and data for this first run of the

6/17/22

subinay adhikary, richard....@glasgow.ac.uk2

6/10/22

Dataset for CrisisFacts

Hi Subinay , We should have the dataset released next week (its actually ready, but we are putting

unread,

Dataset for CrisisFacts

Hi Subinay , We should have the dataset released next week (its actually ready, but we are putting

6/10/22

Luke Ostrander, richard....@glasgow.ac.uk2

1/31/22

TREC-IS 2022 Timeline Question

Hi Luke, So TREC-IS has officially ended as a TREC track, 2021-B was the last edition. We had run the

unread,

TREC-IS 2022 Timeline Question

Hi Luke, So TREC-IS has officially ended as a TREC track, 2021-B was the last edition. We had run the

1/31/22

Ricardo Usbeck

10/19/21

Formal Ontology for TREC-IS Incident Tweet Routing (High-Level) Information Types

Dear all, I am wondering whether someone already modelled the Information Types (http://dcs.gla.ac.uk

unread,

Formal Ontology for TREC-IS Incident Tweet Routing (High-Level) Information Types

Dear all, I am wondering whether someone already modelled the Information Types (http://dcs.gla.ac.uk

10/19/21

Cody Buntain

10/13/21

Call for TREC Papers and Plenary Speakers

Good evening, all! TL;DR - We are looking for speakers to describe their systems in the TREC-IS

unread,

Call for TREC Papers and Plenary Speakers

Good evening, all! TL;DR - We are looking for speakers to describe their systems in the TREC-IS

10/13/21

Cody Buntain

9/20/21

Guidelines for TREC-IS 2021-B

Afternoon, all! We're excited to share details for TREC-IS 2021-B and how we will run the

unread,

Guidelines for TREC-IS 2021-B

Afternoon, all! We're excited to share details for TREC-IS 2021-B and how we will run the

9/20/21

Cody Buntain

7/30/21

TREC-IS 2021A Annotations Available

Good morning, all! To increase the number of events we are annotating this summer, we have performed

unread,

TREC-IS 2021A Annotations Available

Good morning, all! To increase the number of events we are annotating this summer, we have performed

7/30/21

Cody Buntain

6/24/21

TREC-IS 2021 Summer Leaderboard Now Available

Good afternoon, all! We have put together a leaderboard option for TREC-IS this summer, and it's

unread,

TREC-IS 2021 Summer Leaderboard Now Available

Good afternoon, all! We have put together a leaderboard option for TREC-IS this summer, and it's

6/24/21

Cody Buntain

5/3/21

TREC-IS 2021A Submission Deadline Tonight!

As a reminder, the TREC-IS submission deadline is today, 3 May, 11:59 PM AoE. The submission website

unread,

TREC-IS 2021A Submission Deadline Tonight!

As a reminder, the TREC-IS submission deadline is today, 3 May, 11:59 PM AoE. The submission website

5/3/21

Cody Buntain

5/1/21

Submission Site for TREC-IS 2021-A

Evening, all! Hope you're having a good weekend. The submission website for IS is now live at

unread,

Submission Site for TREC-IS 2021-A

Evening, all! Hope you're having a good weekend. The submission website for IS is now live at

5/1/21

Cody Buntain2

4/30/21

TREC-IS 2021-A Reminder

Evening, all. As promised, I've created an updated version of the run-file format-checking script

unread,

TREC-IS 2021-A Reminder

Evening, all. As promised, I've created an updated version of the run-file format-checking script

4/30/21

Cody Buntain

4/13/21

Reminder of TREC-IS 2021-A Workshop (16 April)

Hello, all! As a reminder, we will be holding a workshop on TREC-IS 2021-A this Friday, 16 April, at

unread,

Reminder of TREC-IS 2021-A Workshop (16 April)

Hello, all! As a reminder, we will be holding a workshop on TREC-IS 2021-A this Friday, 16 April, at

4/13/21

Cody Buntain

4/7/21

Announcing TREC-IS 2021-A Workshop (16 April) and Updates

Good evening, all! We are holding a workshop on TREC-IS 2021-A on Friday, 16 April, at 10AM EDT/2PM

unread,

Announcing TREC-IS 2021-A Workshop (16 April) and Updates

Good evening, all! We are holding a workshop on TREC-IS 2021-A on Friday, 16 April, at 10AM EDT/2PM

4/7/21

Cody Buntain

3/24/21

TREC-IS Virtual Office Hours this Friday, 26 March, 11AM EDT

Afternoon, all! First, thank you for your patience! The TREC-IS website has been updated for 2021,

unread,

TREC-IS Virtual Office Hours this Friday, 26 March, 11AM EDT

Afternoon, all! First, thank you for your patience! The TREC-IS website has been updated for 2021,

3/24/21

Cody Buntain

3/8/21

Initial Release, TREC-IS 2021-A Guidelines

Good morning, all! Attached is a PDF of the submission and task guidelines for 2021-A. Big changes

unread,

Initial Release, TREC-IS 2021-A Guidelines

Good morning, all! Attached is a PDF of the submission and task guidelines for 2021-A. Big changes

3/8/21

Cody Buntain

9/23/20

Now Accepting TREC-IS 2020B Submissions

Afternoon/Evening/Morning, all! The submission system is now live for TREC-IS 2020B: https://ir.nist.

unread,

Now Accepting TREC-IS 2020B Submissions

Afternoon/Evening/Morning, all! The submission system is now live for TREC-IS 2020B: https://ir.nist.

9/23/20