extracting stream items from the TREC-TS-2014F dataset

[kita3...@gmail.com]

Hello,

I am one of participants in the TREC 2014 Temporal Summarization (TS) track.

I use the TS-specific corpus subset (http://s3.amazonaws.com/aws-publicdatasets/trec/ts/index.html) and have some problems.

Would you give me any advice?

1.

We were extracting stream items from the TS-specific corpus subset with the attached java program.

However, we cannot find "lingpipe" component in stream items from 2013-02-03-00 to 2013-04-20-23 or get sentences.

Would you tell me about that solution methods?

2.

Our atattied program doesn't output any sentences, when we extract stream items from some chunk files.

(e.g.

http://s3.amazonaws.com/aws-publicdatasets/trec/ts/streamcorpus-2014-v0_3_0-ts-filtered/2012-12-01-00/WEBLOG-28-5bb0b1c7835d2c5d866613709ffe4cef-fcc077e4c970142b466ea34e44635aa3-33d7ff7263ea9a35c5ebe5d77c632f21.sc.xz.gpg,

http://s3.amazonaws.com/aws-publicdatasets/trec/ts/streamcorpus-2014-v0_3_0-ts-filtered/2012-12-01-00/MAINSTREAM_NEWS-50-55d1c5ee21680cc9e7245f8ebf35a977-72dd9a25cb94c83d8695fd00c32f53ed-14a973f07cd891951b98d750e219ac86.sc.xz.gpg)

What does this case mean?

May I ignore these chunk files?

Thank you for your consideration.

Sayaka