[REQUEST] Data sets of blog posts

[Adam Dossa]

Hi All,

I am looking for data sets containing blog posts (I don't mind if they are annotated or not) for a University project.

So far I have found:

http://www.icwsm.org/2009/data/ (which requires a form to be completed etc.)

and

http://u.cs.biu.ac.il/~koppel/BlogCorpus.htm

Does anyone have any pointers to other data sets of this type? I would rather they were based on general news type topics, rather than other specific topics.

Thanks very much,

Adam

[Drew]

Hi Adam -

It's not exactly what you're looking for, but I recently uploaded an archive of pull quotes (anything the writer cited as a quote) from many 19 different blogs. There are about 15k quotes with metadata regarding the article they're from.

https://github.com/dbreunig/PullQuote

Might be of help.

Best,

Drew

[Miles Thompson]

On Mon, Nov 19, 2012 at 11:04 AM, Miles Thompson <mi...@hashmapd.com> wrote:

Hi Adam,

Have you looked at the common crawl yet? Not limited to blog posts as far as I know but there may be jobs on there that are doing just that?

http://commoncrawl.org  - https://commoncrawl.atlassian.net/wiki/display/CRWL/About+the+Data+Set

 

For instance if you limited yourself only to content with 'parsed_as'  set to 'rss' that would be just blog posts, pretty much?