2012 crawl location

102 views
Skip to first unread message

Matthew Berk

unread,
May 16, 2012, 11:39:45 PM5/16/12
to common...@googlegroups.com
Would it be possible to get a definitive status on the 2012 crawl output? Am looking for location(s) and format(s). Thanks!

Matthew

Ben Greenberg

unread,
May 17, 2012, 3:22:02 PM5/17/12
to common...@googlegroups.com
Matthew,

Checkout http://api.commoncrawl.org/blogpost.html

Ben
> --
> You received this message because you are subscribed to the Google Groups
> "Common Crawl" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/common-crawl/-/Ey_LkhGoqO0J.
> To post to this group, send email to common...@googlegroups.com.
> To unsubscribe from this group, send email to
> common-crawl...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/common-crawl?hl=en.

Xuchun Li

unread,
Jun 13, 2012, 5:02:22 AM6/13/12
to common...@googlegroups.com
Hi Matthew,

I can't open the link  http://api.commoncrawl.org/blogpost.html  

Xuchun

Ben Greenberg

unread,
Jun 13, 2012, 4:31:18 PM6/13/12
to common...@googlegroups.com
Here's a cache:
http://webcache.googleusercontent.com/search?q=cache:u3WCGsv_DTIJ:api.commoncrawl.org/blogpost.html+http://api.commoncrawl.org/blogpost.html&cd=1&hl=en&ct=clnk&gl=us&client=safari

Not sure why they took it down
> --
> You received this message because you are subscribed to the Google Groups
> "Common Crawl" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/common-crawl/-/aqz57sRjhaoJ.

Ahad Rana

unread,
Jun 13, 2012, 4:52:39 PM6/13/12
to common...@googlegroups.com
Hi,

Sorry we are in the middle of a data center move, so some our internal websites / services are down for now. 

Ahad.

Xuchun Li

unread,
Jun 13, 2012, 11:51:05 PM6/13/12
to common...@googlegroups.com
Hi Ahad,

So when will be the services ready?

Another important question: how can I get the web site list which are crawled by common-crawl? Thanks.

Xuchun
Reply all
Reply to author
Forward
0 new messages