May 2016 crawl archive now available
29 views
Skip to first unread message
Sebastian Nagel
Jun 20, 2016, 8:31:54 AM6/20/16
to common...@googlegroups.com
Hi all,
the May 2016 crawl archive is now available. It contains 1.46 billion web pages
and includes 400 million seed URLs donated by Moz [1], in addition to the seeds used
in the preceding crawl. More details about the May crawl can be found on our blog [2].
Sebastian
[1] https://moz.com
[2] http://commoncrawl.org/2016/06/may-2016-crawl-archive-now-available/
the May 2016 crawl archive is now available. It contains 1.46 billion web pages
and includes 400 million seed URLs donated by Moz [1], in addition to the seeds used
in the preceding crawl. More details about the May crawl can be found on our blog [2].
Sebastian
[1] https://moz.com
[2] http://commoncrawl.org/2016/06/may-2016-crawl-archive-now-available/
Reply all
Reply to author
Forward
0 new messages