Upgrade URL index server / 2012 URL index discontinued

45 views
Skip to first unread message

Sebastian Nagel

unread,
Dec 23, 2020, 8:07:19 AM12/23/20
to Common Crawl
Hi everybody,


today the URL index https://index.commoncrawl.org/ has been moved to new hardware.
Please let us know if anything does not work as expected. Thanks!


The 2012 URL index - https://urlsearch.commoncrawl.org/ - will be discontinued on Jan 11, 2021.
We advice our users to use the 2012 CDX index instead. It's available at

https://index.commoncrawl.org/CC-MAIN-2012

The ARC files of the crawls 2008 - 2012 are included in our CDX indexes since spring 2019
which makes the old 2012 index obsolete.


Best and wish you a Happy New Year,
Sebastian
Reply all
Reply to author
Forward
0 new messages