Upgrade URL index server / 2012 URL index discontinued

Skip to first unread message

Sebastian Nagel

Dec 23, 2020, 8:07:19 AM12/23/20
to Common Crawl
Hi everybody,

today the URL index https://index.commoncrawl.org/ has been moved to new hardware.
Please let us know if anything does not work as expected. Thanks!

The 2012 URL index - https://urlsearch.commoncrawl.org/ - will be discontinued on Jan 11, 2021.
We advice our users to use the 2012 CDX index instead. It's available at


The ARC files of the crawls 2008 - 2012 are included in our CDX indexes since spring 2019
which makes the old 2012 index obsolete.

Best and wish you a Happy New Year,
Reply all
Reply to author
0 new messages