Upgrade URL index server / 2012 URL index discontinued
52 views
Skip to first unread message
Sebastian Nagel
Dec 23, 2020, 8:07:19 AM12/23/20
to Common Crawl
Hi everybody,
today the URL index https://index.commoncrawl.org/ has been moved to new hardware.
Please let us know if anything does not work as expected. Thanks!
The 2012 URL index - https://urlsearch.commoncrawl.org/ - will be discontinued on Jan 11, 2021.
We advice our users to use the 2012 CDX index instead. It's available at
https://index.commoncrawl.org/CC-MAIN-2012
The ARC files of the crawls 2008 - 2012 are included in our CDX indexes since spring 2019
which makes the old 2012 index obsolete.
Best and wish you a Happy New Year,
Sebastian
today the URL index https://index.commoncrawl.org/ has been moved to new hardware.
Please let us know if anything does not work as expected. Thanks!
The 2012 URL index - https://urlsearch.commoncrawl.org/ - will be discontinued on Jan 11, 2021.
We advice our users to use the 2012 CDX index instead. It's available at
https://index.commoncrawl.org/CC-MAIN-2012
The ARC files of the crawls 2008 - 2012 are included in our CDX indexes since spring 2019
which makes the old 2012 index obsolete.
Best and wish you a Happy New Year,
Sebastian
Reply all
Reply to author
Forward
0 new messages