index.commoncrawl.org returning empty responses (March 2026)

[Jose Tafur]

Hi, the CDX index server at index.commoncrawl.org appears to be down. TLS handshake succeeds but the server returns an empty response (curl error 52). This affects both /collinfo.json and collection-specific queries like /CC-MAIN-2025-43-index. Been happening for at least 24 hours. Is there any ETA for a fix?

[Greg Lindahl]

That’s our rate limiter in action. 

cdx-toolkit is an example of code that goes slow enough. Alternatively, use our columnar url index with duckdb or Athena. 

On Wed, Mar 11, 2026 at 7:28 PM Jose Tafur <joset...@gmail.com> wrote:

Hi, the CDX index server at index.commoncrawl.org appears to be down. TLS handshake succeeds but the server returns an empty response (curl error 52). This affects both /collinfo.json and collection-specific queries like /CC-MAIN-2025-43-index. Been happening for at least 24 hours. Is there any ETA for a fix?

--
You received this message because you are subscribed to the Google Groups "Common Crawl" group.
To unsubscribe from this group and stop receiving emails from it, send an email to common-crawl...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/common-crawl/8c4d27cb-d386-46bb-8da8-f862f0350676n%40googlegroups.com.