March 2026 Crawl and Web Graphs
13 views
Skip to first unread message
Luca Foppiano
Mar 24, 2026, 4:08:38 PM (2 days ago) Mar 24
to Common Crawl
Hi all,
Our March 2026 Crawl Archive and corresponding Web Graph are now available.
The March 2026 crawl consists of 1.97 billion web pages (or 344.64 TiB of uncompressed content). Captures are from 44 million hosts or 36.1 million registered domains and include 600 million new URLs, not visited in any of our prior crawls.
In this crawl, we observed a dramatic increase in fetches over IPv6, explained by the enabling of Happy Eyeballs in the OkHttp library. See the announcement blog post below for more details, and our recent analysis on IPv6 adoption rates.
In this crawl, we observed a dramatic increase in fetches over IPv6, explained by the enabling of Happy Eyeballs in the OkHttp library. See the announcement blog post below for more details, and our recent analysis on IPv6 adoption rates.
The corresponding
Web Graph release consists of 270.2 million nodes and 9 billion edges at the host level, and 120 million nodes and 4.4 billion edges at the domain level.
Have fun!
Luca
Reply all
Reply to author
Forward
0 new messages