November 2025 Crawl and Web Graphs

[Thom Vaughan]

Hi all,

Our November 2025 crawl and Web Graphs are now available.  The November 2025 crawl (CC-MAIN-2025-47) fetched between November 6th and November 19th contains 2.29 billion web pages, or 378 TiB of uncompressed content. Page captures are from 45.2 million hosts or 36.8 million registered domains and include 636 million new URLs, not visited in any of our prior crawls.

The November 2025 Web Graph (cc-main-2025-sep-oct-nov) consists of 235.7 million nodes and 9.5 billion edges at the host level, and 100.7 million nodes and 6.6 billion edges at the domain level.

Thanks to our team members Malte Ostendorff, Hande Çelikkanat, and Damian Stewart for these releases.

Further info below:

🔗 November 2025 Crawl Announcement
🔗 November 2025 Web Graph Announcement
🔗 Crawl Statistics
🔗 Web Graph Statistics

As ever, we'd love to hear from you if you have any comments or suggestions, or if you'd like to share any research.

Cheers, and stay warm!
TV