WordPress domain observed in monthly crawls

[Ravindu De Silva]

Dear Team

Thank you so much for keeping this amazing project public and accessible to everyone. I have a small question: what is the average number of WordPress domains(FQDNS) you've observed in your monthly crawling? Have you ever computed that?

Best

Ravindu

[Greg Lindahl]

Ravindu,

Our Web Graph hosts tsv will tell you about subdomains of *.wordpress.com and *.wordpress.org.

Many wordpress installations use a custom domain name.

For your question, this file is a tsv of all domains:

https://data.commoncrawl.org/projects/hyperlinkgraph/cc-main-2025-jan-feb-mar/domain/cc-main-2025-jan-feb-mar-domain-ranks.txt.gz

and has the count of subdomains of all domains. wordpress.com has 2,370,713 subdomains.

-- greg

--
You received this message because you are subscribed to the Google Groups "Common Crawl" group.
To unsubscribe from this group and stop receiving emails from it, send an email to common-crawl...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/common-crawl/d7f8c65a-b983-4b34-a174-dff40779aeedn%40googlegroups.com.

[Kajol bj]

To view this discussion visit https://groups.google.com/d/msgid/common-crawl/CABQM%2BAxMVc4u8tr9iHEq%3DMYKV5SRLiggRJRX3M8eDnN45WUdUg%40mail.gmail.com.