maintained list of domains in index

82 views
Skip to first unread message

Jamie Costello

unread,
Jul 27, 2015, 7:54:45 AM7/27/15
to Common Crawl
Hi guys,

Wow what a great project, can't believe I haven't heard of you guys before now!

I'm starting a little research project and I'm wondering if you maintain a list of domains in your index anywhere. I was going to download the URL index (220GB) and strip the domains out of that but thought I'd just check first to see if there is a list anywhere of just the domains?

Thanks :-)

Jamie

Hassan Amir

unread,
Aug 10, 2015, 5:02:29 AM8/10/15
to Common Crawl
Reply all
Reply to author
Forward
0 new messages