--
You received this message because you are subscribed to the Google Groups "Common Crawl" group.
To unsubscribe from this group and stop receiving emails from it, send an email to common-crawl+unsubscribe@googlegroups.com.
To post to this group, send email to common...@googlegroups.com.
Visit this group at https://groups.google.com/group/common-crawl.
For more options, visit https://groups.google.com/d/optout.
This is what you are looking for: https://publicsuffix.org/list/I use this list for my crawler to identify hostnames found.
On Mon, Aug 22, 2016 at 12:32 AM, Bhavik Hingrajia <bhav...@gmail.com> wrote:
Hi
There is no any source to get list of new registered and active CCTLDs. So is there any way we can scrap all the domains (CCTLDs ) which are active and which get registered at some time interval.
I don't find any good source of the same. Some are selling but that seems pricy and I need to something automated so it works itself and put it to my server.
--
You received this message because you are subscribed to the Google Groups "Common Crawl" group.
To unsubscribe from this group and stop receiving emails from it, send an email to common-crawl...@googlegroups.com.