On Friday, May 26, 2017 at 9:15:53 PM UTC+10, Jess wrote:
> name.family.doctor.pro.medical.site.personal.website.free-beer.party
>
> but each one must return a http server code
can someone write this script and free license it
it just checks mathematically alphabetically from a dictionary data base draws from and name extensions data base returns a http code which if true gets requests index and then stores it.
Its running time could be over a couple days to do a full crawl but we need a solution to index the internet at this time more than ever before.
Google must not run the crawler anymore its all site submissions