Google Groups no longer supports new Usenet posts or subscriptions. Historical content remains viewable.
Dismiss

NNTP Restructure

7 views
Skip to first unread message

Jess

unread,
May 26, 2017, 7:15:53 AM5/26/17
to
name.family.doctor.pro.medical.site.personal.website.free-beer.party

but each one must return a http server code

Jess

unread,
May 26, 2017, 7:45:03 AM5/26/17
to
On Friday, May 26, 2017 at 9:15:53 PM UTC+10, Jess wrote:
> name.family.doctor.pro.medical.site.personal.website.free-beer.party
>
> but each one must return a http server code

can someone write this script and free license it

it just checks mathematically alphabetically from a dictionary data base draws from and name extensions data base returns a http code which if true gets requests index and then stores it.

Its running time could be over a couple days to do a full crawl but we need a solution to index the internet at this time more than ever before.
Google must not run the crawler anymore its all site submissions


Jess

unread,
May 26, 2017, 7:57:47 AM5/26/17
to
it checks mathematically the alphabet so it goes www.a.
www.aa www.aaa www.ab www.aba
0 new messages