Sogou web spider bad bot?

Laurent

unread,

Apr 15, 2010, 3:01:46 PM4/15/10

to Lasso Talk

I've got Lasso saturation and crash, and I consider that spider to be very
aggressive on fetching our website :

Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)

Located in China, should I block that network ?

Laurent

--
This list is a free service of LassoSoft: http://www.LassoSoft.com/
Search the list archives: http://www.ListSearch.com/Lasso/Browse/
Manage your subscription: http://www.ListSearch.com/Lasso/

Bil Corry

unread,

Apr 15, 2010, 3:15:42 PM4/15/10

to Lasso Talk

Laurent wrote on 4/15/2010 12:01 PM:
> I've got Lasso saturation and crash, and I consider that spider to be very
> aggressive on fetching our website :
>
> Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
>
> Located in China, should I block that network ?

lp_client_browser identifies that UA as:

map: (typecode)=(S), (version)=(4.0), (type)=(Spam Harvester, Bad Bot), (browser)=(Unknown UA from Chinanet (220.181.26.1xx) faking Sogou search robot), (os)=()

That info came from here:

http://www.user-agents.org/cgi-bin/csv2html.pl?data=allagents.csv&template=detail.html&match=\bid_n_s_280407_1\b

So given it's most likely harvesting email addresses, I'd suggest you block them.

- Bil

Laurent

unread,

Apr 19, 2010, 11:21:07 AM4/19/10

to Lasso Talk

Thank you Bill.

> De : Bil Corry <b...@corry.biz>
> Répondre à : Lasso Talk <la...@lists.lassosoft.com>
> Date : Thu, 15 Apr 2010 12:15:42 -0700
> À : Lasso Talk <la...@lists.lassosoft.com>
> Objet : Re: Sogou web spider bad bot?

--
Subscription settings: http://groups.google.com/group/lassotalk/subscribe?hl=en

Reply all

Reply to author

Forward