website "friendly" towards selenium

54 views
Skip to first unread message

THUFIR HAWAT

unread,
Dec 16, 2018, 1:48:49 PM12/16/18
to Selenium Users
What might be a website which would be friendly towards the multiple hits selenium will provide?  CNN?

Shawn McCarthy

unread,
Dec 16, 2018, 5:07:39 PM12/16/18
to Selenium Users
your own website

thufir

unread,
Dec 17, 2018, 5:09:17 AM12/17/18
to seleniu...@googlegroups.com
Fair enough. I did come across:

Here is the full list of Complete Allow Sites:

360.cn

fc2.com

livejasmin.com

popads.net

qq.com

soundcloud.com

uol.com.br


https://towardsdatascience.com/scraping-the-internets-most-popular-websites-a4c6f0be382d
> --
> You received this message because you are subscribed to the Google
> Groups "Selenium Users" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to selenium-user...@googlegroups.com
> <mailto:selenium-user...@googlegroups.com>.
> To post to this group, send email to seleniu...@googlegroups.com
> <mailto:seleniu...@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/selenium-users/8e595828-09da-4e90-969c-db1fa0b3200a%40googlegroups.com
> <https://groups.google.com/d/msgid/selenium-users/8e595828-09da-4e90-969c-db1fa0b3200a%40googlegroups.com?utm_medium=email&utm_source=footer>.
> For more options, visit https://groups.google.com/d/optout.

Shawn McCarthy

unread,
Dec 17, 2018, 10:42:45 AM12/17/18
to Selenium Users
Just from soundcloud, I see this :

(iv) You must not employ scraping or similar techniques to aggregate, repurpose, republish or otherwise make use of any Content.

(v) You must not employ any techniques or make use of any services, automated or otherwise, designed to misrepresent the popularity of Your Content on the Platform, or to misrepresent your activity on the Platform, including without limitation by the use of bots, botnets, scripts, apps, plugins, extensions or other automated means to register accounts, log in, add followers to your account, play Content, follow or unfollow other users, send messages, post comments, or otherwise to act on your behalf, particularly where such activity occurs in a multiple or repetitive fashion. You must not offer or promote the availability of any such techniques or services to any other users of the Platform.



On Monday, December 17, 2018 at 3:09:17 AM UTC-7, THUFIR HAWAT wrote:
Fair enough.  I did come across:

Here is the full list of Complete Allow Sites:

360.cn

fc2.com

livejasmin.com

popads.net

qq.com

soundcloud.com

uol.com.br


https://towardsdatascience.com/scraping-the-internets-most-popular-websites-a4c6f0be382d

On 2018-12-16 2:07 p.m., Shawn McCarthy wrote:
> your own website
>
> On Sunday, December 16, 2018 at 11:48:49 AM UTC-7, THUFIR HAWAT wrote:
>
>     What might be a website which would be friendly towards the multiple
>     hits selenium will provide?  CNN?
>
> --
> You received this message because you are subscribed to the Google
> Groups "Selenium Users" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to selenium-user...@googlegroups.com

thufir

unread,
Dec 17, 2018, 10:46:52 AM12/17/18
to seleniu...@googlegroups.com
Fair enough. I was actually thinking of starting with patent office.
Since I'm not aggregating, reporposing or publishing, actually, probably
would be okay.

First I have to get my import statements working though!

It was a shot in the dark :)


-Thufir

On 2018-12-17 7:42 a.m., Shawn McCarthy wrote:
> Just from soundcloud, I see this :
> https://soundcloud.com/terms-of-use#acceptance-of-terms-of-use
>
> (iv) You must not employ scraping or similar techniques to aggregate,
> repurpose, republish or otherwise make use of any Content.
>
> (v) You must not employ any techniques or make use of any services,
> automated or otherwise, designed to misrepresent the popularity of Your
> Content on the Platform, or to misrepresent your activity on the
> Platform, including without limitation by the use of bots, botnets,
> scripts, apps, plugins, extensions or other automated means to register
> accounts, log in, add followers to your account, play Content, follow or
> unfollow other users, send messages, post comments, or otherwise to act
> on your behalf, particularly where such activity occurs in a multiple or
> repetitive fashion. You must not offer or promote the availability of
> any such techniques or services to any other users of the Platform.
>
>
>
> On Monday, December 17, 2018 at 3:09:17 AM UTC-7, THUFIR HAWAT wrote:
>
> Fair enough.  I did come across:
>
> Here is the full list of Complete Allow Sites:
>
> 360.cn <http://360.cn>
>
> fc2.com <http://fc2.com>
>
> livejasmin.com <http://livejasmin.com>
>
> popads.net <http://popads.net>
>
> qq.com <http://qq.com>
>
> soundcloud.com <http://soundcloud.com>
>
> uol.com.br <http://uol.com.br>
>
>
> https://towardsdatascience.com/scraping-the-internets-most-popular-websites-a4c6f0be382d
> <https://towardsdatascience.com/scraping-the-internets-most-popular-websites-a4c6f0be382d>
>
>
> On 2018-12-16 2:07 p.m., Shawn McCarthy wrote:
> > your own website
> >
> > On Sunday, December 16, 2018 at 11:48:49 AM UTC-7, THUFIR HAWAT
> wrote:
> >
> >     What might be a website which would be friendly towards the
> multiple
> >     hits selenium will provide?  CNN?
> >
> > --
> > You received this message because you are subscribed to the Google
> > Groups "Selenium Users" group.
> > To unsubscribe from this group and stop receiving emails from it,
> send
> > an email to selenium-user...@googlegroups.com <javascript:>
> > <mailto:selenium-user...@googlegroups.com <javascript:>>.
> > To post to this group, send email to seleniu...@googlegroups.com
> <javascript:>
> > <mailto:seleniu...@googlegroups.com <javascript:>>.
> <https://groups.google.com/d/msgid/selenium-users/8e595828-09da-4e90-969c-db1fa0b3200a%40googlegroups.com?utm_medium=email&utm_source=footer
> <https://groups.google.com/d/optout>.
>
> --
> You received this message because you are subscribed to the Google
> Groups "Selenium Users" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to selenium-user...@googlegroups.com
> <mailto:selenium-user...@googlegroups.com>.
> To post to this group, send email to seleniu...@googlegroups.com
> <mailto:seleniu...@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/selenium-users/96855e8e-e13e-4aab-8ee0-e744b648ee78%40googlegroups.com
> <https://groups.google.com/d/msgid/selenium-users/96855e8e-e13e-4aab-8ee0-e744b648ee78%40googlegroups.com?utm_medium=email&utm_source=footer>.

Joe Ward

unread,
Dec 17, 2018, 1:28:55 PM12/17/18
to seleniu...@googlegroups.com

To unsubscribe from this group and stop receiving emails from it, send an email to selenium-user...@googlegroups.com.
To post to this group, send email to seleniu...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/selenium-users/3f6ccd49-783a-8eba-c850-ae144fa4e694%40gmail.com.

thufir

unread,
Dec 18, 2018, 9:19:24 AM12/18/18
to seleniu...@googlegroups.com
thanks, I'm going to start using that on my project:

https://github.com/THUFIR/HelloSeleniumWorld
> > 360.cn <http://360.cn> <http://360.cn>
> >
> > fc2.com <http://fc2.com> <http://fc2.com>
> >
> > livejasmin.com <http://livejasmin.com> <http://livejasmin.com>
> >
> > popads.net <http://popads.net> <http://popads.net>
> >
> > qq.com <http://qq.com> <http://qq.com>
> >
> > soundcloud.com <http://soundcloud.com> <http://soundcloud.com>
> >
> > uol.com.br <http://uol.com.br> <http://uol.com.br>
> >
> >
> >
> https://towardsdatascience.com/scraping-the-internets-most-popular-websites-a4c6f0be382d
> >
>  <https://towardsdatascience.com/scraping-the-internets-most-popular-websites-a4c6f0be382d>
> >
> >
> >     On 2018-12-16 2:07 p.m., Shawn McCarthy wrote:
> >      > your own website
> >      >
> >      > On Sunday, December 16, 2018 at 11:48:49 AM UTC-7, THUFIR
> HAWAT
> >     wrote:
> >      >
> >      >     What might be a website which would be friendly
> towards the
> >     multiple
> >      >     hits selenium will provide?  CNN?
> >      >
> >      > --
> >      > You received this message because you are subscribed to
> the Google
> >      > Groups "Selenium Users" group.
> >      > To unsubscribe from this group and stop receiving emails
> from it,
> >     send
> >      > an email to selenium-user...@googlegroups.com
> <mailto:selenium-user...@googlegroups.com> <javascript:>
> >      > <mailto:selenium-user...@googlegroups.com
> <mailto:selenium-users%2Bunsu...@googlegroups.com> <javascript:>>.
> >      > To post to this group, send email to
> seleniu...@googlegroups.com <mailto:seleniu...@googlegroups.com>
> >     <javascript:>
> >      > <mailto:seleniu...@googlegroups.com
> <mailto:seleniu...@googlegroups.com> <javascript:>>.
> >      > To view this discussion on the web visit
> >      >
> >
> https://groups.google.com/d/msgid/selenium-users/8e595828-09da-4e90-969c-db1fa0b3200a%40googlegroups.com
> >
>  <https://groups.google.com/d/msgid/selenium-users/8e595828-09da-4e90-969c-db1fa0b3200a%40googlegroups.com>
> >
> >      >
> >
>  <https://groups.google.com/d/msgid/selenium-users/8e595828-09da-4e90-969c-db1fa0b3200a%40googlegroups.com?utm_medium=email&utm_source=footer
> >
>  <https://groups.google.com/d/msgid/selenium-users/8e595828-09da-4e90-969c-db1fa0b3200a%40googlegroups.com?utm_medium=email&utm_source=footer>>.
> >
> >      > For more options, visit https://groups.google.com/d/optout
> >     <https://groups.google.com/d/optout>.
> >
> > --
> > You received this message because you are subscribed to the Google
> > Groups "Selenium Users" group.
> > To unsubscribe from this group and stop receiving emails from it,
> send
> > an email to selenium-user...@googlegroups.com
> <mailto:selenium-users%2Bunsu...@googlegroups.com>
> > <mailto:selenium-user...@googlegroups.com
> <mailto:selenium-users%2Bunsu...@googlegroups.com>>.
> > To post to this group, send email to
> seleniu...@googlegroups.com
> <mailto:seleniu...@googlegroups.com>
> > <mailto:seleniu...@googlegroups.com
> <mailto:seleniu...@googlegroups.com>>.
> > To view this discussion on the web visit
> >
> https://groups.google.com/d/msgid/selenium-users/96855e8e-e13e-4aab-8ee0-e744b648ee78%40googlegroups.com
>
> >
> <https://groups.google.com/d/msgid/selenium-users/96855e8e-e13e-4aab-8ee0-e744b648ee78%40googlegroups.com?utm_medium=email&utm_source=footer>.
> > For more options, visit https://groups.google.com/d/optout.
>
> --
> You received this message because you are subscribed to the Google
> Groups "Selenium Users" group.
> To unsubscribe from this group and stop receiving emails from it,
> send an email to selenium-user...@googlegroups.com
> <mailto:selenium-users%2Bunsu...@googlegroups.com>.
> To post to this group, send email to seleniu...@googlegroups.com
> <mailto:seleniu...@googlegroups.com>.
> To view this discussion on the web visit
> --
> You received this message because you are subscribed to the Google
> Groups "Selenium Users" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to selenium-user...@googlegroups.com
> <mailto:selenium-user...@googlegroups.com>.
> To post to this group, send email to seleniu...@googlegroups.com
> <mailto:seleniu...@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/selenium-users/CAJPyTs2p2uPvOiZm5cPcDb3B_3EC4Mc_WKz3JS9uEdy6GG%3Dy%2BQ%40mail.gmail.com
> <https://groups.google.com/d/msgid/selenium-users/CAJPyTs2p2uPvOiZm5cPcDb3B_3EC4Mc_WKz3JS9uEdy6GG%3Dy%2BQ%40mail.gmail.com?utm_medium=email&utm_source=footer>.
Reply all
Reply to author
Forward
0 new messages