How to block a domain?

28 views
Skip to first unread message

Peter

unread,
Oct 12, 2009, 8:47:38 AM10/12/09
to Page2RSS
Hi,

I'd like to block page2rss from my site but page2rss doesn't follow
the robots.txt and I couldn't find another contact form or even email.

So, how can I block page2rss from spidering my page without my
consent?

(Yeah I know I should be glad that other people like my content, but
that's a special case here.)


Thanks,

Peter

Konstantin

unread,
Oct 13, 2009, 2:33:09 PM10/13/09
to page...@googlegroups.com
Peter,

Please send domain name or page urls you would like to block to
privacy at page2rss.com.

Best Regards,
Konstantin

VulturEMaN

unread,
Oct 13, 2009, 3:00:08 PM10/13/09
to Page2RSS
I fail to see the special case in a coupon website forcing you to use
their firefox addon for instant updates (which is probably its own
RSS).
I'd just use a different coupon website if it lacked an RSS and
blocked page2rss.

My .02

Peter

unread,
Oct 13, 2009, 3:15:12 PM10/13/09
to Page2RSS
I'll gladly explain:

We publish a lot of codes and no normal user is interested in 50
coupon codes and deals each day. The only ones interested in all this
data is our competition and shady sites that just republish the
content. I don't think they should profit from our work so easily.

Sure, you can't stop that for 100%, but I'd like it to make it a
little bit harder for them.

I'm sure you can understand.

Also, if some legitimate user would like the full RSS feed of all the
new coupons, he can send the support a quick email and we'll happily
give him the feed.

Lance W. Haverkamp

unread,
Oct 13, 2009, 4:30:21 PM10/13/09
to page...@googlegroups.com
on 10/13/2009 01:15 PM Peter said the following:

>
> Also, if some legitimate user would like the full RSS feed of all the
> new coupons, he can send the support a quick email and we'll happily
> give him the feed.
>

That a good marketing concession, make sure your users know that you
will help them that way.

Just to make sure you understand the difference: page2rss is not a
spider so it should not follow robots.txt. Spiders mindlessly crawl
links, page2rss is fetching information a real-live person specifically
requested.


--


Thanks!

Lance W. Haverkamp
La...@TheHaverkamps.net
Contact & encryption info:
http://thehaverkamps.net/?Lance:Contact_Me
http://facebook.com/LanceHaverkamp

<>< <>< <><


***
This email has been stamped using Penny Post. Stamping email helps
combat spam.
Find out more about stamping your email at: http://pennypost.sourceforge.net

Reply all
Reply to author
Forward
0 new messages