RSS/Atom feed fetch error: Cloudflare "403 forbidden"

[ta...@chepec.se]

I was attempting to subscribe to my own RSS/Atom feeds using my TinyTinyRSS feed reader (which I have used for years, many hundreds of feeds).

When trying to subscribe, TTRSS shows:

Couldn't download the specified URL: HTTP/1.1 403 Forbidden (feed behind Cloudflare)

I am pretty sure this is not a TTRSS issue.

I did some testing with wget from my TTRSS IP address, as well as from my local machine's IP address, and the former is consistenly denied (403 forbidden) whereas the latter is not (200 OK).

Previous reports by other users in the TTRSS forums strongly suggest that the problem is caused by Cloudflare over-zealously blocking what it thinks are bots. See below.

https://discourse.tt-rss.org/t/http-403-and-cloudflare/628/4

https://discourse.tt-rss.org/t/cant-add-feed-msg-specified-url-could-not-be-downloaded-false/1155/5

The same forum posts also suggest the service provider (Hypothes.is in this case) can remedy this problem by relaxing its Cloudflare settings. 

Is this something Hypothes.is would consider looking into? As it is now, I cannot subscribe to any of your users' Atom/RSS feeds (and I've tried my own as well as those of other users and tags).

N.B: the main Hypothes.is feed (https://web.hypothes.is/feed/) appears to be delivered through some other mechanism though, because I can both subscribe to it and wget it from my TTRSS machine without any problems. Confirmed: a quick lookup shows that web.hypothes.is points to 23.185.0.3, whereas hypothes.is points to 104.20.215.15 and 104.20.214.15, which are Cloudflare IPs).

I guess what I'm asking for is for Hypothes.is to relax or adjust your Cloudflare settings so we can subscribe to the hypothes.is user feeds without this mysterious IP-based block. Or, please explain what we are supposed to do be able to subscribe to Hypothes.is user feeds (does Cloudflare have a list of all blocked IP ranges published somewhere? should I contact Linode about this? any other remedies?).

[Katelyn Lemay]

Hello,

We have instructions for RSS/Atom feeds of annotations here: https://web.hypothes.is/help/atom-rss-feeds-for-annotations/

Basically, you start with a query that begins with either https://hypothes.is/stream.atom or https://hypothes.is/stream.rss and add parameters to get tweets by URL, tag, or user. 

I hope this helps,

Katelyn

--
You received this message because you are subscribed to the Google Groups "dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dev+uns...@list.hypothes.is.
To post to this group, send email to d...@list.hypothes.is.
To view this discussion on the web visit https://groups.google.com/a/list.hypothes.is/d/msgid/dev/9c93e3c8-cb84-4e39-9090-490c7894b73a%40list.hypothes.is.

[ta...@chepec.se]

Thanks for replying!

But that's not the problem at all. I've read the RSS/Atom instructions and followed them. 

The problem is that your feeds are inaccessible from certain IP addresses but not from others.

According to the other forum posts I found online, this is most likely related to your content delivery provider (Cloudflare) blocking IP addresses based on too strict criteria. I see no reason why any Linode IP address should be blocked from reading your RSS feeds?

Hypothes.is could probably rectify this issue by adjusting your Cloudflare anti-bot settings, or similar.

Regards,
Taha

[kat...@hypothes.is]

Taha,

Sorry for misunderstanding - I'll check with someone who has Cloudflare admin access to see if they can look into it.

-Katelyn

[kat...@hypothes.is]

Hi Taha,

We don't have anyone available to tackle this right away, but I've created a Github issue which you can track here: https://github.com/hypothesis/product-backlog/issues/710

Best,

Katelyn

[kat...@hypothes.is]

Taha, 

A suggestion from our Director of Integrations: 

prefix the feed with https://via.hypothes.is and see if that solves it.

If that works, you'll have a workaround until the Cloudflare issue is resolved.

Best,

Katelyn 

On Tuesday, July 10, 2018 at 9:20:22 AM UTC-4, ta...@chepec.se wrote:

[ta...@chepec.se]

Thank you for opening a Github issue, and for the suggestion. I think we'll be better off continuing this on Github (nicer editor, right)?

/T