[REDIS] Short circuiting due to recent redis failure

[Leonardo Penna]

Hi everyone!

We have Canvas running on 4 different servers (1. app; 2. db; 3. automated jobs; 4. redis), with an NFS for the shared files.

The setup works as expected, but whenever we try to open an external tool (going through the OAuth flow), we receive a 502 Bad Gateway error. And the following message appears in the production.log:

[REDIS] Short circuiting due to recent redis failure (xxx.xxx.xxx.xxx:6379)

When I move Redis back to the app server, everything works.

Here's the redis.yml (used in the app and automated jobs server):

production:
   servers:
      - redis://xx.xxx.xxx.xxx:6379

And cache_store.yml:

production:
   cache_store: redis_cache_store

Am I missing something? Thanks!

[Leonardo Penna]

I found the solution here:

https://stackoverflow.com/questions/8537254/redis-connect-to-remote-server

Redis was not listening to non-local interfaces.

Best,