Celery/Redis/DDS with multi server

[k bez]

I use DDS with Celery/Redis in a single server environment just fine. I want to move to a multi server environment for more scrape power.
My idea is to use a Postgre DB with Redis server on Master server and add records with DDS/Celery to Redis only from there.
Slave servers ll run Scrapyd and only consume records from master Redis server and update master Postgre DB.

Anyone have idea how i can implement this scenario or is there a different/better one?

[sif...@aliyun.com]

hello, can you send a document of DDS for me? thank you!