Hi,
I've been developing a reverse lookup tool, using the task queue and datastore in PHP, in order to prevent duplicate crawling we decided to assign names in the task queue (the domain name) however since configuring this the task queue on my local environment isn't running at all. Is there a reason why this might be?
I've not tested it live, because it isn't ready, the queue.yaml file for this queue is:
- name: domaincrawler
rate: 1/s
max_concurrent_requests: 10
Please let me know if you have any ideas.
Best,
Ant