Run 000s of jobs using APscheduler

[Vanya Sahu]

Hi I have to schedule jobs for over 10k servers and they need to hit an API every 5 minutes. When I try to do this via Apscheduler, most of the jobs remain unfinished as their next execution time starts without getting the opportunity for the first one to finish. Can someome guide me how to move further on this?

[Alex Grönholm]

What do you want to happen when a job is due for execution but the previous instance is still running?

Vanya Sahu kirjoitti 1.2.2022 klo 15.20:

Hi I have to schedule jobs for over 10k servers and they need to hit an API every 5 minutes. When I try to do this via Apscheduler, most of the jobs remain unfinished as their next execution time starts without getting the opportunity for the first one to finish. Can someome guide me how to move further on this? --
You received this message because you are subscribed to the Google Groups "APScheduler" group.
To unsubscribe from this group and stop receiving emails from it, send an email to apscheduler...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/apscheduler/fa198b15-9ecc-4da9-a72b-0b0d68d25de6n%40googlegroups.com.

[Vanya Sahu]

I'd want them both to execute, but if the time is beyond certain limit, example 2 hours, then I want to ignore the oldest pending job.

Thanks and Regards

Vanya Sahu

Phone - 9873877103

To view this discussion on the web visit https://groups.google.com/d/msgid/apscheduler/d9102166-d97a-32a7-ce0e-a64fe8a1a638%40nextday.fi.

[Alex Grönholm]

Such sophisticated logic is not currently possible with APScheduler. You're better off implementing such guards on your own.

To view this discussion on the web visit https://groups.google.com/d/msgid/apscheduler/CACOHDTYfOqedy1VmKeB0C%3DWASdxsEJgF%2BnkJbCL9GRnWdSiXKA%40mail.gmail.com.