Taskqueue stops running tasks several times a day

[Mind]

I have an Android game whose server side is Python on AppEngine.

The app processes the client requests.  These requests result in a need to update the client profile (player stats).  I offload this to a task.

Tasks run fine some days.  On other days, the task queue randomly stops running and refuses to process any tasks.  Synchronous cron jobs also start late or not at all during this time.

Outages can last several minutes to 10's of minutes.  They are not dependent of the volume of client requests (I graph everything) or time of day.  Some days it happens with 20 clients connected ... and other days it is just fine with over 200 clients connected at the same time.

The statistics I don't care too much about, but I ALSO use tasks and CRON to control game flow, cycle to the next game board/etc.  So broken task queue means all my Android user's game clients stop working.

Has anyone else observed anything similar or got any suggestions ? 

[Nicholas Verne]

Please give us your app id so we can investigate. Also, it would help
us if you could give some specific dates/times of outages.

Thanks,

Nick Verne

> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/google-appengine/-/2nvta8dI8gwJ.
> To post to this group, send email to google-a...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengi...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.

[Richard Steventon]

Nick,

I shared a private google docs spreadsheet with you detailing average
number of players per game for this year.

Start at week 21. Column A = (server) time. Anytime the number of
players in a game suddenly goes to zero... is because the taskqueue
stopped running.

When it restarts, one of two things happen:
1) It clears the queue (NO spike in user numbers.... ie: all
unprocessed results from previous games get deleted/lost)
2) It runs the queue (spike in the user count.... ie: all unprocessed
results from previous games get processed)

-Bye
-Richard

[Robert Kluin]

Hey Richard,
Did you ever get an explanation / resolution for this? I have been
seeing this same behavior across a lot of apps that I work with. We
will see one or more queues just stop executing tasks for, typically,
several minutes, but I have seen this last as long as 20 minutes.


Robert

[Mind]

Robert,

Still no response on this from anyone else.

Just this week:
- Monday : no outages ... yes, some days have zero problems!
- Tuesday : 3 outages, incl one for 48 minutes!!!!!
- Today : 2 outages (so far)

-R

> >> For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en.

[vlad]

Mind, did you file a production issue? Not that it assures a
resolution but without details it is easy for GAE team to dismiss
posts like this. I have been there...

[Amy Unruh]

hi,

There's an internal issue created for this, and it's currently being looked at.  Have you filed a production issue?  If so, I can link the two so that you and others can track its resolution.

 -Amy

[Richard Steventon]

I have not filed a production issue.

Sent from my Android phone.