Seeing huge delays on task queue execution - 13sec+ per task

101 views
Skip to first unread message

Jan Zawadzki / Hapara

unread,
Mar 27, 2012, 8:25:51 AM3/27/12
to Google App Engine
Is anyone else seeing these delays?

Jan

vlad

unread,
Mar 27, 2012, 6:00:18 PM3/27/12
to google-a...@googlegroups.com
I have been screaming about this for a looong time. The offcial position of GAE team is - we don't guarantee on time execution. Even though this issue is not about on time execution but rather about bugs/inefficiency of their scheduler. They just closed my ticket about that. Feel free to star

http://code.google.com/p/googleappengine/issues/detail?id=7185
http://code.google.com/p/googleappengine/issues/detail?id=4901

Gopal Patel

unread,
Mar 27, 2012, 9:48:48 PM3/27/12
to google-a...@googlegroups.com
i think this happen only when they release a new version of app engine. so it linked to app wise upgrade.

--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/AeanzAICxSAJ.

To post to this group, send email to google-a...@googlegroups.com.
To unsubscribe from this group, send email to google-appengi...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.

Waleed Abdulla

unread,
Mar 28, 2012, 2:16:44 AM3/28/12
to google-a...@googlegroups.com
Agreed. More control over priority of tasks would be nice. I'd like to be able to designate a queue as high-priority so it's tasks execute at the same priority as user requests, or low-priority so they only execute when there are free instances and no other pending requests.

stevep

unread,
Mar 28, 2012, 11:45:12 AM3/28/12
to Google App Engine
Gopal: Sadly your conclusion is entirely incorrect.

As Vlad noted, task queue execution can be highly unpredictable, and
has been for ages. Unfortunately this has been, and perhaps always
will be, a customer issue that GAE engineers/PMs never address. The
irony is that as Robert Kluin pointed out in his recently published
interview, task queues are a primary, standout feature of GAE. Like
much of GAE, however, the promise is there, the enterprise-level
polish is not. -stevep

stevep

unread,
Mar 28, 2012, 11:47:31 AM3/28/12
to Google App Engine
Waleed: Made the best case I could for this exact functionality
perhaps a year ago, perhaps more. Starred an open ticket item Vlad had
created related to it. Fingers still crossed. -stevep

On Mar 27, 11:16 pm, Waleed Abdulla <wal...@ninua.com> wrote:
> Agreed. More control over priority of tasks would be nice. I'd like to be
> able to designate a queue as high-priority so it's tasks execute at the
> same priority as user requests, or low-priority so they only execute when
> there are free instances and no other pending requests.
>
>
>
>
>
>
>
> On Tue, Mar 27, 2012 at 6:48 PM, Gopal Patel <patelgo...@gmail.com> wrote:
> > i think this happen only when they release a new version of app engine. so
> > it linked to app wise upgrade.
>

vlad

unread,
Mar 28, 2012, 4:46:47 PM3/28/12
to google-a...@googlegroups.com
steve, well said. I did not read Robert's interview but I also think of TaskQueue as a last "breakthrough" feature. Since then GAE had released a ton of stuff, but besides File/Blob API, most of it was ...meh - Just my 2c
> > To post to this group, send email to google-appengine@googlegroups.com.
> > To unsubscribe from this group, send email to
> > google-appengine+unsubscribe@googlegroups.com.

Philip

unread,
Mar 30, 2012, 8:44:56 AM3/30/12
to Google App Engine
As far as I know Task Queue is built on top of the regular datastore.
How about providing HR Task Queue - a Task Queue built on top of high
replication datastore?
> > > > To post to this group, send email to google-a...@googlegroups.com.
>
> > > > To unsubscribe from this group, send email to
> > > > google-appengi...@googlegroups.com.

Nicholas Verne

unread,
Mar 30, 2012, 5:54:26 PM3/30/12
to google-a...@googlegroups.com
This is incorrect. Task Queue is not built on the datastore at all.

Vlad Troyanker

unread,
Mar 30, 2012, 6:41:04 PM3/30/12
to google-a...@googlegroups.com
Nick, can we count on fixing TaskQueue scheduling?

http://code.google.com/p/googleappengine/issues/detail?id=7185
Reply all
Reply to author
Forward
0 new messages