Tasks are not issued correctly, causing major malfunction in my ap

64 views
Skip to first unread message

ZeroCool

unread,
Apr 12, 2012, 9:55:07 AM4/12/12
to Google App Engine
Someone please look into this issue.
It's killing me.
The problem is spreading.
pe-server5
pe-server7
pe-server8

Jeff Schnitzer

unread,
Apr 12, 2012, 10:59:30 AM4/12/12
to google-a...@googlegroups.com
Your description of the problem is useless.

Jeff

> --
> You received this message because you are subscribed to the Google Groups "Google App Engine" group.
> To post to this group, send email to google-a...@googlegroups.com.
> To unsubscribe from this group, send email to google-appengi...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
>

ZeroCool

unread,
Apr 12, 2012, 11:37:40 AM4/12/12
to Google App Engine
My apps use transactional tasks to defer transactions across entity
groups.
This behavior has been working for over a year.
From yesterday, they started to fail silently.
Many of my transactions can't complete due to this changed behavior.
I know, we now can use cross group transactions. But shouldn't the
previous version remain supported for 3 years?

Jeff Schnitzer

unread,
Apr 12, 2012, 1:37:21 PM4/12/12
to google-a...@googlegroups.com
Please describe the problem in a lot more detail. You're speaking as
if we understand what's going on. Nobody does. Fail silently? What
does that mean? The tasks don't execute but stay in the queue? The
tasks don't get added to the queue? If you want help, you have to do
a lot more than say "my app is broken".

I enqueue transactional tasks all the time. I use this to string out
a transactional operation across dozens of entity groups. It works
fine.

Jeff

2012/4/12 ZeroCool <zer...@gmail.com>:

powera (App Engine Reliablity)

unread,
Apr 12, 2012, 3:37:21 PM4/12/12
to Google App Engine
I've looked at the app, and it seems the problem is that the rate of
task execution is very low right now and there is a large backlog of
pending tasks. I'm testing a fix to pe-server5, if it works I will
apply it to the other apps.

On Apr 12, 10:37 am, Jeff Schnitzer <j...@infohazard.org> wrote:
> Please describe the problem in a lot more detail.  You're speaking as
> if we understand what's going on.  Nobody does.  Fail silently?  What
> does that mean?  The tasks don't execute but stay in the queue?  The
> tasks don't get added to the queue?  If you want help, you have to do
> a lot more than say "my app is broken".
>
> I enqueue transactional tasks all the time.  I use this to string out
> a transactional operation across dozens of entity groups.  It works
> fine.
>
> Jeff
>
> 2012/4/12 ZeroCool <zero...@gmail.com>:

nischalshetty

unread,
Apr 12, 2012, 10:13:42 PM4/12/12
to google-a...@googlegroups.com
We too are facing the slow task execution rate problem. Tasks are integral to our app. I've logged a production issue here - 


Anyone else facing the issue please star and leave a comment on the above issue with your app ids.
> >> > To post to this group, send email to google-appengine@googlegroups.com.
> >> > To unsubscribe from this group, send email to google-appengine+unsubscribe@googlegroups.com.
> >> > For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en.
>
> > --
> > You received this message because you are subscribed to the Google Groups "Google App Engine" group.
> > To post to this group, send email to google-appengine@googlegroups.com.
> > To unsubscribe from this group, send email to google-appengine+unsubscribe@googlegroups.com.

powera (App Engine Reliablity)

unread,
Apr 13, 2012, 12:17:08 AM4/13/12
to Google App Engine
Yes, that's the same problem. It seems to be affecting a very small
number of apps right now. I've fixed your app as well as a few others
that seem to be having this problem.

For other people seeing a similar problem, updating that issue with
your app id is probably the fastest way to get resolution if you see
this issue.
> > google-a...@googlegroups.com.
> > > >> > To unsubscribe from this group, send email to
> > google-appengi...@googlegroups.com.
> > > >> > For more options, visit this group athttp://
> > groups.google.com/group/google-appengine?hl=en.
>
> > > > --
> > > > You received this message because you are subscribed to the Google
> > Groups "Google App Engine" group.
> > > > To post to this group, send email to google-a...@googlegroups.com.
>
> > > > To unsubscribe from this group, send email to
> > google-appengi...@googlegroups.com.

nischalshetty

unread,
Apr 13, 2012, 1:34:58 AM4/13/12
to google-a...@googlegroups.com
Thank you. The execution rate seems to have picked up (still a lot of pending tasks). Hoping it gets cleared soon. I'll update you if the execution rate drops again. 

Once again, thanks a lot for fixing this.
> > > >> > To unsubscribe from this group, send email to
> > > >> > For more options, visit this group athttp://
> > groups.google.com/group/google-appengine?hl=en.
>
> > > > --
> > > > You received this message because you are subscribed to the Google
> > Groups "Google App Engine" group.
> > > > To post to this group, send email to google-appengine@googlegroups.com.
>
> > > > To unsubscribe from this group, send email to

ZeroCool

unread,
Apr 13, 2012, 3:57:55 AM4/13/12
to google-a...@googlegroups.com
Sorry, I was out of my mind because of user complaints.
Just as powera stated, the tasks stayed in the queue because of low throughput.
They are now working fine.
Cheers.

>> > To post to this group, send email to google-appengine@googlegroups.com.
>> > To unsubscribe from this group, send email to google-appengine+unsubscribe@googlegroups.com.


>> > For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en.
>
> --
> You received this message because you are subscribed to the Google Groups "Google App Engine" group.

> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to google-appengine+unsubscribe@googlegroups.com.

ZeroCool

unread,
Apr 13, 2012, 4:02:29 AM4/13/12
to google-a...@googlegroups.com
Thank you very much for the help.
The apps have returned to normal state.
Lessons learned: be careful to use task queues to spread transactions, either spread them into different queues or simply don't use the method at all.
It was a work around before XG transactions.
I will use cross group transaction as often as possible.
> > > >> > To unsubscribe from this group, send email to
> > > >> > For more options, visit this group athttp://
> > groups.google.com/group/google-appengine?hl=en.
>
> > > > --
> > > > You received this message because you are subscribed to the Google
> > Groups "Google App Engine" group.
> > > > To post to this group, send email to google-appengine@googlegroups.com.
>
> > > > To unsubscribe from this group, send email to
> > > > For more options, visit this group athttp://
> > groups.google.com/group/google-appengine?hl=en.
> > google-appengine@googlegroups.com.
> > > >> > To unsubscribe from this group, send email to
> > google-appengine+unsubscribe@googlegroups.com.
> > > >> > For more options, visit this group athttp://
> > groups.google.com/group/google-appengine?hl=en.
>
> > > > --
> > > > You received this message because you are subscribed to the Google
> > Groups "Google App Engine" group.
> > > > To post to this group, send email to google-appengine@googlegroups.com.
>
> > > > To unsubscribe from this group, send email to
> > google-appengine+unsubscribe@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages