Andrew Richardson
Feb 14, 2012, 10:23:12 AM2/14/12
to google-a...@googlegroups.com
My app uses the Task Queue to send email messages...and a few days ago, I must have gotten a bad task in the queue. One of the tasks has been failing and retrying endlessly, eating up all my email quota (I guess they count against your quota even with the message fails to send).
Yesterday I paused my "email" queue, deleted a few tasks that looked like they could be causing problems, and was hoping to dispatch the rest by hand this morning to make sure they went out. But again, as soon as my quotas were reset, my app went wild and blew up all the email quota for today.
In the logs I see references to retries for things like "X-Appengine-Queuename:email, X-Appengine-Taskname:2162362032997459024" - but the email queue was supposedly paused, and that task number was not even in the queue! It's probably one of the ones I deleted by hand - is it expected for this task to still be present and running? Today I purged the email queue and set it to a retry limit of 2...so I'm hoping that helps.
Maybe I'm misunderstanding how Task Queues are supposed to work - I thought that pausing it would stop any pending tasks from executing until I resumed it? I hope someone can shed some light on this...thanks!
Robert Kluin
Feb 14, 2012, 11:48:39 PM2/14/12
to google-a...@googlegroups.com
Hey Andrew,
Are you sure that task was run in your email queue? Perhaps it was
run in the default queue?
Are you sure that task was run in your email queue? Perhaps it was
run in the default queue?
Do your tasks run on front-ends or backends? Just asking in case
there is a long-running processon a backend sitting there spinning and
consuming your email quota.
Robert
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/google-appengine/-/9G15Fj4GRBQJ.
> To post to this group, send email to google-a...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengi...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
Andrew Richardson
Feb 15, 2012, 10:17:41 AM2/15/12
to Google App Engine
Thanks for the reply, Robert - I'm fairly sure it was run in the email
queue, but yesterday when I purged the email queue and set the retry
limit to 2, I did the same for the "default" queue just to be safe
(these are my only 2 queues). It looks like no email tasks have been
executed since then (on either queue), but again this morning I'm at
100% of quota.
Are there two email quotas? When I view Quota Details, I see one
"Recipients Emailed" in the "Mail" section (which is at 0%), and
another "Recipients Emailed" at the bottom under "Other Quotas With
Warnings" (which is at 100%). The docs make it sound like maybe you
can only have 100 unique recipients over the entire lifetime of your
app...if that's the case, then maybe I'm running into a quota that
isn't supposed to reset daily..? Still, there's no way I've emailed
100 different people; I'm running a limited beta with 8 users now, and
before that I was running an alpha with about 10.
Still confused...
Andrew
queue, but yesterday when I purged the email queue and set the retry
limit to 2, I did the same for the "default" queue just to be safe
(these are my only 2 queues). It looks like no email tasks have been
executed since then (on either queue), but again this morning I'm at
100% of quota.
Are there two email quotas? When I view Quota Details, I see one
"Recipients Emailed" in the "Mail" section (which is at 0%), and
another "Recipients Emailed" at the bottom under "Other Quotas With
Warnings" (which is at 100%). The docs make it sound like maybe you
can only have 100 unique recipients over the entire lifetime of your
app...if that's the case, then maybe I'm running into a quota that
isn't supposed to reset daily..? Still, there's no way I've emailed
100 different people; I'm running a limited beta with 8 users now, and
before that I was running an alpha with about 10.
Still confused...
Andrew
Andrew Richardson
Feb 15, 2012, 7:07:29 PM2/15/12
to google-a...@googlegroups.com
Just to follow up with the result here...it looks like this was an AppEngine problem. Somehow I clobbered the Mail service and got it into a bad state. I filed a Production Issue on the Issue Tracker, and they put my quota back to normal. Hopefully it stays that way!
Ikai Lan (Google)
Feb 15, 2012, 7:12:56 PM2/15/12
to google-a...@googlegroups.com
Andrew, was this the issue I resolved? I'm trying to track down instances of wedged free email quota to see if this is a software bug or an unintended consequence of a job we ran to fix an earlier issue.
On Wed, Feb 15, 2012 at 4:07 PM, Andrew Richardson <awrich...@gmail.com> wrote:
Just to follow up with the result here...it looks like this was an AppEngine problem. Somehow I clobbered the Mail service and got it into a bad state. I filed a Production Issue on the Issue Tracker, and they put my quota back to normal. Hopefully it stays that way!
--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/cmkwuYL3go8J.
Andrew Richardson
Feb 20, 2012, 1:24:36 PM2/20/12
to google-a...@googlegroups.com
Ikai,
Yes, this was the issue you resolved for me. Everything is still looking good - thanks for the investigation!
Reply all
Reply to author
Forward
0 new messages