Is there any outage at appengine.. please respond if you feel the same

87 views
Skip to first unread message

sandeep Koduri

unread,
Aug 9, 2011, 2:54:52 AM8/9/11
to google-a...@googlegroups.com
there are some kind of errors showing up sudden unexpected error :::
but the system status is not showing up any changes in status. any others facing similar problems please post/reply so that this will taken into consideration and fixed soon


one kind is at django extends where django is trying to access other templates 
the second kind is of datastore ones. throwing errors for even the data available at the server...



<class 'google.appengine.runtime.DeadlineExceededError'>: 
Traceback (most recent call last):
  File "/base/data/home/apps/cricwaves/2-1-5-4.352350870255798790/cricket/StaticPages.py", line 54, in main
    run_wsgi_app(application)
  File "/base/python_runtime/python_lib/versions/1/google/appengine/ext/webapp/util.py", line 98, in run_wsgi_app
    run_bare_wsgi_app(add_wsgi_middleware(application))
  File "/base/python_runtime/python_lib/versions/1/google/appengine/ext/webapp/util.py", line 116, in run_bare_wsgi_app
    result = application(env, _start_response)
  File "/base/python_runtime/python_lib/versions/1/google/appengine/ext/webapp/__init__.py", line 700, in __call__
    handler.get(*groups)
  File "/base/data/home/apps/cricwaves/2-1-5-4.352350870255798790/cricket/StaticPages.py", line 35, in get
    self.generate(PageVariable+".html",m2,"ls","StaticPagesDynamiccontent"+PageVariable,"StaticPagesDynamiccontent","StaticPage",PageVariable)
  File "/base/data/home/apps/cricwaves/2-1-5-4.352350870255798790/cricket/basehandler.py", line 405, in generate
    else: gentab = template.render(path, values, debug=_DEBUG).decode('utf-8')
  File "/base/python_runtime/python_lib/versions/1/google/appengine/ext/webapp/template.py", line 72, in render
    t = load(template_path, debug)
  File "/base/python_runtime/python_lib/versions/1/google/appengine/ext/webapp/template.py", line 100, in load
    template = django.template.loader.get_template(file_name)
  File "/base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/loader.py", line 80, in get_template
    template = get_template_from_string(source, origin, template_name)
  File "/base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/loader.py", line 88, in get_template_from_string
    return Template(source, origin, name)
  File "/base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/__init__.py", line 158, in __init__
    self.nodelist = compile_string(template_string, origin)
  File "/base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/__init__.py", line 174, in compile_string
    return parser.parse()
  File "/base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/__init__.py", line 273, in parse
    compiled_result = compile_func(self, token)
  File "/base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/loader_tags.py", line 154, in do_extends
    nodelist = parser.parse()
  File "/base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/__init__.py", line 273, in parse
    compiled_result = compile_func(self, token)
  File "/base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/loader_tags.py", line 132, in do_block
    nodelist = parser.parse(('endblock', 'endblock %s' % block_name))
  File "/base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/__init__.py", line 273, in parse
    compiled_result = compile_func(self, token)
  File "/base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/defaulttags.py", line 862, in spaceless
    nodelist = parser.parse(('endspaceless',))
  File "/base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/__init__.py", line 273, in parse
    compiled_result = compile_func(self, token)
  File "/base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/loader_tags.py", line 172, in do_include
    return ConstantIncludeNode(path[1:-1])
  File "/base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/loader_tags.py", line 87, in __init__
    t = get_template(template_path)
  File "/base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/loader.py", line 80, in get_template
    template = get_template_from_string(source, origin, template_name)
  File "/base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/loader.py", line 88, in get_template_from_string
    return Template(source, origin, name)
  File "/base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/__init__.py", line 158, in __init__
    self.nodelist = compile_string(template_string, origin)
  File "/base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/__init__.py", line 174, in compile_string
    return parser.parse()
  File "/base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/__init__.py", line 273, in parse
    compiled_result = compile_func(self, token)
  File "/base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/defaulttags.py", line 580, in ifequal
    return do_ifequal(parser, token, False)
  File "/base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/defaulttags.py", line 554, in do_ifequal
    nodelist_true = parser.parse(('else', end_tag))
  File "/base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/__init__.py", line 273, in parse
    compiled_result = compile_func(self, token)
  File "/base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/loader_tags.py", line 172, in do_include
    return ConstantIncludeNode(path[1:-1])
  File "/base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/loader_tags.py", line 87, in __init__
    t = get_template(template_path)
  File "/base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/loader.py", line 79, in get_template
    source, origin = find_template_source(template_name)
  File "/base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/loader.py", line 68, in find_template_source
    source, display_name = loader(name, dirs)
  File "/base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/loaders/filesystem.py", line 17, in load_template_source
    return (open(filepath).read(), filepath)





--
Regards
Sandeep Koduri
Phone: +91- 99 666 02 456
Gtalk: sandeep.koduri | Skype: sandeep.koduri
P Please consider the environment before printing this email 

Mike Johnston

unread,
Aug 9, 2011, 2:59:03 AM8/9/11
to Google App Engine
We're also experiencing a complete outage right now.

Johan Euphrosine

unread,
Aug 9, 2011, 3:22:08 AM8/9/11
to google-a...@googlegroups.com
Please open a production issue with your appid:
http://code.google.com/p/googleappengine/issues/entry?template=Production%20issue

Thanks in advance.

> --
> You received this message because you are subscribed to the Google Groups "Google App Engine" group.
> To post to this group, send email to google-a...@googlegroups.com.
> To unsubscribe from this group, send email to google-appengi...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
>
>

--
Johan Euphrosine (proppy)
Developer Programs Engineer
Google Developer Relations

Waleed Abdulla

unread,
Aug 9, 2011, 3:24:43 AM8/9/11
to google-a...@googlegroups.com
I also experienced an outage on two of my apps about an hour ago. It started with a considerable slowing down of requests, and then it went completely down, including the app engine dashboard. 15 minutes later it came back online, and it's still okay so far. During that outage period, the app engine status page did not show anything and continued to report that nothing was wrong.





Waleed Abdulla

unread,
Aug 9, 2011, 3:33:11 AM8/9/11
to google-a...@googlegroups.com
Johan, 
    It's back to normal now. My app ids are networkedblogs and networkedhub. I'm attaching my errors/second graph during the outage period. 

Waleed
errors per second.png

Johan Euphrosine

unread,
Aug 9, 2011, 3:47:06 AM8/9/11
to google-a...@googlegroups.com
Thanks for sharing the details,

Feel free to create a production if you want more details about what happened.

Johan Euphrosine

unread,
Aug 9, 2011, 3:59:54 AM8/9/11
to google-a...@googlegroups.com
After taking a closer look it seems that only networkedblogs has been impacted.

Do you confirm this ?

FYI, I'm tracking this on the following production issue:
http://code.google.com/p/googleappengine/issues/detail?id=5533

Feel free to start or comment it if you want to get notified about updates.

Thanks in advance.

Waleed Abdulla

unread,
Aug 9, 2011, 4:07:40 AM8/9/11
to google-a...@googlegroups.com
Johan, 
    Yes, the logs confirm what you said, that only networkedblogs was impacted. But, during the outage, I tried to open the dashboard of the other app, networkedhub, and it failed as well and I couldn't access it so I thought it's the same issue. Maybe it was just a coincidence that I couldn't access the other app's dashboard at the time. 

    I stared the issue and I'll try to add more details if I can. 

Thanks,
Waleed

Nguyễn Kim Kha

unread,
Aug 9, 2011, 6:00:58 AM8/9/11
to google-a...@googlegroups.com

Johan Euphrosine

unread,
Aug 9, 2011, 6:04:20 AM8/9/11
to google-a...@googlegroups.com
Yes, that's because the admin-console powering the dashboard was also
affected by this outage.

FYI, there is still ongoing issue with M/S being tracked there:
http://code.google.com/p/googleappengine/issues/detail?id=5499

tempy

unread,
Aug 9, 2011, 7:06:24 AM8/9/11
to Google App Engine
Just to add my two cents, my app seems to be doing ok now, but
overnight (I'm in Berlin) it seems to have experienced an outage with
lots of different errors. It seems to have lost all of its instances
and then new instances failed to start on warmup with this:
"A serious problem was encountered with the process that handled this
request, causing it to exit. This is likely to cause a new process to
be used for the next request to your application. If you see this
message frequently, you may be throwing exceptions during the
initialization of your application. (Error code 104)"

tasks were run twice, or not run, and so on. I'm still trying to get
through the sea of red in the logs and figure out if there was any
damage done.

My app id is "hrkleio" and its on the hr datastore, so this couldn't
have been an MS issue.
> >> >>http://code.google.com/p/googleappengine/issues/entry?template=Produc...
>
> >> >> Thanks in advance.
>
> >> >> On Tue, Aug 9, 2011 at 8:59 AM, Mike Johnston <m...@simperium.com>

Johan Euphrosine

unread,
Aug 9, 2011, 7:20:22 AM8/9/11
to google-a...@googlegroups.com
Sounds like a different problem, feel free to open a new production
issue for this:
http://code.google.com/p/googleappengine/issues/entry?template=Production%20issue

tempy

unread,
Aug 9, 2011, 7:44:53 AM8/9/11
to Google App Engine
Johan,
I assumed that production issues shouldn't be filed for problems that
have been resolved. I posted here instead of filing an issue because
by the time I woke up, the outage had already come and gone, the app
is working fine now.

On Aug 9, 1:20 pm, Johan Euphrosine <pro...@google.com> wrote:
> Sounds like a different problem, feel free to open a new production
> issue for this:http://code.google.com/p/googleappengine/issues/entry?template=Produc...
> > For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en.

Robert Kluin

unread,
Aug 9, 2011, 2:38:09 PM8/9/11
to google-a...@googlegroups.com
I saw all instances get killed restarted around the same time. I
observed this on both MS and HR applications. Seemed to be roughly
correlated with the pre-release announcement.


Robert

Reply all
Reply to author
Forward
0 new messages