Reminder: Scheduled Maintenance This Evening

0 views
Skip to first unread message

Marce (Google)

unread,
Nov 11, 2008, 3:53:03 PM11/11/08
to Google App Engine
Hi,

This is just a reminder that this evening from 5-6pm PST, you will not
be able to deploy new application versions. More details can be found
here:
http://groups.google.com/group/google-appengine-downtime-notify/browse_thread/thread/25c9c6fdfe4561f5

Also, a reminder that all notifications of App Engine downtime,
planned or otherwise, can be found on the Downtime Notify group:
http://groups.google.com/group/google-appengine-downtime-notify/

-Marzia

Gee

unread,
Nov 11, 2008, 9:56:38 PM11/11/08
to Google App Engine
6:55pm - is appengine.google.com down for anyone else?

my main app is returning 404 but some of my other apps are ok... I
cannot deploy because appengine.google.com is also returning 404

On Nov 11, 12:53 pm, "Marce (Google)" <ma...@google.com> wrote:
> Hi,
>
> This is just a reminder that this evening from 5-6pm PST, you will not
> be able to deploy new application versions.  More details can be found
> here:http://groups.google.com/group/google-appengine-downtime-notify/brows...

cz

unread,
Nov 11, 2008, 10:03:20 PM11/11/08
to Google App Engine
I'm getting 404/not found for http://appengine.google.com/ which was
how I accessed the dashboard up until last night.
Also, my app (adb2) is returning spurious 500 server errors and random
404/not found, but it worked fine up until the system maintenance
period. This app was last deployed around 8pm last night so it should
be still working I think. It's a Django app that uses zipimport for
the django libs if that makes any difference...
I can't get to the logs since the dashboard access seems borked. Is
this just me or are the app servers still a little funky right now?

Thanks,
- Claude

On Nov 11, 12:53 pm, "Marce (Google)" <ma...@google.com> wrote:
> Hi,
>
> This is just a reminder that this evening from 5-6pm PST, you will not
> be able to deploy new application versions.  More details can be found
> here:http://groups.google.com/group/google-appengine-downtime-notify/brows...

Alexander Kojevnikov

unread,
Nov 11, 2008, 10:03:56 PM11/11/08
to Google App Engine
My website works ATM:
www.muspy.com

appengine.google.com returns 404

Gee

unread,
Nov 11, 2008, 10:07:51 PM11/11/08
to Google App Engine
k yea I also got lots of random 500 server errors around the
maintenance time... now my app is down, but one of my other apps is ok
(seems to only affect some apps)

I get 404 errors on both my app and appengine.google.com

hope this is resolved soon... our app is deployed and we have lots of
unhappy users at the moment :-(

thanks for posting your status so I know its not just me :-)

On Nov 11, 7:03 pm, Alexander Kojevnikov <alexan...@kojevnikov.com>
wrote:

Marzia Niccolai

unread,
Nov 11, 2008, 10:09:34 PM11/11/08
to google-a...@googlegroups.com
Hi,

The admin console is currently down.  More information will be posted to Downtime Notify soon.

-Marzia

Gee

unread,
Nov 11, 2008, 10:26:42 PM11/11/08
to Google App Engine
Thanks for the update...

Any chance of helping us get our apps back online? (rotzy.com)

I can deal with console being down :-) but my app is 404ing too :-(

thanks!!

On Nov 11, 7:09 pm, Marzia Niccolai <ma...@google.com> wrote:
> Hi,
>
> The admin console is currently down.  More information will be posted to
> Downtime Notify soon.
>
> -Marzia
>
> On Tue, Nov 11, 2008 at 7:03 PM, Alexander Kojevnikov <
>

Marzia Niccolai

unread,
Nov 11, 2008, 10:44:08 PM11/11/08
to google-a...@googlegroups.com
Hi,

Our engineers are working as quickly as possible to restore functionality.  A small number of applications, which include the Admin Console, are affected by this outage.  If your application was affected, you should have received an email directly from our engineers to the developers listed in your admin console.

-Marzia

Gee

unread,
Nov 11, 2008, 10:54:44 PM11/11/08
to Google App Engine
Got the email.. thanks for the prompt response... we appreciate the
ease in communicating with you guys during downtimes :-)

On Nov 11, 7:44 pm, Marzia Niccolai <ma...@google.com> wrote:
> Hi,
>
> Our engineers are working as quickly as possible to restore functionality.
> A small number of applications, which include the Admin Console, are
> affected by this outage.  If your application was affected, you should have
> received an email directly from our engineers to the developers listed in
> your admin console.
>
> -Marzia
>

Gayle Laakmann

unread,
Nov 11, 2008, 11:24:21 PM11/11/08
to Google App Engine
My site (http://www.careercup.com) is down. I did not get an email.

On Nov 11, 7:44 pm, Marzia Niccolai <ma...@google.com> wrote:
> Hi,
>
> Our engineers are working as quickly as possible to restore functionality.
> A small number of applications, which include the Admin Console, are
> affected by this outage.  If your application was affected, you should have
> received an email directly from our engineers to the developers listed in
> your admin console.
>
> -Marzia
>

benben

unread,
Nov 11, 2008, 11:51:07 PM11/11/08
to Google App Engine
My site www.119797.com also donw.

Marzia Niccolai

unread,
Nov 11, 2008, 11:54:39 PM11/11/08
to google-a...@googlegroups.com
Hi,

Another issue occurred during scheduled maintenance tonight, which is not related to the issue mentioned above.

This issue affected objects stored in Memcache.  If your application was affected by this error, you would not have been individually emailed.

If your application is currently experiencing issues, it is most likely related to the Memcache issue which our engineering team is currently investigating.  You should see an AttributeError in your application's logs.

We expect this issue will be fixed shortly.

-Marzia

benben

unread,
Nov 12, 2008, 12:00:05 AM11/12/08
to Google App Engine
My app can not work now, can you tell me how to fix this? Do not use
memcache?

Arun Shanker Prasad

unread,
Nov 12, 2008, 12:08:29 AM11/12/08
to Google App Engine
Hi,

Thanks for the notice, I saw the error log about the memcache
issues.. So I rolled out a version without them. When will I be able
to revert to my old version?

Thanks,
Arun Shanker Prasad.

Marzia Niccolai

unread,
Nov 12, 2008, 12:12:56 AM11/12/08
to google-a...@googlegroups.com
Hi,

The issue with Memcache should be now resolved.

-Marzia

Arun Shanker Prasad

unread,
Nov 12, 2008, 12:13:18 AM11/12/08
to Google App Engine
Hi,
Also the error I got was "PicklingError" during the memcache
set. This was working last night....
Thanks,
Arun Shanker Prasad.

Marzia Niccolai

unread,
Nov 12, 2008, 12:15:25 AM11/12/08
to google-a...@googlegroups.com
Hi,

What is the app id that is experiencing this issue?

-Marzia

Marzia Niccolai

unread,
Nov 12, 2008, 12:16:14 AM11/12/08
to google-a...@googlegroups.com
Also, what are you placing in Memcache when your application is showing this error?

-Marzia

Arun Shanker Prasad

unread,
Nov 12, 2008, 12:17:29 AM11/12/08
to Google App Engine
Hi,

Thanks for the quick response, I took a look at the version with
the memcache, I am still getting the following error during the
memcahce..set()....

PicklingError: Can't pickle <type 'instancemethod'>: it's not found as
__builtin__.instancemethod

Thanks,
Arun Shanker Prasad.

On Nov 12, 10:12 am, Marzia Niccolai <ma...@google.com> wrote:
> Hi,
>
> The issue with Memcache should be now resolved.
>
> -Marzia
>
> On Tue, Nov 11, 2008 at 9:08 PM, Arun Shanker Prasad <
>
Message has been deleted

Marzia Niccolai

unread,
Nov 12, 2008, 12:32:15 AM11/12/08
to google-a...@googlegroups.com
It seems like this error is most likely caused as the result of pickling a Query object instead of the results of a query.  Are engineering team is looking in to this issue.

-Marzia

On Tue, Nov 11, 2008 at 9:20 PM, Arun Shanker Prasad <ArunShan...@gmail.com> wrote:

Hi,

 My app id is space1. I am putting the parentModel.child_set list
into memcahce.

Thanks,
Arun Shanker Prasad.

Efe

unread,
Nov 12, 2008, 12:39:39 AM11/12/08
to Google App Engine
I'm still getting 404 to my app.
http://1.latest.denizlispordotcom.appspot.com/


On Nov 12, 1:32 pm, Marzia Niccolai <ma...@google.com> wrote:
> It seems like this error is most likely caused as the result of pickling a
> Query object instead of the results of a query.  Are engineering team is
> looking in to this issue.
>
> -Marzia
>
> On Tue, Nov 11, 2008 at 9:20 PM, Arun Shanker Prasad <
>

benben

unread,
Nov 12, 2008, 12:45:07 AM11/12/08
to Google App Engine
My error Log:

#
11-11 09:43PM 15.731 Traceback (most recent call last):
#
E 11-11 09:43PM 15.731 File "/base/python_dist/lib/python2.5/wsgiref/
handlers.py", line 92, in run
#
E 11-11 09:43PM 15.731 self.result = application(self.environ,
self.start_response)
#
E 11-11 09:43PM 15.731 File "/base/python_lib/versions/1/google/
appengine/ext/webapp/__init__.py", line 515, in __call__
#
E 11-11 09:43PM 15.731 handler.handle_exception(e, self.__debug)
#
E 11-11 09:43PM 15.731 File "/base/python_lib/versions/1/google/
appengine/ext/webapp/__init__.py", line 381, in handle_exception
#
E 11-11 09:43PM 15.731 self.error(500)
#
E 11-11 09:43PM 15.731 File "/base/data/home/apps/udog/
2.329226735080474139/main.py", line 42, in error
#
E 11-11 09:43PM 15.731 self.render('themes/benben/404.html',
template_value)
#
E 11-11 09:43PM 15.731 File "/base/data/home/apps/udog/
2.329226735080474139/main.py", line 21, in render
#
E 11-11 09:43PM 15.731 template_value['links']=DB.getLinkAll()
#
E 11-11 09:43PM 15.731 File "/base/data/home/apps/udog/
2.329226735080474139/cache.py", line 13, in wrapper
#
E 11-11 09:43PM 15.731 memcache.set(key, data, time)
#
E 11-11 09:43PM 15.731 File "/base/python_lib/versions/1/google/
appengine/api/memcache/__init__.py", line 539, in set
#
E 11-11 09:43PM 15.731 return self._set_with_policy
(MemcacheSetRequest.SET, key, value, time=time)
#
E 11-11 09:43PM 15.731 File "/base/python_lib/versions/1/google/
appengine/api/memcache/__init__.py", line 602, in _set_with_policy
#
E 11-11 09:43PM 15.731 stored_value, flags = _validate_encode_value
(value, self._do_pickle)
#
E 11-11 09:43PM 15.731 File "/base/python_lib/versions/1/google/
appengine/api/memcache/__init__.py", line 170, in
_validate_encode_value
#
E 11-11 09:43PM 15.731 stored_value = do_pickle(value)
#
E 11-11 09:43PM 15.731 File "/base/python_lib/versions/1/google/
appengine/api/memcache/__init__.py", line 274, in DoPickle
#
E 11-11 09:43PM 15.731 self._pickler_instance.dump(value)
#
E 11-11 09:43PM 15.731 File "/base/python_dist/lib/python2.5/
pickle.py", line 218, in dump
#
E 11-11 09:43PM 15.731 self.save(obj)
#
E 11-11 09:43PM 15.731 File "/base/python_dist/lib/python2.5/
pickle.py", line 325, in save
#
E 11-11 09:43PM 15.731 self.save_reduce(obj=obj, *rv)
#
E 11-11 09:43PM 15.731 File "/base/python_dist/lib/python2.5/
pickle.py", line 413, in save_reduce
#
E 11-11 09:43PM 15.731 save(state)
#
E 11-11 09:43PM 15.731 File "/base/python_dist/lib/python2.5/
pickle.py", line 280, in save
#
E 11-11 09:43PM 15.731 f(self, obj) # Call unbound method with
explicit self
#
E 11-11 09:43PM 15.731 File "/base/python_dist/lib/python2.5/
pickle.py", line 643, in save_dict
#
E 11-11 09:43PM 15.731 self._batch_setitems(obj.iteritems())
#
E 11-11 09:43PM 15.731 File "/base/python_dist/lib/python2.5/
pickle.py", line 675, in _batch_setitems
#
E 11-11 09:43PM 15.731 save(v)
#
E 11-11 09:43PM 15.731 File "/base/python_dist/lib/python2.5/
pickle.py", line 325, in save
#
E 11-11 09:43PM 15.731 self.save_reduce(obj=obj, *rv)
#
E 11-11 09:43PM 15.731 File "/base/python_dist/lib/python2.5/
pickle.py", line 390, in save_reduce
#
E 11-11 09:43PM 15.731 save(cls)
#
E 11-11 09:43PM 15.731 File "/base/python_dist/lib/python2.5/
pickle.py", line 280, in save
#
E 11-11 09:43PM 15.731 f(self, obj) # Call unbound method with
explicit self
#
E 11-11 09:43PM 15.731 File "/base/python_dist/lib/python2.5/
pickle.py", line 742, in save_global
#
E 11-11 09:43PM 15.731 (obj, module, name))
#
E 11-11 09:43PM 15.731 PicklingError: Can't pickle <type
'instancemethod'>: it's not found as __builtin__.instancemethod


On 11月12日, 上午4时53分, "Marce (Google)" <ma...@google.com> wrote:
> Hi,
>
> This is just a reminder that this evening from 5-6pm PST, you will not
> be able to deploy new application versions. More details can be found
> here:http://groups.google.com/group/google-appengine-downtime-notify/brows...

Arun Shanker Prasad

unread,
Nov 12, 2008, 1:22:19 AM11/12/08
to Google App Engine
Hi,

Regarding you option to set the value as a list this is not causing
any issue and got it working by changing the code. Was this modified
during the current modification? Because I can still get the same code
to work in the SDK......

Thanks,
Arun Shanker Prasad.

On Nov 12, 10:32 am, Marzia Niccolai <ma...@google.com> wrote:
> It seems like this error is most likely caused as the result of pickling a
> Query object instead of the results of a query.  Are engineering team is
> looking in to this issue.
>
> -Marzia
>
> On Tue, Nov 11, 2008 at 9:20 PM, Arun Shanker Prasad <
>

Arun Shanker Prasad

unread,
Nov 12, 2008, 1:30:55 AM11/12/08
to Google App Engine
Hi,

Still getting the same error even with setting the value in a list.

Thanks,
Arun Shanker Prasad.

On Nov 12, 11:22 am, Arun Shanker Prasad <ArunShankerPra...@gmail.com>

heidmotron

unread,
Nov 12, 2008, 2:58:19 PM11/12/08
to Google App Engine
When I try to memcache django's QueryPaginator object I'm getting:

PicklingError: Can't pickle <type 'instancemethod'>: it's not found as
__builtin__.instancemethod

It was working before yesterday. Is there something new I should be
doing?

On Nov 11, 11:30 pm, Arun Shanker Prasad <ArunShankerPra...@gmail.com>

Marzia Niccolai

unread,
Nov 12, 2008, 3:02:13 PM11/12/08
to google-a...@googlegroups.com
Hi,

You will need to store the results of the Query, instead of the QueryPaginator itself.

-Marzia

Scott Mahr

unread,
Nov 13, 2008, 12:25:21 PM11/13/08
to Google App Engine
My app worked yesterday, and now is down as well. id=o24u
If I roll back to before I used memcache would it fix it? Any idea on
when this will be ironed out?

sample log entry
11-13 09:19AM 20.397 / 500 9068ms 4122mcycles 0kb
66.215.95.164 - - [13/11/2008:09:19:29 -0800] "GET / HTTP/1.1" 500 0 -
-
E 11-13 09:19AM 29.461
Traceback (most recent call last):
E 11-13 09:19AM 29.461
File "/base/python_dist/lib/python2.5/wsgiref/handlers.py", line 92,
in run
E 11-13 09:19AM 29.461
<class 'google.appengine.runtime.DeadlineExceededError'>:
Traceback (most recent call last):
File "/base/data/home/apps/o24u/3.7/o24umain.py", line 804, in
<module>
main()
File "/base/data/home/apps/o24u/3.7/o24umain.py", line 802, in main
wsgiref.handlers.CGIHandler().run(application)
File "/base/python_dist/lib/python2.5/wsgiref/handlers.py", line 96,
in run
self.handle_error()
File "/base/python_dist/lib/python2.5/wsgiref/handlers.py", line
306, in handle_error
self.log_exception(sys.exc_info())
File "/base/python_dist/lib/python2.5/wsgiref/handlers.py", line
298, in log_exception
self.traceback_limit, stderr
File "/base/python_dist/lib/python2.5/traceback.py", line 125, in
print_exception
print_tb(tb, limit, file)
File "/base/python_dist/lib/python2.5/traceback.py", line 70, in
print_tb
if line: _print(file, ' ' + line.strip())

Marzia Niccolai

unread,
Nov 13, 2008, 1:15:26 PM11/13/08
to google-a...@googlegroups.com
Hi,

This is related to the Memcache maintenance, please see the discussion on this thread:

http://groups.google.com/group/google-appengine/browse_thread/thread/736a51417ede40b4

-Marzia
Reply all
Reply to author
Forward
0 new messages