URGENT: 1.9.25 causes many errors in my python app

[PK]

My service has been unstable today. I think it is related to some new instances that start with 1.9.25 and fail with errors I have not seen before, the instances with 1.9.24 do not have the issue. I see some instances still start with 1.9.24 fortunately...

Is Google aware of this?

PK

p...@gae123.com

[PK]

My code fails really early on because some initialization assertions fire. The assertions suggest that the same module is initialized multiple times. Have you been changing something fundamental in python27 as you roll out 1.9.25?

[Patrice (Cloud Platform Support)]

Hi PK

Do you mind giving us the app ID for your project so we can look into it?

Cheers!

[PK]

I immediately replied to Patrice but I have not heard back. In the meantime several 1.9.25 instances keep starting and they immediately die. Fortunately, 1.9.24 instances are also starting and they serve correctly some of the load so it is not as horrible as it could be but is bad. Customers, see a nightmare of working and not working app and are screaming...

This is Cloud's worst nightmare. One Friday without none of your fault your app stops working and the vendor is not there to help you. I will keep posting here every 15 minutes until I get help from Google.

By the way this is a paid app, I tried to upgrade my support contract but I could not file a ticket.

[Patrice (Cloud Platform Support)]

Hi PK,

Sorry for the delay in answering. When I grabbed your appID, it was to make sure the issue could be monitored.

Over the weekend a lot of research was done on the backend. About an hour after I've gotten your appID, seems like the errors subsided a bit.

I also noticed that you indeed got support and filed a ticket, which is getting worked on as we speak, so I hope that your issue is under control now.

I got your appID as I was running out of the office, but since that touched the newest version, I made sure to send it up before logging out for the weekend to make sure it wouldn't "fall in the cracks" and only be actionned on Monday.

If there's anything else we can do, I will be happy to help further, just let us know!

Cheers

[PK]

Thanks Patrice.

I was forced to get gold support, something I cannot 

really afford but

I just could not let my customers down, it was

bad enough they suffered through the whole day

Friday. Gold support turned off

1.9.25 for my app so all my instances are back

to 1.9.24 and do not get errors any more. 

However, the root cause has not been 

found/acknowledged yet. 

PK

http://www.gae123.com

[Wilson MacGyver]

is GAE 1.9.25 out in the wild already? I haven't seen them on my java or go instances....

--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/71E9DA38-636B-4329-A6FD-94C9A1BDEC6D%40gae123.com.

For more options, visit https://groups.google.com/d/optout.

--

Omnem crede diem tibi diluxisse supremum.

[PK]

It is not out yet but my app was definitely one 

of the guinea pigs... 

My issue is very python27 specific. 

PK

http://www.gae123.com

To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/CAM0dQn%3De_v5xLdv0_3JTkkMJK0ZRvn1JBgD8wdnLg5rFyeeiHQ%40mail.gmail.com.

[Dimitri Adamou]

Letting you know you aren't alone, I filed a ticket for 1.9.25 and was having issues, after being put back to 1.9.24 everything has been going smoothly again - I'm on PHP.

I really wish there was an "opt for new version" or "please upload a new version of your module to upgrade to latest app engine sdk" etc. It's happened to me 3 times with each release 

[Chris Ramsdale]

PK, 

this is not the way that this should roll out.  reach out to me personally and i'll credit you for the support costs.  in the parallel i've reached out to the Python team to see what the root cause was here.

-- Chris

Product Manager, Google Cloud Platform

--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.

To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/4929f8c4-7a0d-4318-b766-19bc7464ab79%40googlegroups.com.