"This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender immediately"
--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/5aa7088c-a33e-4135-974b-232adc1c4c08%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Hi Nick,
My app is based in us-central.My app is a very simple nodejs app, that runs an expressjs server. It starts in a few seconds (at most) with the command "node app.js --config config.json"I'm attaching my Dockerfile and default.yaml.Keep in mind that I deploy using the "gcloud app deploy default.yaml --image-url gcr.io/my-project/default"Cheers,
On Mon, Mar 20, 2017 at 9:27 PM 'Nick (Cloud Platform Support)' via Google App Engine <google-appengine@googlegroups.com> wrote:
Ah, apologies for sending that last message too quick - I'll also need to know roughly the details of your application's contents. How long does it take your code to start up (you can check this by running the container on your own machine, assuming it has stats comparable to the deployment machine specs). Along with this information, could you share your Dockerfile contents with me in response to the email I've just sent you from esup...@google.com?
Cheers,
Nick
Cloud Platform Community Support
On Saturday, March 18, 2017 at 12:03:46 PM UTC-4, Stanislas Marion wrote:--Hi Nick,I have tweaked my build so that all the image building is done outside of GAE.After I have pushed my docker image to Google (using gcloud docker -- push gcr.io/...) which takes very little time, it seems like the "Updating service" step takes forever (7-8min) whereas all that is needed is a simple variant of 'docker run new_image' > `migrate traffic to new_image'. Why does that last 7-8 minutes ??? Is there any way to speed it up? It is very painful when developing.Best,
On Monday, October 3, 2016 at 10:39:50 PM UTC+2, Nick (Cloud Platform Support) wrote:Hey Kevin,
The speed of deployment can be changed by limiting the size of the uploaded app, limiting the complexity of the build necessary in the Dockerfile, if present, and by ensuring a fast and reliable internet connection. Other than these variables, it's hard to comment on what specifically might be making deployment exhibit the timing that it does on your system.
I hope this is helpful - let me know if you have any further questions! I'll be happy to help!
Cheers,
NickCloud Platform Community Suppor
On Thursday, September 29, 2016 at 3:48:26 PM UTC-4, Kevin Lau wrote:
Is there a faster way to deploy an app? Google App Engine is slow to deploy, hangs on "Updating service [someproject]..." I am using a flexible environment with PHP.
"This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender immediately"
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscribe@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/5aa7088c-a33e-4135-974b-232adc1c4c08%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Hi Nick,
My app is based in us-central.My app is a very simple nodejs app, that runs an expressjs server. It starts in a few seconds (at most) with the command "node app.js --config config.json"I'm attaching my Dockerfile and default.yaml.Keep in mind that I deploy using the "gcloud app deploy default.yaml --image-url gcr.io/my-project/default"Cheers,
On Mon, Mar 20, 2017 at 9:27 PM 'Nick (Cloud Platform Support)' via Google App Engine <google-appengine@googlegroups.com> wrote:
Ah, apologies for sending that last message too quick - I'll also need to know roughly the details of your application's contents. How long does it take your code to start up (you can check this by running the container on your own machine, assuming it has stats comparable to the deployment machine specs). Along with this information, could you share your Dockerfile contents with me in response to the email I've just sent you from esup...@google.com?
Cheers,
Nick
Cloud Platform Community Support
On Saturday, March 18, 2017 at 12:03:46 PM UTC-4, Stanislas Marion wrote:--Hi Nick,I have tweaked my build so that all the image building is done outside of GAE.After I have pushed my docker image to Google (using gcloud docker -- push gcr.io/...) which takes very little time, it seems like the "Updating service" step takes forever (7-8min) whereas all that is needed is a simple variant of 'docker run new_image' > `migrate traffic to new_image'. Why does that last 7-8 minutes ??? Is there any way to speed it up? It is very painful when developing.Best,
On Monday, October 3, 2016 at 10:39:50 PM UTC+2, Nick (Cloud Platform Support) wrote:Hey Kevin,
The speed of deployment can be changed by limiting the size of the uploaded app, limiting the complexity of the build necessary in the Dockerfile, if present, and by ensuring a fast and reliable internet connection. Other than these variables, it's hard to comment on what specifically might be making deployment exhibit the timing that it does on your system.
I hope this is helpful - let me know if you have any further questions! I'll be happy to help!
Cheers,
NickCloud Platform Community Suppor
On Thursday, September 29, 2016 at 3:48:26 PM UTC-4, Kevin Lau wrote:
Is there a faster way to deploy an app? Google App Engine is slow to deploy, hangs on "Updating service [someproject]..." I am using a flexible environment with PHP.
"This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender immediately"
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscribe@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/5aa7088c-a33e-4135-974b-232adc1c4c08%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
On Mon, Mar 20, 2017 at 9:27 PM 'Nick (Cloud Platform Support)' via Google App Engine <google-a...@googlegroups.com> wrote:
Ah, apologies for sending that last message too quick - I'll also need to know roughly the details of your application's contents. How long does it take your code to start up (you can check this by running the container on your own machine, assuming it has stats comparable to the deployment machine specs). Along with this information, could you share your Dockerfile contents with me in response to the email I've just sent you from esup...@google.com?
Cheers,
Nick
Cloud Platform Community Support
On Saturday, March 18, 2017 at 12:03:46 PM UTC-4, Stanislas Marion wrote:--Hi Nick,I have tweaked my build so that all the image building is done outside of GAE.After I have pushed my docker image to Google (using gcloud docker -- push gcr.io/...) which takes very little time, it seems like the "Updating service" step takes forever (7-8min) whereas all that is needed is a simple variant of 'docker run new_image' > `migrate traffic to new_image'. Why does that last 7-8 minutes ??? Is there any way to speed it up? It is very painful when developing.Best,
On Monday, October 3, 2016 at 10:39:50 PM UTC+2, Nick (Cloud Platform Support) wrote:Hey Kevin,
The speed of deployment can be changed by limiting the size of the uploaded app, limiting the complexity of the build necessary in the Dockerfile, if present, and by ensuring a fast and reliable internet connection. Other than these variables, it's hard to comment on what specifically might be making deployment exhibit the timing that it does on your system.
I hope this is helpful - let me know if you have any further questions! I'll be happy to help!
Cheers,
NickCloud Platform Community Suppor
On Thursday, September 29, 2016 at 3:48:26 PM UTC-4, Kevin Lau wrote:
Is there a faster way to deploy an app? Google App Engine is slow to deploy, hangs on "Updating service [someproject]..." I am using a flexible environment with PHP.
"This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender immediately"
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/5aa7088c-a33e-4135-974b-232adc1c4c08%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
"This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender immediately"
--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/dcfd42f7-f1da-4c0f-8adb-9e3cfdd361ca%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Hi Nick,
Thanks a lot for the lengthy explanation.In this light, is there anything I can do to speed things up? Like for instance take care of the load-balancer myself? Indeed I don't see a reason why it should need to be changed. Could I do this with GAE or would I have to move to G Container/Compute E?Cheers,
{"@type":"type.googleapis.com/google.cloud.audit.AuditLog","status":{"code":404,"message":"The object 'projects/<PROJECTID>/global/deployments/<PROJECTID>-gclb' is not found."},"authenticationInfo":{"principalEmail":"NUMBER@cloudservices.gserviceaccount.com"},"requestMetadata":{"calle...
{protoPayload: {…}insertId: "54B423EB72139.A6A3558.C2071C50"resource: {type: "deployment"labels: {name: "<PROJECTID>-gclb"project_id: "<PROJECTID>"}}timestamp: "2017-03-21T18:59:35.632Z"severity: "ERROR"logName: "projects/<PROJECTID>/logs/cloudaudit.googleapis.com%2Factivity"}```This represents the deployment infrastructure checking whether the deployment "<PROJECTID>-gclb" has been created yet, whether the create operation scheduled above has finished yet. However, after another 25 seconds, approximately, we see the following:```19:00:00.122
{"@type":"type.googleapis.com/google.cloud.audit.AuditLog","authenticationInfo":{"principalEmail":"NUMBER@cloudservices.gserviceaccount.com"},"requestMetadata":{"callerIp":"10.131.45.3","callerSuppliedUserAgent":"App Engine Flex Google-API-Java-Client Google-HTTP-Java-Client/1.22.0-SNAPSHOT (...{protoPayload: {authenticationInfo: {principalEmail: "NUMBER@cloudservices.gserviceaccount.com"
On Mon, Mar 20, 2017 at 9:27 PM 'Nick (Cloud Platform Support)' via Google App Engine <google-appengine@googlegroups.com> wrote:
Ah, apologies for sending that last message too quick - I'll also need to know roughly the details of your application's contents. How long does it take your code to start up (you can check this by running the container on your own machine, assuming it has stats comparable to the deployment machine specs). Along with this information, could you share your Dockerfile contents with me in response to the email I've just sent you from esup...@google.com?
Cheers,
Nick
Cloud Platform Community Support
On Saturday, March 18, 2017 at 12:03:46 PM UTC-4, Stanislas Marion wrote:--Hi Nick,I have tweaked my build so that all the image building is done outside of GAE.After I have pushed my docker image to Google (using gcloud docker -- push gcr.io/...) which takes very little time, it seems like the "Updating service" step takes forever (7-8min) whereas all that is needed is a simple variant of 'docker run new_image' > `migrate traffic to new_image'. Why does that last 7-8 minutes ??? Is there any way to speed it up? It is very painful when developing.Best,
On Monday, October 3, 2016 at 10:39:50 PM UTC+2, Nick (Cloud Platform Support) wrote:Hey Kevin,
The speed of deployment can be changed by limiting the size of the uploaded app, limiting the complexity of the build necessary in the Dockerfile, if present, and by ensuring a fast and reliable internet connection. Other than these variables, it's hard to comment on what specifically might be making deployment exhibit the timing that it does on your system.
I hope this is helpful - let me know if you have any further questions! I'll be happy to help!
Cheers,
NickCloud Platform Community Suppor
On Thursday, September 29, 2016 at 3:48:26 PM UTC-4, Kevin Lau wrote:
Is there a faster way to deploy an app? Google App Engine is slow to deploy, hangs on "Updating service [someproject]..." I am using a flexible environment with PHP.
"This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender immediately"
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscribe@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/5aa7088c-a33e-4135-974b-232adc1c4c08%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
"This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender immediately"
--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscribe@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/dcfd42f7-f1da-4c0f-8adb-9e3cfdd361ca%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Hey Stanislas,
The exact explanation speculated on in my last post shouldn't be taken as any description of what's necessarily going on, however it was an estimate of what might be happening based on the logs observed. I'm corresponding with experts in this area to get a more clear answer at the moment.
You could look into deploying on Container Engine, which would mean that the front-end management done by the App Engine Flexible Environment infrastructure wouldn't be happening, rather it would be the responsibility of the resources you deploy on Container Engine (a managed service based pretty transparently on Kubernetes). Surely deploying new container images to your pool of instances in a cluster (or multiple clusters) would be quite fast, since the master sitting in front of your clusters and the nodes in the cluster are not as massively distributed as the App Engine Flexible Environment serving infrastructure, hence updating their routing rules would be relatively fast. This is something to look into and experiment with if you don't want to wait on the more detailed word from experts, but don't rush to that if you're not all that curious.
I'll get back to this thread with more details when they're forthcoming in our investigation.
Cheers,
Nick
Cloud Platform Community Support
On Tuesday, March 21, 2017 at 3:50:34 PM UTC-4, Stanislas Marion wrote:
Hi Nick,Thanks a lot for the lengthy explanation.In this light, is there anything I can do to speed things up? Like for instance take care of the load-balancer myself? Indeed I don't see a reason why it should need to be changed. Could I do this with GAE or would I have to move to G Container/Compute E?Cheers,
{"@type":"type.googleapis.com/google.cloud.audit.AuditLog","status":{"code":404,"message":"The object 'projects/<PROJECTID>/global/deployments/<PROJECTID>-gclb' is not found."},"authenticationInfo":{"principalEmail":"NUM...@cloudservices.gserviceaccount.com"},"requestMetadata":{"calle...
{protoPayload: {…}insertId: "54B423EB72139.A6A3558.C2071C50"resource: {type: "deployment"labels: {name: "<PROJECTID>-gclb"project_id: "<PROJECTID>"}}timestamp: "2017-03-21T18:59:35.632Z"severity: "ERROR"logName: "projects/<PROJECTID>/logs/cloudaudit.googleapis.com%2Factivity"}```This represents the deployment infrastructure checking whether the deployment "<PROJECTID>-gclb" has been created yet, whether the create operation scheduled above has finished yet. However, after another 25 seconds, approximately, we see the following:```19:00:00.122
{"@type":"type.googleapis.com/google.cloud.audit.AuditLog","authenticationInfo":{"principalEmail":"NUM...@cloudservices.gserviceaccount.com"},"requestMetadata":{"callerIp":"10.131.45.3","callerSuppliedUserAgent":"App Engine Flex Google-API-Java-Client Google-HTTP-Java-Client/1.22.0-SNAPSHOT (...{protoPayload: {authenticationInfo: {principalEmail: "NUM...@cloudservices.gserviceaccount.com"
To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/5aa7088c-a33e-4135-974b-232adc1c4c08%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
"This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender immediately"
--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/dcfd42f7-f1da-4c0f-8adb-9e3cfdd361ca%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
"This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender immediately"
--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/01edf030-61cd-4bed-b4c5-3564749c05fe%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Great, thank you so much for your help, I'll be very interested in the details you'll get from your investigation.
On Tue, Mar 21, 2017 at 9:22 PM 'Nick (Cloud Platform Support)' via Google App Engine <google-appengine@googlegroups.com> wrote:
Hey Stanislas,
The exact explanation speculated on in my last post shouldn't be taken as any description of what's necessarily going on, however it was an estimate of what might be happening based on the logs observed. I'm corresponding with experts in this area to get a more clear answer at the moment.
You could look into deploying on Container Engine, which would mean that the front-end management done by the App Engine Flexible Environment infrastructure wouldn't be happening, rather it would be the responsibility of the resources you deploy on Container Engine (a managed service based pretty transparently on Kubernetes). Surely deploying new container images to your pool of instances in a cluster (or multiple clusters) would be quite fast, since the master sitting in front of your clusters and the nodes in the cluster are not as massively distributed as the App Engine Flexible Environment serving infrastructure, hence updating their routing rules would be relatively fast. This is something to look into and experiment with if you don't want to wait on the more detailed word from experts, but don't rush to that if you're not all that curious.
I'll get back to this thread with more details when they're forthcoming in our investigation.
Cheers,
Nick
Cloud Platform Community Support
On Tuesday, March 21, 2017 at 3:50:34 PM UTC-4, Stanislas Marion wrote:
Hi Nick,Thanks a lot for the lengthy explanation.In this light, is there anything I can do to speed things up? Like for instance take care of the load-balancer myself? Indeed I don't see a reason why it should need to be changed. Could I do this with GAE or would I have to move to G Container/Compute E?Cheers,
{"@type":"type.googleapis.com/google.cloud.audit.AuditLog","status":{"code":404,"message":"The object 'projects/<PROJECTID>/global/deployments/<PROJECTID>-gclb' is not found."},"authenticationInfo":{"principalEmail":"NUMBER@cloudservices.gserviceaccount.com"},"requestMetadata":{"calle...
{protoPayload: {…}insertId: "54B423EB72139.A6A3558.C2071C50"resource: {type: "deployment"labels: {name: "<PROJECTID>-gclb"project_id: "<PROJECTID>"}}timestamp: "2017-03-21T18:59:35.632Z"severity: "ERROR"logName: "projects/<PROJECTID>/logs/cloudaudit.googleapis.com%2Factivity"}```This represents the deployment infrastructure checking whether the deployment "<PROJECTID>-gclb" has been created yet, whether the create operation scheduled above has finished yet. However, after another 25 seconds, approximately, we see the following:```19:00:00.122
{"@type":"type.googleapis.com/google.cloud.audit.AuditLog","authenticationInfo":{"principalEmail":"NUMBER@cloudservices.gserviceaccount.com"},"requestMetadata":{"callerIp":"10.131.45.3","callerSuppliedUserAgent":"App Engine Flex Google-API-Java-Client Google-HTTP-Java-Client/1.22.0-SNAPSHOT (...{protoPayload: {authenticationInfo: {principalEmail: "NUMBER@cloudservices.gserviceaccount.com"
To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscribe@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/5aa7088c-a33e-4135-974b-232adc1c4c08%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
"This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender immediately"
--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscribe@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/dcfd42f7-f1da-4c0f-8adb-9e3cfdd361ca%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
"This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender immediately"
--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscribe@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/01edf030-61cd-4bed-b4c5-3564749c05fe%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Hey Stanislas,So, I can confirm that my prior investigation and intuitions were on the right track. I can confirm that a majority of deployment lag comes from programming the Google Cloud Load Balancers (GCLB). This is what we've seen in this case. Updates have to go out across the entire infrastructure while still respecting certain locks used to keep configurations consistent. These Load Balancers are not visible to users in the Console and not user-configurable as they're infrastructural and meant to be exactly as they are, else users may try to modify or accidentally delete them, which would cause a lot of issues.We're devoting a lot of energy to decreasing GCLB configuration push times, so rest assured that our efforts in that direction should pay off going forward.Cheers,NickCloud Platform Community Support
On Tuesday, March 21, 2017 at 6:41:52 PM UTC-4, Stanislas Marion wrote:
Great, thank you so much for your help, I'll be very interested in the details you'll get from your investigation.
{"@type":"type.googleapis.com/google.cloud.audit.AuditLog","status":{"code":404,"message":"The object 'projects/<PROJECTID>/global/deployments/<PROJECTID>-gclb' is not found."},"authenticationInfo":{"principalEmail":"NUM...@cloudservices.gserviceaccount.com"},"requestMetadata":{"calle...
{protoPayload: {…}insertId: "54B423EB72139.A6A3558.C2071C50"resource: {type: "deployment"labels: {name: "<PROJECTID>-gclb"project_id: "<PROJECTID>"}}timestamp: "2017-03-21T18:59:35.632Z"severity: "ERROR"logName: "projects/<PROJECTID>/logs/cloudaudit.googleapis.com%2Factivity"}```This represents the deployment infrastructure checking whether the deployment "<PROJECTID>-gclb" has been created yet, whether the create operation scheduled above has finished yet. However, after another 25 seconds, approximately, we see the following:```19:00:00.122
{"@type":"type.googleapis.com/google.cloud.audit.AuditLog","authenticationInfo":{"principalEmail":"NUM...@cloudservices.gserviceaccount.com"},"requestMetadata":{"callerIp":"10.131.45.3","callerSuppliedUserAgent":"App Engine Flex Google-API-Java-Client Google-HTTP-Java-Client/1.22.0-SNAPSHOT (...{protoPayload: {authenticationInfo: {principalEmail: "NUM...@cloudservices.gserviceaccount.com"
To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/5aa7088c-a33e-4135-974b-232adc1c4c08%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
"This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender immediately"
--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/dcfd42f7-f1da-4c0f-8adb-9e3cfdd361ca%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
"This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender immediately"
--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/01edf030-61cd-4bed-b4c5-3564749c05fe%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
"This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender immediately"
--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/a3520170-b3d5-4ddc-afce-a9dbc838d4d5%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Hi Nick,
Thank you so much for your time and detailed explanations. I've been investigating GKE and it seems like it strikes the right balance between speed and convenience, so I'll probably move progressively towards it.Best,
On Thu, Apr 6, 2017 at 1:28 AM 'Nick (Cloud Platform Support)' via Google App Engine <google-appengine@googlegroups.com> wrote:
Hey Stanislas,So, I can confirm that my prior investigation and intuitions were on the right track. I can confirm that a majority of deployment lag comes from programming the Google Cloud Load Balancers (GCLB). This is what we've seen in this case. Updates have to go out across the entire infrastructure while still respecting certain locks used to keep configurations consistent. These Load Balancers are not visible to users in the Console and not user-configurable as they're infrastructural and meant to be exactly as they are, else users may try to modify or accidentally delete them, which would cause a lot of issues.We're devoting a lot of energy to decreasing GCLB configuration push times, so rest assured that our efforts in that direction should pay off going forward.Cheers,NickCloud Platform Community Support
On Tuesday, March 21, 2017 at 6:41:52 PM UTC-4, Stanislas Marion wrote:
Great, thank you so much for your help, I'll be very interested in the details you'll get from your investigation.
{"@type":"type.googleapis.com/google.cloud.audit.AuditLog","status":{"code":404,"message":"The object 'projects/<PROJECTID>/global/deployments/<PROJECTID>-gclb' is not found."},"authenticationInfo":{"principalEmail":"NUMBER@cloudservices.gserviceaccount.com"},"requestMetadata":{"calle...
{protoPayload: {…}insertId: "54B423EB72139.A6A3558.C2071C50"resource: {type: "deployment"labels: {name: "<PROJECTID>-gclb"project_id: "<PROJECTID>"}}timestamp: "2017-03-21T18:59:35.632Z"severity: "ERROR"logName: "projects/<PROJECTID>/logs/cloudaudit.googleapis.com%2Factivity"}```This represents the deployment infrastructure checking whether the deployment "<PROJECTID>-gclb" has been created yet, whether the create operation scheduled above has finished yet. However, after another 25 seconds, approximately, we see the following:```19:00:00.122
{"@type":"type.googleapis.com/google.cloud.audit.AuditLog","authenticationInfo":{"principalEmail":"NUMBER@cloudservices.gserviceaccount.com"},"requestMetadata":{"callerIp":"10.131.45.3","callerSuppliedUserAgent":"App Engine Flex Google-API-Java-Client Google-HTTP-Java-Client/1.22.0-SNAPSHOT (...{protoPayload: {authenticationInfo: {principalEmail: "NUMBER@cloudservices.gserviceaccount.com"
To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscribe@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/5aa7088c-a33e-4135-974b-232adc1c4c08%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
"This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender immediately"
--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscribe@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/dcfd42f7-f1da-4c0f-8adb-9e3cfdd361ca%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
"This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender immediately"
--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscribe@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/01edf030-61cd-4bed-b4c5-3564749c05fe%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
"This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender immediately"
--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscribe@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/a3520170-b3d5-4ddc-afce-a9dbc838d4d5%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Logs Directory: [/tmp/tmp.ijTCcTysEa/logs] Last Log File: [None]
It's odd that there should be "None" for the last log file. Did you run the failing command before running gcloud info? And are there any log files in /tmp/tmp.ijTCcTysEa/logs? It's possible with a file path like that that the log directory is temporary, so the logs from a prior deployment may not be saved unless you actively retrieve them after the fact within a given timeframe.
Cheers,
Nick
Cloud Platform Community Support
gcloud beta app operations describe d8c581c51b0-e9a02f
Hey Stanislas,So, I can confirm that my prior investigation and intuitions were on the right track. I can confirm that a majority of deployment lag comes from programming the Google Cloud Load Balancers (GCLB). This is what we've seen in this case. Updates have to go out across the entire infrastructure while still respecting certain locks used to keep configurations consistent. These Load Balancers are not visible to users in the Console and not user-configurable as they're infrastructural and meant to be exactly as they are, else users may try to modify or accidentally delete them, which would cause a lot of issues.We're devoting a lot of energy to decreasing GCLB configuration push times, so rest assured that our efforts in that direction should pay off going forward.Cheers,NickCloud Platform Community Support
On Tuesday, March 21, 2017 at 6:41:52 PM UTC-4, Stanislas Marion wrote:
Great, thank you so much for your help, I'll be very interested in the details you'll get from your investigation.
{"@type":"type.googleapis.com/google.cloud.audit.AuditLog","status":{"code":404,"message":"The object 'projects/<PROJECTID>/global/deployments/<PROJECTID>-gclb' is not found."},"authenticationInfo":{"principalEmail":"NUM...@cloudservices.gserviceaccount.com"},"requestMetadata":{"calle...
{protoPayload: {…}insertId: "54B423EB72139.A6A3558.C2071C50"resource: {type: "deployment"labels: {name: "<PROJECTID>-gclb"project_id: "<PROJECTID>"}}timestamp: "2017-03-21T18:59:35.632Z"severity: "ERROR"logName: "projects/<PROJECTID>/logs/cloudaudit.googleapis.com%2Factivity"}```This represents the deployment infrastructure checking whether the deployment "<PROJECTID>-gclb" has been created yet, whether the create operation scheduled above has finished yet. However, after another 25 seconds, approximately, we see the following:```19:00:00.122
{"@type":"type.googleapis.com/google.cloud.audit.AuditLog","authenticationInfo":{"principalEmail":"NUM...@cloudservices.gserviceaccount.com"},"requestMetadata":{"callerIp":"10.131.45.3","callerSuppliedUserAgent":"App Engine Flex Google-API-Java-Client Google-HTTP-Java-Client/1.22.0-SNAPSHOT (...{protoPayload: {authenticationInfo: {principalEmail: "NUM...@cloudservices.gserviceaccount.com"
To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/5aa7088c-a33e-4135-974b-232adc1c4c08%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
"This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender immediately"
--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/dcfd42f7-f1da-4c0f-8adb-9e3cfdd361ca%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
"This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender immediately"
--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/01edf030-61cd-4bed-b4c5-3564749c05fe%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
server: jetty9
--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscribe@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/e20829dd-2d13-4453-bea9-6dbb3eed771b%40googlegroups.com.
Happenned to me on the AppEngine Standard. Cleaning the staging.PROJECTNAME bucket on GCS fixed it.It appears the folder gets bigger and bigger and it really slows the deploy.
On Nov 16, 2017 01:35, <voice...@gmail.com> wrote:
From limited testing with Java Flexible, it happens with--server: jetty9
Significantly less issues with standard Java, though we want to user the jetty built in container.What we see is that initial deployment is OK, and every consecutive deployment slows down exponentially, until above half an hour it does not happen at all (or at least we consider it dead).I assume there is some problem of GAE tracking the instances.
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
https://github.com/GoogleCloudPlatform/python-docs-samples/appengine/flexible/hello_world
--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscribe@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/0c5f7fed-3551-4426-88e4-1383b4151084%40googlegroups.com.
Speaking from experience here.
Just move on.Google App Engine (esp. Flexible Engine) is not worthy of your time.Take care,
@gunar
On Tue, Nov 21, 2017 at 1:24 AM, Vijay M <vijay...@gmail.com> wrote:
I have been struggling with the same issue. I tried deploying a very simple app and waited for several minutes before the process timed out. I even ran into the same timeout issue with Google's own samples from--https://github.com/GoogleCloudPlatform/python-docs-samples/appengine/flexible/hello_world
Coming from AWS, it has been very frustrating working with GCP. One more day of this and I am going back to AWS.
On Thursday, September 29, 2016 at 12:48:26 PM UTC-7, Kevin Lau wrote:
Is there a faster way to deploy an app? Google App Engine is slow to deploy, hangs on "Updating service [someproject]..." I am using a flexible environment with PHP.
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/450defe8-df59-496d-a9d9-a36800302f19%40googlegroups.com.
Same with us. Our deployment hangs at `updating service` and eventually fails.
--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscribe@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/1514f6e9-35dc-46a9-ae0b-383c94529263%40googlegroups.com.
Updating service [****] (this may take several minutes)
Hi all,Thanks for being patient, everyone. I waited to reply here until the experiment was fully ramped-up and verified in prod, but all projects should now be eligible to start using the faster in-place version updates.To perform an in-place update, please pass the --version flag to the deploy command and specify the version you would like to deploy over. Additionally, you’ll likely want to prevent that version from becoming the default, so be sure to include the --no-promote flag. For example:$ gcloud app deploy --version <your-existing-version-here> --no-promoteWe recommend you use this flow only for development purposes, and continue to deploy full versions for any production traffic.Thanks to everyone who tested this out so far, and please let me know if you run into any issues or concerns along the way.-DeWitt
On Mon, Feb 12, 2018 at 11:55 AM Mike Hardy <mha...@localinsights.io> wrote:
Same boat as Franck and others - this is unusable--
On Thursday, February 8, 2018 at 12:23:23 PM UTC-8, Franck Diédrich wrote:Hello,I'm experiencing serious latency too on a flexible env.Deployments used to last around 9 minutes (which is quite long) and now they time out without explicit reason.When will deployement improvement flow be available?
Le jeudi 29 septembre 2016 21:48:26 UTC+2, Kevin Lau a écrit :
Is there a faster way to deploy an app? Google App Engine is slow to deploy, hangs on "Updating service [someproject]..." I am using a flexible environment with PHP.
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
DeWitt, thanks for informing us but I see a few potential problems.1. we've been passing `--version` in our gcloud app deploy command for the last 6 months to name the new release. Isn't this going to conflict with users like us who want to name the newest version?
2. I tested the solution and it just deploys to the previous version. It doesn't actually shut down the previous version and create a new one. In my opinion, one of the biggest features of app engine is rolling back to a previous version. It looks like this deployment method eliminates that feature.
To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscribe@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/a6de923a-d6d7-41f2-9789-f4360fcadf7d%40googlegroups.com.
Hi Prashanth,
As DeWitt mentioned, having a delay around 6 minutes median (50th percentile) for a new version of App Engine Flex. deployment is the expected behavior since when you deploy your first application to the flexible environment, your virtual machine (VM) and other infrastructure are set up.
In your case, 45 minutes is too long and it seems something is misconfigured. So, I recommend to double check if you deploy each service with a separate app.yaml file and if the issue persists, you may report the issue to the Issue Tracker and provide us with the redacted output of the deploy command you are using (with the --verbosity tag set to debug) along with the output of the “gcloud info --anonymize” command so that we would be able investigate the root cause of the issue.
Hey Stanislas,So, I can confirm that my prior investigation and intuitions were on the right track. I can confirm that a majority of deployment lag comes from programming the Google Cloud Load Balancers (GCLB). This is what we've seen in this case. Updates have to go out across the entire infrastructure while still respecting certain locks used to keep configurations consistent. These Load Balancers are not visible to users in the Console and not user-configurable as they're infrastructural and meant to be exactly as they are, else users may try to modify or accidentally delete them, which would cause a lot of issues.We're devoting a lot of energy to decreasing GCLB configuration push times, so rest assured that our efforts in that direction should pay off going forward.Cheers,NickCloud Platform Community Support
On Tuesday, March 21, 2017 at 6:41:52 PM UTC-4, Stanislas Marion wrote:Great, thank you so much for your help, I'll be very interested in the details you'll get from your investigation.On Tue, Mar 21, 2017 at 9:22 PM 'Nick (Cloud Platform Support)' via Google App Engine <google-a...@googlegroups.com> wrote:Hey Stanislas,
The exact explanation speculated on in my last post shouldn't be taken as any description of what's necessarily going on, however it was an estimate of what might be happening based on the logs observed. I'm corresponding with experts in this area to get a more clear answer at the moment.
You could look into deploying on Container Engine, which would mean that the front-end management done by the App Engine Flexible Environment infrastructure wouldn't be happening, rather it would be the responsibility of the resources you deploy on Container Engine (a managed service based pretty transparently on Kubernetes). Surely deploying new container images to your pool of instances in a cluster (or multiple clusters) would be quite fast, since the master sitting in front of your clusters and the nodes in the cluster are not as massively distributed as the App Engine Flexible Environment serving infrastructure, hence updating their routing rules would be relatively fast. This is something to look into and experiment with if you don't want to wait on the more detailed word from experts, but don't rush to that if you're not all that curious.
I'll get back to this thread with more details when they're forthcoming in our investigation.
Cheers,
Nick
Cloud Platform Community SupportOn Tuesday, March 21, 2017 at 3:50:34 PM UTC-4, Stanislas Marion wrote:Hi Nick,Thanks a lot for the lengthy explanation.In this light, is there anything I can do to speed things up? Like for instance take care of the load-balancer myself? Indeed I don't see a reason why it should need to be changed. Could I do this with GAE or would I have to move to G Container/Compute E?Cheers,On Tue, Mar 21, 2017 at 8:42 PM 'Nick (Cloud Platform Support)' via Google App Engine <google-a...@googlegroups.com> wrote:Hey Stanislas,
My initial hunch was that the issue was the deployment of other resources necessary to support the containers running. My analysis of deployment-related logs appears to confirm this:I created a simple NodeJS app using your dockerfile and default.yaml. I then pushed the docker image to gcr.io and ran "gcloud app deploy --image-url ..."After about 1 minute of waiting, all resources associated with the deployment had apparently completed, but the command had not returned yet:```$ gcloud deployment-manager resources list --deployment aef-default-20170321t185300NAME TYPE STATE ERRORS INTENTaef-default-20170321t185300-00 compute.beta.regionInstanceGroupManager COMPLETED []aef-default-20170321t185300-00ahs compute.v1.httpsHealthCheck COMPLETED []aef-default-20170321t185300-00it compute.v1.instanceTemplate COMPLETED []aef-default-20170321t185300-bs compute.v1.backendService COMPLETED []aef-default-20170321t185300-hcfw compute.v1.firewall COMPLETED []aef-default-20170321t185300-hcs compute.v1.httpsHealthCheck COMPLETED []```At around the same time that the last of the above completed, I see the following in the Console logs when selecting the "Deployment" logs source:```{protoPayload: {…}insertId: "54B422B11D921.AE9070D.A80D9821"resource: {type: "deployment"labels: {project_id: "<PROJECTID>"name: "<PROJECTID>-gclb"}}timestamp: "2017-03-21T18:54:05.999Z"severity: "ERROR"logName: "projects/<PROJECTID>/logs/cloudaudit.googleapis.com%2Factivity"}```I haven't expanded the protoPayload, but it shows that this was an attempt to delete the deployment "<PROJECTID>-gclb" if it exists. It's near-immediately followed by a log representing an update on the deployment "<PROJECTID>-gclb" with createPolicy: "CREATE_OR_ACQUIRE". I believe it's reasonable to assume gclb stands for "Google Cloud Load Balancer", but I could be wrong here.About six minutes later, the deployment command finally completed. At about the same time, the following shows up in the logs:```18:59:35.632{"@type":"type.googleapis.com/google.cloud.audit.AuditLog","status":{"code":404,"message":"The object 'projects/<PROJECTID>/global/deployments/<PROJECTID>-gclb' is not found."},"authenticationInfo":{"principalEmail":"NUM...@cloudservices.gserviceaccount.com"},"requestMetadata":{"calle...{protoPayload: {…}insertId: "54B423EB72139.A6A3558.C2071C50"resource: {type: "deployment"labels: {name: "<PROJECTID>-gclb"project_id: "<PROJECTID>"}}timestamp: "2017-03-21T18:59:35.632Z"severity: "ERROR"logName: "projects/<PROJECTID>/logs/cloudaudit.googleapis.com%2Factivity"}```This represents the deployment infrastructure checking whether the deployment "<PROJECTID>-gclb" has been created yet, whether the create operation scheduled above has finished yet. However, after another 25 seconds, approximately, we see the following:```19:00:00.122{"@type":"type.googleapis.com/google.cloud.audit.AuditLog","authenticationInfo":{"principalEmail":"NUM...@cloudservices.gserviceaccount.com"},"requestMetadata":{"callerIp":"10.131.45.3","callerSuppliedUserAgent":"App Engine Flex Google-API-Java-Client Google-HTTP-Java-Client/1.22.0-SNAPSHOT (...{protoPayload: {authenticationInfo: {principalEmail: "NUM...@cloudservices.gserviceaccount.com"}requestMetadata: {callerIp: "10.131.45.3"callerSuppliedUserAgent: "App Engine Flex Google-API-Java-Client Google-HTTP-Java-Client/1.22.0-SNAPSHOT (gzip)"}serviceName: "deploymentmanager.googleapis.com"methodName: "v2.deploymentmanager.deployments.update"resourceName: "projects/<PROJECTID>/global/deployments/aef-gclb"}insertId: "54B42402DA050.AE94741.97003020"resource: {type: "deployment"labels: {name: "aef-gclb"project_id: "<PROJECTID>"}}timestamp: "2017-03-21T19:00:00.122Z"severity: "NOTICE"logName: "projects/<PROJECTID>/logs/cloudaudit.googleapis.com%2Factivity"operation: {id: "operation-1490122775787-54b423eb8f5f9-5492ae56-bcfc4ec6"producer: "deploymentmanager.googleapis.com"last: true}}```Notice "type: deployment" and "last: true". This appears to signal the completion of a deployment "aef-gclb" at around the same time that the command line returned news that the deployment was ready to serve.This all seems to point to the fact that there are some resources which need to be deployed before the app can serve, quite apart from fetching the container image from gcr.io. It appears that creating a load balancer / updating its rules is an important part of this which naturally will take a long time since a whole array of distributed machines in the routing infrastructure will need to sign off that they contain the new rules before the user can be confident the deployment has completed.
I hope this helps clarify things for you. As we continue to improve the infrastructure, doubtless times involved in these steps will decrease. We definitely analyze the data related to deployments and all kinds of other operations to determine how to streamline our systems. If you ever notice something in future that needs explanation, feel free to post in this group to inquire.
Cheers,
Nick
Cloud Platform Community Support
On Tuesday, March 21, 2017 at 6:00:11 AM UTC-4, Stanislas Marion wrote:Hi Nick,My app is based in us-central.My app is a very simple nodejs app, that runs an expressjs server. It starts in a few seconds (at most) with the command "node app.js --config config.json"I'm attaching my Dockerfile and default.yaml.Keep in mind that I deploy using the "gcloud app deploy default.yaml --image-url gcr.io/my-project/default"Cheers,On Mon, Mar 20, 2017 at 9:27 PM 'Nick (Cloud Platform Support)' via Google App Engine <google-a...@googlegroups.com> wrote:Ah, apologies for sending that last message too quick - I'll also need to know roughly the details of your application's contents. How long does it take your code to start up (you can check this by running the container on your own machine, assuming it has stats comparable to the deployment machine specs). Along with this information, could you share your Dockerfile contents with me in response to the email I've just sent you from esup...@google.com?
Cheers,
Nick
Cloud Platform Community Support
On Saturday, March 18, 2017 at 12:03:46 PM UTC-4, Stanislas Marion wrote:Hi Nick,I have tweaked my build so that all the image building is done outside of GAE.After I have pushed my docker image to Google (using gcloud docker -- push gcr.io/...) which takes very little time, it seems like the "Updating service" step takes forever (7-8min) whereas all that is needed is a simple variant of 'docker run new_image' > `migrate traffic to new_image'. Why does that last 7-8 minutes ??? Is there any way to speed it up? It is very painful when developing.Best,
On Monday, October 3, 2016 at 10:39:50 PM UTC+2, Nick (Cloud Platform Support) wrote:Hey Kevin,
The speed of deployment can be changed by limiting the size of the uploaded app, limiting the complexity of the build necessary in the Dockerfile, if present, and by ensuring a fast and reliable internet connection. Other than these variables, it's hard to comment on what specifically might be making deployment exhibit the timing that it does on your system.
I hope this is helpful - let me know if you have any further questions! I'll be happy to help!
Cheers,
NickCloud Platform Community Suppor
On Thursday, September 29, 2016 at 3:48:26 PM UTC-4, Kevin Lau wrote:
Is there a faster way to deploy an app? Google App Engine is slow to deploy, hangs on "Updating service [someproject]..." I am using a flexible environment with PHP.
"This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender immediately"
--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/5aa7088c-a33e-4135-974b-232adc1c4c08%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
"This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender immediately"
--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/dcfd42f7-f1da-4c0f-8adb-9e3cfdd361ca%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
"This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender immediately"
--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/01edf030-61cd-4bed-b4c5-3564749c05fe%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
"This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender immediately"
Hello Matt,
As the issue is related to user’s deployment failure sometimes which is an indicator that this issue shouldn't be reported on Google Groups as this forum is meant for general discussion of the platform, not specific technical issues.
What's needed for anybody who would want to report a technical issue, is to use the issue tracker rather than google groups so that we can properly involve the engineering team and further investigate this deployment issue in the public issue tracker. If it is required to share any private or project specific information please choose the “Private” component so that the information are not visible to the public.
I wish you the best of luck in proceeding to either open a proper issue report in the public issue tracker.
I would also encourage you to share the public issue tracker link in this thread if you keep that public so that other users can go to the link for resolution or they can see the updates on the issue.
We're devoting a lot of energy to decreasing GCLB configuration push times, so rest assured that our efforts in that direction should pay off going forward.
Cheers,Nick
Cloud Platform Community Support
On Tuesday, March 21, 2017 at 6:41:52 PM UTC-4, Stanislas Marion wrote:
Great, thank you so much for your help, I'll be very interested in the details you'll get from your investigation.
On Tue, Mar 21, 2017 at 9:22 PM 'Nick (Cloud Platform Support)' via Google App Engine <google-a...@googlegroups.com> wrote:
Hey Stanislas,
The exact explanation speculated on in my last post shouldn't be taken as any description of what's necessarily going on, however it was an estimate of what might be happening based on the logs observed. I'm corresponding with experts in this area to get a more clear answer at the moment.
You could look into deploying on Container Engine, which would mean that the front-end management done by the App Engine Flexible Environment infrastructure wouldn't be happening, rather it would be the responsibility of the resources you deploy on Container Engine (a managed service based pretty transparently on Kubernetes). Surely deploying new container images to your pool of instances in a cluster (or multiple clusters) would be quite fast, since the master sitting in front of your clusters and the nodes in the cluster are not as massively distributed as the App Engine Flexible Environment serving infrastructure, hence updating their routing rules would be relatively fast. This is something to look into and experiment with if you don't want to wait on the more detailed word from experts, but don't rush to that if you're not all that curious.
I'll get back to this thread with more details when they're forthcoming in our investigation.
Cheers,
Nick
Cloud Platform Community Support
Cheers,
Nick
Cloud Platform Community Support
On Tuesday, March 21, 2017 at 6:00:11 AM UTC-4, Stanislas Marion wrote:
Hi Nick,My app is based in us-central.My app is a very simple nodejs app, that runs an expressjs server. It starts in a few seconds (at most) with the command "node app.js --config config.json"I'm attaching my Dockerfile and default.yaml.Keep in mind that I deploy using the "gcloud app deploy default.yaml --image-url gcr.io/my-project/default"Cheers,
On Mon, Mar 20, 2017 at 9:27 PM 'Nick (Cloud Platform Support)' via Google App Engine <google-a...@googlegroups.com> wrote:
Ah, apologies for sending that last message too quick - I'll also need to know roughly the details of your application's contents. How long does it take your code to start up (you can check this by running the container on your own machine, assuming it has stats comparable to the deployment machine specs). Along with this information, could you share your Dockerfile contents with me in response to the email I've just sent you from esup...@google.com?
Cheers,
Nick
Cloud Platform Community Support
On Saturday, March 18, 2017 at 12:03:46 PM UTC-4, Stanislas Marion wrote:
Hi Nick,I have tweaked my build so that all the image building is done outside of GAE.After I have pushed my docker image to Google (using gcloud docker -- push gcr.io/...) which takes very little time, it seems like the "Updating service" step takes forever (7-8min) whereas all that is needed is a simple variant of 'docker run new_image' > `migrate traffic to new_image'. Why does that last 7-8 minutes ??? Is there any way to speed it up? It is very painful when developing.
Best,
On Monday, October 3, 2016 at 10:39:50 PM UTC+2, Nick (Cloud Platform Support) wrote:
Hey Kevin,
The speed of deployment can be changed by limiting the size of the uploaded app, limiting the complexity of the build necessary in the Dockerfile, if present, and by ensuring a fast and reliable internet connection. Other than these variables, it's hard to comment on what specifically might be making deployment exhibit the timing that it does on your system.
I hope this is helpful - let me know if you have any further questions! I'll be happy to help!
Cheers,
NickCloud Platform Community Suppor
On Thursday, September 29, 2016 at 3:48:26 PM UTC-4, Kevin Lau wrote:
Is there a faster way to deploy an app? Google App Engine is slow to deploy, hangs on "Updating service [someproject]..." I am using a flexible environment with PHP.
"This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender immediately"
--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-a...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/5aa7088c-a33e-4135-974b-232adc1c4c08%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
"This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender immediately"
--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-a...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/dcfd42f7-f1da-4c0f-8adb-9e3cfdd361ca%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
"This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender immediately"
--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/hZMEkmmObDU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-a...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/01edf030-61cd-4bed-b4c5-3564749c05fe%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.