App Engine Flex ERROR: (gcloud.beta.app.deploy) NOT_FOUND

[Matt Lowden]

Hello,

I have a collection of App Engine Flex services that are deployed using `gcloud beta app deploy` due to needing the `beta_settings` app.yaml property in order to connect to a Cloud SQL instance (https://cloud.google.com/sql/docs/mysql/connect-app-engine-flexible#public-ip-default_1).

These deployment processes are executed using GitLab's CI/CD and have been untouched for around a year.

Yesterday these deployments started failing with the following error (Both as part of the GitLab pipeline and on my local machine):

Please bear in mind I've removed all of the account specific data.

gcloud beta app deploy app.yaml

Services to deploy:

descriptor:                      [pathtoyaml\app.yaml]

source:                      [ pathtoyaml  ]

target project:              []

target service:              []

target version:              []

target url:                  [https://appengineservice.appspot.com]

target service account:      [App Engine default service account]

Do you want to continue (Y/n)?  y

Beginning deployment of service [ appengineservice  ]...

#============================================================#

#= Uploading 0 files to Google Cloud Storage                =#

#============================================================#

File upload done.

Updating service [ appengineservice  ] (this may take several minutes)...done.

ERROR: (gcloud.beta.app.deploy) NOT_FOUND: Requested entity was not found.

If I run the command with --log-http I can see the following request at the bottom which returns the error in question

=======================

==== request start ====

uri: https://cloudbuild.googleapis.com/v1/projects/topsify-tools/locations/global/builds/ca6dfd3d-eeb4-4748-8fd5-930257e47b64?alt=json

method: GET

== headers start ==

b'accept': b'application/json'

b'accept-encoding': b'gzip, deflate'

b'authorization': --- Token Redacted ---

b'content-length': b'0'

b'user-agent': b'google-cloud-sdk gcloud/364.0.0 command/gcloud.beta.app.deploy invocation-id/d1f77d7d4a28468d91c14ca149993995 environment/None environment-version/None interactive/True from-script/False python/3.8.10 term/ (Windows NT 10.0.19042)'

== headers end ==

== body start ==

== body end ==

==== request end ====

---- response start ----

status: 404

-- headers start --

-content-encoding: gzip

alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000,h3-Q050=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43"

cache-control: private

content-length: 114

content-type: application/json; charset=UTF-8

date: Wed, 10 Nov 2021 11:32:52 GMT

server: ESF

transfer-encoding: chunked

vary: Origin, X-Origin, Referer

x-content-type-options: nosniff

x-frame-options: SAMEORIGIN

x-xss-protection: 0

-- headers end --

-- body start --

{

  "error": {

    "code": 404,

    "message": "Requested entity was not found.",

    "status": "NOT_FOUND"

  }

}

-- body end --

total round trip time (request+response): 0.294 secs

---- response end ----

----------------------

Apologies if this is something that I'm doing from my end as I haven't seen any other reports of this issue aside from a single thread on Stack Overflow that was started yesterday.

Thank you in advance & if you have any question please don't hesitate to ask.

Thanks,

Matt.

[wokmou]

Could you also execute your command with --verbosity to debug it. As it appears there is a missing file during you deployment.

[Matt Lowden]

If I run with the `--verbosity debug` the following is where the error occurs:

apitools.base.py.exceptions.HttpNotFoundError: HttpError accessing <https://cloudbuild.googleapis.com/v1/projects/topsify-tools/locations/global/builds/23f14bc1-d139-4cb5-b68b-31d7784425ce?alt=json>: response: <{'vary': 'Origin, X-Origin, Referer', 'content-type': 'application/json; charset=UTF-8', 'date': 'Wed, 10 Nov 2021 23:49:26 GMT', 'server': 'ESF', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff', 'alt-svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000,h3-Q050=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43"', 'transfer-encoding': 'chunked', 'status': '404', 'content-length': '114', '-content-encoding': 'gzip'}>, content <{

[Matt Lowden]

Thank you for the reply. Which --verbosity flag should I use and what should I be looking for specifically?

On Wednesday, November 10, 2021 at 9:21:04 PM UTC wokmou wrote:

[goya]

This seems to be a known issue that is being investigated by the App Engine team. You can check here for updates on any progress [1]. 

Please note that connecting from GAE flex to Cloud SQL uses beta settings, which are not recommended for production usage. To have your app connect to Cloud SQL in a production environment, you might be interested in using Cloud Run instead of GAE flex [2]

[1]: https://issuetracker.google.com/206670000 

[2]: https://cloud.google.com/sql/docs/mysql/connect-run 

[Khomsan Nawiang]

PS://Phai

ในวันที่ พ. 10 พ.ย. 2021 23:15 น. 'Matt Lowden' via Google App Engine <google-a...@googlegroups.com> เขียนว่า:

--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/40cfda3a-5a39-464b-8db3-06cd21a38832n%40googlegroups.com.

[goya]

The changes that caused this issue have been rolled back, so it should not be happening anymore.