url created by blobstore.create_upload_url not work.

96 views
Skip to first unread message

中村智

unread,
Nov 12, 2018, 3:16:10 AM11/12/18
to Google App Engine
Until October, I was able to upload files from the URL created by "blobstore.create_upload_url", but this created URL no longer responds back this morning.

Have there been any specification changes?

Attila-Mihaly Balazs

unread,
Nov 12, 2018, 7:39:34 AM11/12/18
to Google App Engine
URLs created with "blobstore.create_upload_url" are one-time only (so you can't reuse them) and also time-limited (so you can't wait very long for using it). Are you using the generated URL only once and without waiting for a long time?

Attila

Henry Pan

unread,
Nov 12, 2018, 7:42:16 AM11/12/18
to Google App Engine
Saluting Attila from Redmond,

Would you pls also advice whether this is 'URLs' also true for GKE as well?

Thanks in advance + Happy Monday
'
Henry Pan

Attila-Mihaly Balazs

unread,
Nov 12, 2018, 7:52:25 AM11/12/18
to Google App Engine
Hi Henri,

Sorry, I'm having trouble understanding the question "whether this is 'URLs' also true for GKE as well". When you say "blobstore.create_upload_url" I'm assuming that you're talking about the "blobstore" service which is a deprecated (but still running) service available in Google AppEngine Python Standard 2.7: https://cloud.google.com/appengine/docs/standard/python/refdocs/google.appengine.ext.blobstore.blobstore

AFAIK, this is not available outside of this environment. Or are you talking about running a client in GKE? (ie. the piece of code which uploads to the generated URL?)

Attila

Henry Pan

unread,
Nov 12, 2018, 9:14:17 AM11/12/18
to google-a...@googlegroups.com
Wow Sorry  Attila,

My silly question is that should the similar issue happens on GKE, is your advice still apply?
 

Thanks


Henry Pan

DevOps Architect | Dito

henr...@ditoweb.com | PHONE: (425) 802-3975

Dito Logo.png




--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/583b7260-1e62-40e0-9b0e-6c20cf3bf72c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Attila-Mihaly Balazs

unread,
Nov 13, 2018, 12:34:13 AM11/13/18
to Google App Engine
Hi Henry,

I'm sorry, I still don't understand the relation of the question to GKE. In my understanding the original question refers to blobstore (https://cloud.google.com/appengine/docs/standard/python/blobstore/) which is a deprecated/legacy storage solution that is only available inside of Google AppEngine v1 (so not even AppEngine v2 and definitely not outside of AppEngine like GKE, Compute, etc).

Code outside of AppEngine can interact with Blobstore since it uses Cloud Storage (so for an outside client it is just like Cloud Storage), but can't use it (for example they can't call the "create_upload_url" method). There is similar functionality in GCS (signed URLs for upload: https://cloud.google.com/storage/docs/access-control/signed-urls) but blobstore itself is an "AppEngine v1" technology (of course clients uploading/downloading from blobstore can be anywhere as long as they speak HTTP(S)).

Attila

中村智

unread,
Nov 13, 2018, 12:48:21 AM11/13/18
to Google App Engine
Thank you Attila-Mihaly Balazs.

Yes, I use the url one-time only.
Until October, my program was able to upload files from the URL created by "blobstore.create_upload_url", I guess the URL stopped working after this November.
So, I changed my program to use Google Cloud Storage, and it works well now.

2018年11月12日月曜日 21時39分34秒 UTC+9 Attila-Mihaly Balazs:

Attila-Mihaly Balazs

unread,
Nov 13, 2018, 2:49:48 AM11/13/18
to Google App Engine
I'm happy that you managed to change over to google cloud storage quickly and without too much of an issue. Blobstore is deprecated and should be avoided as much as possible.

Out of curiosity: was it the case that you were creating an upload url from one project while the cloud storage bucket was in a different project? I was using this setup and it worked perfectly until last Thursday (I had to give "storage.objectAdmin" access to the AppEngine service account in the project hosting the storage bucket), but then it stopped working.

Support is still investigating but my short-term fix was to use a bucket in the same project as the AppEngine application.

Attila
Reply all
Reply to author
Forward
0 new messages