Is BlobstoreService createUploadUrl still supposed to work with GCS ?

[Francois Masurel]

Hi everybody,

Is this kind of code still supported ?

UploadOptions uploadOptions = UploadOptions.Builder.withGoogleStorageBucketName(BUCKET_NAME);

return BlobstoreServiceFactory.getBlobstoreService().createUploadUrl(callbackUrl, uploadOptions);

There is absolutely no problem with small files < 1 MB, but it works only one on ten times when I try to upload a 50MB zip file.

Le callbackUrl is never called even if the file seems to be uploading fine and we are redirected on a blank page.

What am I doing wrong ?  Is there any other way to upload a file directly to GCS from the browser ?

Thanx for your help.

François

[Barry Hunter]

You could perhaps just setup the Form to POST directly to GCS, rather than using the blobstore supplied method? 

https://developers.google.com/storage/docs/reference-methods#postobject

--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.

[Kaan Soral]

Didn't notice any problems while using it with python, didn't try it too much but it never failed

Sounds concerning, the whole point of blobstore upload urls are large uploads

[Francois Masurel]

Hi Barry,

Thanx for answering.

I'll give a try to your solution.

Do you know if a Java library exists to do all the signing stuff ?

Thanx again for your help.

François

[Kaan Soral]

I'm currently trying to upload a 20mb file, it has failed once, a 500 error
Generally all gcs errors are invisible 500 errors, you can't see them on appengine logs

Failed 2 out of 2 times :(

[Youri op 't Roodt]

I'm experiencing errors too since this morning, none of the files I upload appear in the blobstore viewer. We upload hundreds of images per day, usually 3-5Mb each, haven't had any problems for a year. No code changes, seems like issues at Google.

[Kaan Soral]

all uploads I've tried failed with a 500 (21mb file)

I've also checked whether it was an enctype or similar issue, but 99% it's not

Out of topic, I wasn't handling upload error cases, decided to switch to https://github.com/blueimp/jQuery-File-Upload/wiki/Basic-plugin this just to know the upload status, interestingly the demo system is also built on appengine, might be a good time to improve the upload logic and catch the 500 wave to handle it better :)

[Francois Masurel]

Problem acknowledged by Google : https://groups.google.com/forum/#!topic/google-appengine-downtime-notify/jWjCxoPOP8Y

[Francois Masurel]

The problem is supposed to be fixed but it still doesn't work for my 50 MB files :-(

[Kaan Soral]

I've improved my upload routines and deployed changes 2 hours ago for testing

I was expecting the problem to be fixed, however it still exists

I'm trying to upload a 20mb file, it goes up to 99%, waits a bit there and fails with a 503 error, like all 5** errors of gcs, it's not visible on appengine logs

Anyone else experiencing issues?

[Francois Masurel]

I have starred and commented this related issue : https://code.google.com/p/googleappengine/issues/detail?id=10083

May be you could create a specific one for GCS.

François

[Kaan Soral]

Thanks, Starred that one + created this one to get attention to the 503: https://code.google.com/p/googleappengine/issues/detail?id=10101&thanks=10101&ts=1381441536

[Francois MASUREL]

Starred.

François Masurel

--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/dXuVCy58juU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.