Signed URL and resumable upload

[Jerome GORIN]

Hi,

Does uploading on signed url also supports the resumable upload functionality?

Many thanks,

Jérôme

[Google Cloud Storage Team]

Hello Jerome,

Yes we do support resumable uploads on signed URLs, but it requires a little bit of extra work on the server-side.  I've written this up on Stack Overflow for posterity: 

http://stackoverflow.com/questions/14569203/can-i-do-a-resumable-upload-with-a-google-cloud-storage-signed-url/14569208#14569208

The normal workflow looks like this:

 * Client requests a signature so it can do a PUT

 * Server does authentication and returns a signature

 * Client does PUT with the returned signature

The resumable workflow looks like this:

 * Client requests a signature so it can do a PUT

 * Server does authentication and returns a signature

 * Server makes a POST request to initiate the resumable upload as described here: https://developers.google.com/storage/docs/developer-guide#resumable

 * Server returns both the signature and the upload ID to the client

 * Client does one or more PUTs using the provided signature and upload ID

Benson

Google Cloud Storage Team

--
 
 

[Jerome GORIN]

Hi benson,

You've reach the posterity, at least for me, dependending on your age :). I'm going to test it.

Do you have a reference implementation in python for the server side?

All the best,

Jérôme

2013/1/28 Google Cloud Storage Team <gs-...@google.com>

--
You received this message because you are subscribed to the Google Groups "Google Cloud Storage" group.
To unsubscribe from this group and stop receiving emails from it, send an email to gs-discussio...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

[Google Cloud Storage Team]

Hi Jérôme,

I do not believe we have a reference implementation yet, although it sounds like a good idea to me.  I'll add that to my list of code samples to consider writing. 

After reviewing my answer on Stack Overflow with a few of my colleagues (answer is here: http://stackoverflow.com/questions/14569203/can-i-do-a-resumable-upload-with-a-google-cloud-storage-signed-url)  I've updated it in an effort to make it easier to understand.  I hope you'll take a look and see if it helps at all. 

Regards,

Benson

To unsubscribe from this group, send email to gs-discussio...@googlegroups.com.

[Jerome GORIN]

Hi Benson,

I'm current developing the upload to a signed URL process at the client side, but I will come back to you once I start the support for resumable upload. The goal of my question was primarly about whether or not using signed url in my application. Your answer completely matches my expectation and the steps you provided seems pretty understandable to me.

Thanks again,

Jérôme

2013/1/30 Google Cloud Storage Team <gs-...@google.com>

[Google Cloud Storage Team]

Hi Jérôme,

You're welcome, and I'm glad you have the information you need. If you have any further questions please don't hesitate to ask. 

Regards,

Benson

[Jerome GORIN]

Hi, I'm really sorry to come back to you again, but you answered so well to my question that I couldn't resists to.

I'm still implementing the uploading via a put on a signed url using curl. I generate my signed url with generate_url() on a new key with the python boto library, which have this form :

http://storage.googleapis.com/98a86562a74d514d48e32d073c57bede/Datastore.docx?Signature=nr%2FVkrmAnOR%2B9Zh%2BT1YfgkNMQ8A%3D&Expires=1360886806&AWSAccessKeyId=GOOGKND477EVMDYF6YSM

but I always get an accessed denied on google cloud storage.

I'm still wondering what I'm doing wrong. Have you got any clue?

All the best,

[Google Cloud Storage Team]

Hi Jérôme,

I'm glad you're comfortable asking questions. I would love to help you, but I'm afraid I need just a little more information to work with. Would you be willing to post this question on Stack Overflow (http://stackoverflow.com) and provide the relevant pieces of your code? That will help me understand what you're doing and answer the question more readily, and will also make it easier for other people having similar difficulties to find help. It will also help me format the code in my response in a readable way. 

If this sounds good, you can send me a note with a link to your question once it's posted. 

Best Regards,

Benson

Google Cloud Storage Team