Re: [gs-discussion] Resumable Upload Exception

[Google Cloud Storage Team]

Hi Cathy,

I assume you ran 'gsutil config' to setup your access credentials. A 403 error usually indicates an access control problem. Just to eliminate a permissions problem between the credentials used with your code and gsutil, I'd suggest using gsutil to create a new bucket and retrying the gsutil upload to an object in the new bucket. If that doesn't help, please send a trace of the session (minus any sensitive data, like OAuth tokens), using the gsutil -D option to gs-...@google.com and we'll take a look.

Thanks,

Marc

Google Cloud Storage Team

On Mon, Oct 29, 2012 at 11:54 AM, Cathy <itdevtea...@gmail.com> wrote:

I'm trying to upload a 30GB zipped file so that I can insert the rows into a Google BigQuery table.  I've attempted the upload a few times from the API interface but the file never loaded and I did not receive an error message.  So, I download the gsutil tool and installed. I am receiving the error message "ResumableUploadException:  Got status 403 from attempt to start resumable upload.  Aborting. 

-- 

[Cathy]

I'm not writing an app.  I'm running the CP command from the gsutil command line.  I'll try the gsutil config.  My company does not want to invest to much time and money in BigQuery and Cloud Storage until we can upload and query 1B rows.

[Cathy]

Ok I ran the gsutil config and that worked!  Thanks a bunch!

[Cathy]

I was able to start the upload, but it ran for over a week and finally aborted with an error "ResumableUploadException:  Too many resumable upload attempts failed without progress.  You might try this upload again later.  I have a 279GB file that I am compressing.  This is the command I used:

python gsutil cp -z txt \\filepath gs://url

[Mike Schwartz (Google Storage Team)]

Hi Cathy,

Can you please tell us the real command line you used (i.e., with real file name and bucket/object name)? If you'd prefer not to have that show up on gs-discussion, you can send to gs-...@google.com. Thanks,

Mike

--
 
 

[Cathy]

C:\gsutil>python gsutil cp -z txt \\crpssdw01\g$\BigQuery\BigQuery.csv gs://susser

Copying file://\\crpssdw01\g$\BigQuery\BigQuery.csv [Content-Type=application/octet-stream]...

Catching up md5 for resumed upload

Catching up md5 for resumed upload

Catching up md5 for resumed upload

Catching up md5 for resumed upload

Catching up md5 for resumed upload

ResumableUploadException: Too many resumable upload attempts failed without progress. You might try this upload again later.

The upload runs for several days and shows progress (nearly complete).

[Cathy]

Mike, I uploaded the command I was using on Nov 26.  Do you have any input/answers for me to be able to complete the upload?

Thanks,

Cathy