quick data upload?

[neoedmund]

since the data quote seems to be 1GB, i am trying to upload a database
to gae.

but the difficult is the speed is too slow. say a table size is 10MB,
300,000 rows,
if i use buldloader.py , when uploaded 20,000+ rows, get a "ERROR
bulkloader.py] Error in worker [Thread-9]: <url
open error (10060, 'Operation timed out')>"
and when i re-run it, it seems not to resume but start from the
beginning.

i also tried to http POST bulk data using my own methods, it is also
slow, it seems will take a week or a month to upload all the 200+MB
csv data.

so is there some quicker ways? thanks.

[ke...@kanno.com]

I don't know the quicker way for uploading data, but I successfully
re-ran my uploader.

You must have "sqlite3" module to re-run uploading. You also should set
the option "--db_filename=" for bulkloader.py

I hope you upload your data successfully ;)

[yobin]

I found My app sometimes rais a error "This Google App Engine application is temporarily over its serving quota. Please try again later.'

But I only use 13.17 of 46.30 CPU hours and 0.34 of 1.00 GBytes , could anyone tell me what happen? Thks

My app is http://yiqichao.appspot.com/

[Kugutsumen]

Out of curiosity what is your upload bandwidth? Have you ever tried
uploading a video on youtube or Google Video for example.

For example in Indonesia, the best internet access you can get is via
cable. They give you 3 mbit downstream but the upload bandwidth is
ridiculously slow, only 128kbit or 256kbit. It takes forever to upload
anything. To avoid this problem, I usually rsync everything on one of
my dedicated host in Germany then upload from there.

I'm about to upload 8 gig of data to App Engine; I'll share my
results.

[neoedmund]

Hi, since the data quota is 1GB, how could you upload 8 GB?

[Kugutsumen]

On Mar 21, 2:53 pm, neoedmund <neoedm...@gmail.com> wrote:

If you are a billed user, quotas are different and adjustable:

Incoming bandwidth 10.40 GBytes / 24h
Stored Data: up to 41.00 GBytes / 24h
Url Fetch: 1046.13 GBytes / 24h