uploading data to GAE datastore

[David Stone]

Hi,

GAE now has two kind of datastores, master slave one and high
replication one.

I am able to upload data (csv format) to master slave datastore by
using bulkloader. A few days ago, i created a new application and the
default datastore type is now high replication datastore. Later on, i
tried to upload data to the high replication datastore as i did with
master slave datastore. But the operation was failed. The error
message is like:

[error ]Retrying on non-fatal datastore error: ApplicationError: 1 app
xxx cannot access app xxx's data
Traceback (most recent call last):
......
......
ApplicationError: ApplicationError: 1 ApplicationError: 1 app xxx
cannot access app xxx's data

After i tried several times, i finally got:
[INFO ] Authentication Failed


Could anyone help?

Thanks a lot!
David

[Barry Hunter]

Are you including a

--url=http://<appname>.appspot.com/[remote_api_path]

parameter on the command line? Technically its probably optional if
you put the remote API in the default location, but for hr its more
important.

And if you are adding that, try adding a s~ in front of your appid in
the the --application=<app-id> call. so

--application=s~<app-id>

> --
> You received this message because you are subscribed to the Google Groups "Google App Engine" group.
> To post to this group, send email to google-a...@googlegroups.com.
> To unsubscribe from this group, send email to google-appengi...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
>
>

[David Stone]

The reason it did not work is because the way of uploading data only
works for master slave datastore as their document mentions.

On May 23, 12:58 pm, Barry Hunter <barrybhun...@gmail.com> wrote:
> Are you including a
>
> --url=http://<appname>.appspot.com/[remote_api_path]
>
> parameter on the command line? Technically its probably optional if
> you put the remote API in the default location, but for hr its more
> important.
>
> And if you are adding that, try adding a s~ in front of your appid in
> the the --application=<app-id> call. so
>
> --application=s~<app-id>
>

> > For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en.- Hide quoted text -
>
> - Show quoted text -

[Lancelot]

So we do not have any way for bulk-uploading data to HR?

[Owen]

Bulkloader *DOES* work with HR per Barry's comments. The documentation
is not up to date, which is frustrating, but it does work. You need
the --url parameter and you need to add the s~ when uploading to
production.

[Lancelot]

I could make it by your suggestions.

Thank you!

[Bruce Aloe]

Hi,

I use python runtime environment and met the same problem.

I use this command to upload data to master slave datastore:
appcfg.py upload_data --config_file=bulkloader.yaml --
filename=xxx.csv --kind=xxx C:\

According to GAE document i should use url instead of local directory
C:\ that i specified in the command. But it doesn't work for me, that
is why I don't use any url, instead i use the C:\ local directory. And
it works for me when i upload csv data to master slave datastore.

I got the same error like this when i use the command (appcfg.py
upload_data --config_file=bulkloader.yaml --filename=xxx.csv --
kind=xxx C:\ ) to upload csv data to HR datastore:

[error ]Retrying on non-fatal datastore error: ApplicationError: 1 app

s~xxx cannot access app xxx's data

Traceback (most recent call last):
......
......

ApplicationError: ApplicationError: 1 app s~xxx cannot access app
xxx's data


What is wrong and what should i change?

Thanks a lot!

Bruce

[Lancelot]

Here is my line:

appcfg.py upload_data --application=s~myappname --kind=myonetable --config_file=bulkloader.yaml --filename=ancestor.csv --url=http://myappname.appspot.com/_ah/remote_api/

I think you should add --application arg, with s~ prefix for your application name.