Using the bulkloader with Java App Engine

[Andri Firstianto-GCP]

Hi...

Got error 500 as below (Please help)

i am trying to follow steps on the above subject in this link http://ikaisays.com/2010/06/10/using-the-bulkloader-with-java-app-engine/

try to execute below.

appcfg.py create_bulkloader_config --url=http://APPID.appspot.com/remote_api        --application=APPID          --filename=config.yml

11:46 AM Creating bulkloader configuration.

[INFO    ] Logging to bulkloader-log-20160214.114630

[INFO    ] Throttling transfers:

[INFO    ] Bandwidth: 250000 bytes/second

[INFO    ] HTTP connections: 8/second

[INFO    ] Entities inserted/fetched/modified: 20/second

[INFO    ] Batch Size: 10

[INFO    ] Opening database: bulkloader-progress-20160214.114630.sql3

[INFO    ] Opening database: bulkloader-results-20160214.114630.sql3

[INFO    ] Connecting to xxxxxx.com/remote_api

[ERROR   ] Exception during authentication

Traceback (most recent call last):

  File "...\bulkloader.py", line 3466, in Run

    self.request_manager.Authenticate()

  File "...\bulkloader.py", line 1329, in Authenticate

    remote_api_stub.MaybeInvokeAuthentication()

  File "...t\remote_api\remote_api_stub.py", line 740, in MaybeInvokeAuthentication

    datastore_stub._server.Send(datastore_stub._path, payload=None)

  File "..\appengine_rpc.py", line 405, in Send

    f = self.opener.open(req)

  File "C:\Python27\lib\urllib2.py", line 410, in open

    response = meth(req, response)

  File "C:\Python27\lib\urllib2.py", line 523, in http_response

    'http', request, response, code, msg, hdrs)

  File "C:\Python27\lib\urllib2.py", line 448, in error

    return self._call_chain(*args)

  File "C:\Python27\lib\urllib2.py", line 382, in _call_chain

    result = func(*args)

  File "C:\Python27\lib\urllib2.py", line 531, in http_error_default

    raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)

HTTPError: HTTP Error 500: Internal Server Error

[ERROR   ] Authentication Failed: Incorrect credentials or unsupported authentication type (e.g. OpenId).

Please help  and thank you

[Andri Firstianto-GCP]

After deleting OAuth 2.0 at "Connected apps & sites" at https://myaccount.google.com/security

the error as below (Even enter correct password)?

07:05 PM Downloading data records.

[INFO    ] Logging to bulkloader-log-20160214.190545

[INFO    ] Throttling transfers:

[INFO    ] Bandwidth: 250000 bytes/second

[INFO    ] HTTP connections: 8/second

[INFO    ] Entities inserted/fetched/modified: 20/second

[INFO    ] Batch Size: 10

[INFO    ] Opening database: bulkloader-progress-20160214.190545.sql3

[INFO    ] Opening database: bulkloader-results-20160214.190545.sql3

[INFO    ] Connecting to .../remote_api

Password for ...@gmail.com:

Invalid username or password.

Password for ...@gmail.com:

Invalid username or password.

Password for ..@gmail.com:

Invalid username or password.

[ERROR   ] Authentication Failed: Incorrect credentials or unsupported authentication type (e.g. OpenId).

Please help and thank you

[Nick (Cloud Platform Support)]

Hey Andri,

OpenID authentication has been deprecated. You'll need to use OAuth2 to authenticate. This Stack Overflow Q&A has a potential solution. In addition to this, however, the bulkloader feature is undocumented and not supported any longer. You can always use Datastore Backup to Cloud Storage and download those files, etc.

Best of luck,

Nick