Unable to use bulkloader

118 views
Skip to first unread message

LaFolle

unread,
Jun 25, 2012, 7:09:08 AM6/25/12
to google-a...@googlegroups.com
I am trying to use bulkloader, but cant get out of this error. Where am I wrong?


Application: mercipristo
Creating bulkloader configuration.
[INFO    ] Logging to bulkloader-log-20120625.163457
[INFO    ] Throttling transfers:
[INFO    ] Bandwidth: 250000 bytes/second
[INFO    ] HTTP connections: 8/second
[INFO    ] Entities inserted/fetched/modified: 20/second
[INFO    ] Batch Size: 10
[INFO    ] Opening database: bulkloader-progress-20120625.163457.sql3
[INFO    ] Opening database: bulkloader-results-20120625.163457.sql3
[INFO    ] Connecting to mercipristo.appspot.com/_ah/remote_api
[INFO    ] Downloading kinds: ['__Stat_PropertyType_PropertyName_Kind__']
[ERROR   ] [WorkerThread-0] WorkerThread:
Traceback (most recent call last):
  File "/home/kc/google_appengine/google/appengine/tools/adaptive_thread_pool.py", line 176, in WorkOnItems
    status, instruction = item.PerformWork(self.__thread_pool)
  File "/home/kc/google_appengine/google/appengine/tools/bulkloader.py", line 764, in PerformWork
    transfer_time = self._TransferItem(thread_pool)
  File "/home/kc/google_appengine/google/appengine/tools/bulkloader.py", line 1170, in _TransferItem
    self, retry_parallel=self.first)
  File "/home/kc/google_appengine/google/appengine/tools/bulkloader.py", line 1471, in GetEntities
    results = self._QueryForPbs(query)
  File "/home/kc/google_appengine/google/appengine/tools/bulkloader.py", line 1442, in _QueryForPbs
    raise datastore._ToDatastoreError(e)
BadRequestError: app s~mercipristo cannot access app mercipristo's data
[INFO    ] [WorkerThread-1] Backing off due to errors: 1.0 seconds
[INFO    ] An error occurred. Shutting down...
[ERROR   ] Error in WorkerThread-0: app s~mercipristo cannot access app mercipristo's data
[INFO    ] Have 0 entities, 0 previously transferred
[INFO    ] 0 entities (1546 bytes) transferred in 2.6 seconds

Thanks 

Takashi Matsuo

unread,
Jun 25, 2012, 1:13:50 PM6/25/12
to google-a...@googlegroups.com
Hi LaFille,

Can you show me your exact command line?
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/google-appengine/-/ziosbmpjCeQJ.
> To post to this group, send email to google-a...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengi...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.



--
Takashi Matsuo | Developer Advocate | tma...@google.com

LaFolle

unread,
Jun 25, 2012, 1:24:04 PM6/25/12
to google-a...@googlegroups.com
Sorry, I forgot to put that!!!


kc@Jaguareins:~/lafolle$ ../google_appengine/appcfg.py  create_bulkloader_config --filename=bulkloader.yaml . --application=mercipristo

> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to

pdknsk

unread,
Jun 25, 2012, 7:04:51 PM6/25/12
to Google App Engine
This bug was introduced with HRD. I'm surprised Google has still not
fixed or at least documented it. The fix is posted at the following
link.

https://groups.google.com/group/google-appengine/msg/092f97bd2ec83bbd
Message has been deleted

LaFolle

unread,
Jun 26, 2012, 4:14:56 AM6/26/12
to google-a...@googlegroups.com
Thanks a lot. That did solve the problem.

Matthew Blain

unread,
Jun 28, 2012, 5:41:43 PM6/28/12
to Google App Engine
The simple workaround is to use --url and not specify the application
flag at all. Or the directory (which in turn loads the appid from the
app.yaml file).
I'll go update the docs to suggest that instead of the others--it does
some of each now.
Reply all
Reply to author
Forward
0 new messages