Can't download all data with bulkloader from non-default namespace

60 views
Skip to first unread message

rekby

unread,
Jul 30, 2011, 4:19:48 AM7/30/11
to google-a...@googlegroups.com
I use Python SDK 1.5.2. High-replication datastore. I see data statistic for namespace 2 in dashboard.

appcfg.py download_data --application=s~my-optimiser --url=https://3.my-optimiser.appspot.com/remote_api --namespace="2" --filename=optimiser.data
Downloading data records.
[INFO    ] Logging to bulkloader-log-20110730.121721
[INFO    ] Throttling transfers:
[INFO    ] Bandwidth: 250000 bytes/second
[INFO    ] HTTP connections: 8/second
[INFO    ] Entities inserted/fetched/modified: 20/second
[INFO    ] Batch Size: 10
[INFO    ] Opening database: bulkloader-progress-20110730.121721.sql3
[INFO    ] Opening database: bulkloader-results-20110730.121721.sql3
[INFO    ] Connecting to 3.my-optimiser.appspot.com/remote_api
[ERROR   ] Unable to download kind stats for all-kinds download.
[ERROR   ] Kind stats are generated periodically by the appserver
[ERROR   ] Kind stats are not available on dev_appserver.

Johan Euphrosine

unread,
Aug 2, 2011, 10:32:55 AM8/2/11
to google-a...@googlegroups.com
Can you share your application id, so we can investigate the issue ?

Feel free to fill a production issue if this is directly affecting
your operation:
http://code.google.com/p/googleappengine/issues/entry?template=Production%20issue

> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/google-appengine/-/fN3ISosu8ZgJ.
> To post to this group, send email to google-a...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengi...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>

--
Johan Euphrosine (proppy)
Developer Programs Engineer
Google Developer Relations

Timofey Koolin

unread,
Aug 2, 2011, 10:51:07 AM8/2/11
to google-a...@googlegroups.com
Yes, I can. My app ID: my-optimiser (my-optimiser.appspot.com).

It isn't very need personal for me now - I have only one Entity type and I can download it with --kind option, but I think it is bug in platform or SDK.

Now I try use https://my-optimiser.appspot.com instead of https://3.my-optimiser.appspot.com - it have same error.

2011/8/2 Johan Euphrosine <pro...@google.com>



--
С уважением,
Кулин Тимофей.

Телефон: +7 (4852) 974793
ICQ: 114902104
email: tim...@koolin.ru
Blog: http://timofey.koolin.ru

Johan Euphrosine

unread,
Aug 3, 2011, 7:46:14 AM8/3/11
to google-a...@googlegroups.com
Hi Timofey,

I managed to reproduce your issue:
proppy@proppy:~$ ~/google_appengine/appcfg.py download_data
--application=s~proppy-guestbook-namespace
--url=https://proppy-guestbook-namespace.appspot.com/_ah/remote_api
--namespace="foo" --filename=foo.data
Downloading data records.
[INFO ] Logging to bulkloader-log-20110803.134504


[INFO ] Throttling transfers:
[INFO ] Bandwidth: 250000 bytes/second
[INFO ] HTTP connections: 8/second
[INFO ] Entities inserted/fetched/modified: 20/second
[INFO ] Batch Size: 10

[INFO ] Opening database: bulkloader-progress-20110803.134504.sql3
[INFO ] Opening database: bulkloader-results-20110803.134504.sql3
[INFO ] Connecting to proppy-guestbook-namespace.appspot.com/_ah/remote_api


[ERROR ] Unable to download kind stats for all-kinds download.
[ERROR ] Kind stats are generated periodically by the appserver
[ERROR ] Kind stats are not available on dev_appserver.

Looks like a bug, can you fill it on
http://code.google.com/p/googleappengine/issues/entry and followup
with the url there ?

Thanks in advance.

Timofey Koolin

unread,
Aug 3, 2011, 9:55:46 PM8/3/11
to google-a...@googlegroups.com
Yes, I fill it.
3 августа 2011 г. 15:46 пользователь Johan Euphrosine <pro...@google.com> написал:
Reply all
Reply to author
Forward
0 new messages