Datastore Admin Issue - Backup - Namespaces

131 views
Skip to first unread message

aswath satrasala

unread,
Jun 2, 2015, 8:14:58 AM6/2/15
to google-a...@googlegroups.com
Hello,
I am trying to do backup of a Namespace, however, I cannot select the namespace.
I am doing the following in the appengine console (old)
* Click on the Datastore Admin
* Select the KINDS
* Click on the 'Backup Entities'
* In the next screen, I am trying to choose the namespace.  However, there are only few namespaces displayed. I cannot select the namespace, I wanted.

-Aswath

Patrice (Cloud Platform Support)

unread,
Jun 2, 2015, 10:22:36 AM6/2/15
to google-a...@googlegroups.com, aswath satrasala, aswath satrasala
Hi Aswath.

We'd need a bit more details to be able to help you here.

Are you sure that the namespace you want to backup isn't part of another application's datastore? Are the kinds you are backing up in that namespace? 

I've tried different combinations, and everything seemed to have worked fine. If you could add print screens, both showing that the kinds are in the requested namespace, and of the page not showing you the namespace, it would be helpful in troubleshooting further

Cheers

aswath satrasala

unread,
Jun 3, 2015, 3:30:03 AM6/3/15
to Patrice (Cloud Platform Support), google-a...@googlegroups.com
Hello,
My appid: accountingguru-india


The kinds, I want to backup are in that namespace, but I could have selected other kinds also (in the previous screen), that may not yet be in that namespace.

A whole bunch of namespaces are missing in the dropdown selection.  The namespaces starting after 'BIS..' are not displayed.
Attached is the screen shot, of the namespace dropdown selection

-Aswath




Screenshot 2015-06-03 12.49.30.png

Alejandro Gonzalez

unread,
Jun 3, 2015, 4:40:05 AM6/3/15
to google-a...@googlegroups.com, Patrice (Cloud Platform Support)
Hello Patrice,

I checked this, and i have the same problem as Aswath. I have an application with a lot of namespaces, and the namespace dropdown is only showing the first 250 namespaces. For the round number it seems like there is a limit on the number of namespaces displayed.

Thanks.
Alejandro.



--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/CAKFF5G5wRCY_t4xwSz-P_Fxhv2r6sQ%3DoUTj-8UvGNOuC814rXA%40mail.gmail.com.

For more options, visit https://groups.google.com/d/optout.

Patrice (Cloud Platform Support)

unread,
Jun 3, 2015, 10:47:55 AM6/3/15
to google-a...@googlegroups.com, alejandro...@nextinit.com, pvout...@google.com
Hi Alejandro, 

thank you for letting me know. See that makes a little bit more sense that it simply shows the first X. Not exactly expected behavior, but more logical than what I thought was happening at first.

In any case, that seems to be a defect within the admin console. I therefore went ahead and created this issue, as the proper place to report defects is the public issue tracker.

I would suggest for you two to star the issue so you can get updated when there`s progress.

Cheers!
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscribe@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.

Patrice (Cloud Platform Support)

unread,
Jun 3, 2015, 2:02:24 PM6/3/15
to google-a...@googlegroups.com, pvout...@google.com, alejandro...@nextinit.com
Hi again,

So, as you can see on the linked issue, this is actually expected behavior, to make sure that the query retrieving your namespaces doesn't time out, we limit the results.

If you need to have a namespace backed up that you cannot find, you will have to use cron jobs for scheduled backups.

Cheers!

aswath satrasala

unread,
Jun 8, 2015, 12:57:35 AM6/8/15
to google-a...@googlegroups.com, Patrice (Cloud Platform Support), Alejandro Gonzalez
Hi Patrice,

A request for enhancement. Doing cron is fine, however, it is still
a workaround. It can be done in the Datastore Viewer style. Please
give a suggestbox style, instead of listing 250 namespaces, as this
not really useful, if you are dealing with large namespaces.

I have updated the issue also.

My humble request to the appengine team. Please treat namespaces on
par with default namespace. It should be supported in all tools and
utilities with the same ease as the default namespace.

On the same topic of namespaces, I just wanted to say that production
apps experience difficulties because of the namespaces not supported
well in all parts of the appengine. The biggest hurdle is in doing
the migration/scheme change for the entities. Mapreduce lacks
documentation for namespaces with no clear examples to handle large
number namespaces. If anyone has done mapreduce for large number of
namespaces, request to share tips or examples.

Continuing.. I don't know much about Google Cloud Dataflow, does
Google Cloud dataflow support namespaces?

Thanks a lot.
Aswath
www.AccountingGuru.net.



On Wed, Jun 3, 2015 at 11:32 PM, Patrice (Cloud Platform Support)
>>>> To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com.
>>>> To post to this group, send email to google-a...@googlegroups.com.
> --
> You received this message because you are subscribed to the Google Groups "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com.
> To post to this group, send email to google-a...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/ead52dd0-e013-4583-8d74-d8c63d3c3cce%40googlegroups.com.

Patrice (Cloud Platform Support)

unread,
Jun 10, 2015, 12:06:11 PM6/10/15
to google-a...@googlegroups.com, aswath satrasala, aswath satrasala, alejandro...@nextinit.com, pvout...@google.com
Hi aswath

We are working on sending this more generic request up. Basically we intend to have every place where namespace is accessible to be the same kind of suggestion box as the Admin. Thank you for your feedback, it is always appreciated, and we try to improve our services with it, so thank you for sending it :).

As for Dataflow, I have to be honest I haven't explored it that much. I'd assume that you build your datastore reader with queries, and it should be possible to target specific namespaces. 

Cheers!
>>>> To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscribe@googlegroups.com.
>>>> To post to this group, send email to google-appengine@googlegroups.com.
>>>> Visit this group at http://groups.google.com/group/google-appengine.
>>>> To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/CAKFF5G5wRCY_t4xwSz-P_Fxhv2r6sQ%3DoUTj-8UvGNOuC814rXA%40mail.gmail.com.
>>>>
>>>> For more options, visit https://groups.google.com/d/optout.
>>>
>>>
> --
> You received this message because you are subscribed to the Google Groups "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscribe@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages