Modify Datastore Admin Backup Built-in Taskqueue

66 views
Skip to first unread message

ray abanid

unread,
Jan 19, 2021, 10:10:50 AM1/19/21
to Google App Engine
Hello everyone,

I have some questions regarding the datastore backup. I'm wondering if we can modify or override the built-in task queue on datastore admin /_ah/datastore_admin/backup.create?

What I want to do when exporting the data from datastore is that I would only need to export the data that has specific date range that I specify. I saw on the documentation that you can pass a parameter to the URL. Is its possible to pass the parameter on the date range like this one?
/_ah/datastore_admin/backup.create?name=MyBackup&StartDate=12-01-20&EndDate=01-12-21.

Please let me know if I miss something.

Thanks a lot
Ray

Elliott (Cloud Platform Support)

unread,
Jan 19, 2021, 3:08:48 PM1/19/21
to Google App Engine
Hello,

I understand that you to want to export the data from Cloud Datastore that has a specific date range you that may specify programmatically such as the example:

/_ah/datastore_admin/backup.create?name=MyBackup&StartDate=12-01-20&EndDate=01-12-21

I did some research into this and found that the backup URL is meant to be done automatically. I was wanting to share some documentation available to the public on the details but since this is not standard, examples are limited. So to evolve this conversation and provide advice to you, can you please provide the documentation you found to illustrate your use case?

I have found that it may be possible to use the URL with parameters, but I am unable to verify this using official documentation. So it may not work.


I have looked at Cloud Datastore Admin as an option but it is deprecated. I would suggest looking into the new method of exporting as backup.

To add value to this thread, I was able to find a thread with an accepted answer relating to a similar question indicating the Cloud Datastore Admin is deprecated and that upgrading to the Cloud Datastore export service was recommended.

I hope this helps.

Brenshield Abanid

unread,
Jan 25, 2021, 5:07:24 AM1/25/21
to Google App Engine
Hi Elliot,

Thank you for the answer. Unfortunately I can't provide the documentation that I was talking about since I just saw it on the thread on stackoverflow. I thought the answer was based on the documentation but it was not. Sorry for that.

Like you said, you can pass a parameter based on this thread: but is there any documentation indicating on what other parameters you can pass? Because if there's any, can you please provide a link? Thank you so much!

Denis T (Google Cloud Platform Support)

unread,
Jan 27, 2021, 5:17:51 AM1/27/21
to Google App Engine

Hello,

As my colleague supposed, it might be possible to use a URL with the parameters, however, he wasn’t able to verify that. Looking into the mentioned answer on StackOverflow, I believe that it’s outdated by now - after all, it was posted in 2013. That answer suggests the usage of Datastore Admin and Task Queue API - both options have been deprecated since then.

Nevertheless, in response to your question, the documentation for the parameters of the taskqueue.add() method can be found here. However, please note that It is now recommended to use the managed export/import service instead.

Reply all
Reply to author
Forward
0 new messages