replicate from one datastore to another firestore

53 views
Skip to first unread message

Rajesh Gupta

unread,
Dec 15, 2020, 11:23:32 PM12/15/20
to google-a...@googlegroups.com
Hello,
I want to copy the data from one datastore project to another firestore project in realtime
Here is the scenario
- We use Objectify to put data the datastore
- After doing put, the row from datastore should be replicated to another firestore project in almost realtime

Why am I doing this?
I am out of quota for datastore indexes.  I have to query data.  So, I thought I will replicate to firestore and query the data.  

What are my options here?

--
Rajesh
Field Service Software on Google Cloud Platform and Mobile


vladoi

unread,
Dec 16, 2020, 6:13:33 AM12/16/20
to Google App Engine
Hello,

>What are my options here?
From your use case description, I believe you should contact Google Cloud Support [1] to request a Datastore indexes quota increase. Also you can export your Datastore data to GCS and then import it on your other project (Firestore Datastore Mode) [2].

Rajesh Gupta

unread,
Dec 17, 2020, 3:49:53 AM12/17/20
to google-a...@googlegroups.com
I had raised a production issue.  The team said that they cannot increase the indexes quota.  
Can you help me out with the increase in index quota.? I need another 25-50, so that we don't slow down our expansion of our SAAS.

Regarding your suggestion: export to GCS and then import to  Firestore:  This is not suitable in my case. I am looking at almost realtime data transfer to firestore, so that I can use firestore data for certain queries.

Cheers,
Rajesh
Field Service Software on Google Cloud Platform and Mobile

--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/5a237e07-fe5f-4d73-ac1e-da009dc1bbb3n%40googlegroups.com.

vladoi

unread,
Dec 18, 2020, 3:31:58 AM12/18/20
to Google App Engine
For increasing the Datastore index quota you have to create a support case with Google Cloud [1] . In the support case you will include the project name, the new index count, the business justification and the approval of the Account Manager or the Sales Representative who assisted you. Then we will inform you if your request was approved. Please note that: for the quota increase request to be accepted no Kind in your Datastore is allowed to have more than 50 indexes.

Reply all
Reply to author
Forward
0 new messages