# Export the data from the old instance.appcfg.py -e <your email address> download_data \--url http://<your Google Apps rietveld domain>/remote_api \--filename /tmp/codereview.data \--log_file /tmp/codereview.log \--batch_size 100
# Import the data into your new instance.
appcfg.py -e <your email address> upload_data \
--url http://<your AppSpot rietveld domain>/_ah/remote_api \
--filename /tmp/codereview.data --batch_size 100
--
You received this message because you are subscribed to the Google Groups "codereview-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to codereview-disc...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
To unsubscribe from this group and stop receiving emails from it, send an email to codereview-discuss+unsub...@googlegroups.com.
IIRC the hosted version was using a custom data model?
To unsubscribe from this group and stop receiving emails from it, send an email to codereview-disc...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "codereview-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to codereview-disc...@googlegroups.com.
Well, the migration doc seems to suggest it's the same, so you can export import:
https://docs.google.com/document/d/1GP5uTwiLRAVeY-mXxfhqMPEud3ieB16A8xEbbBDfE6M/pub
--
Perry Ismangil
me.ismangil.com
builtins:- remote_api: on
I have attached the log file from the recently failed export. It doesn't have any indication on what the error is, but it appears to be a situation where one of the worker threads goes into an endless backoff loop while the rest of the threads fail to make progress.Ok, this definitely smells like an authentication issue (after 5 days the auth token has likely expired; it also matches what I see in my logs). Looking at the top of the file, it seems the exporter is using fairly low throttling limits (in particular on the bandwidth front); feel free to increase that, to see if that help.Regarding the larger batch sizes, I don't have a log file, but if I remember correctly, it fails to spawn multiple threads and eventually times out.Ok. Anything beyond 1k is going to be problematic anyway, since the AppEngine datastore is doing throttling of its own\.I currently have an export running with a batch size set to 40...It has transferred 365K entities so far after about 6 hours. If I'm lucky, it will finish without error in 24 hours.Keep me posted! And if this fails, maybe try a larger batch size with a much increased bandwidth limit (actually you can also try to increase the other throttling settings, don't worry about hammering us too hard).