Using gcloud instead of the GAE SDK to develop GAE standard

95 views
Skip to first unread message

PK

unread,
Nov 2, 2016, 5:25:20 PM11/2/16
to Google App Engine
Is the gcloud toolchain now in parity with the GAE SDK tools? It seems that gloud is the future and I am considering switching my environment over but want to 

(1) confirm and 
(2) see if there are any gotchas that others run into.




Emanuele Ziglioli

unread,
Nov 3, 2016, 4:20:45 PM11/3/16
to Google App Engine
Can I add 

(3) is the datastore emulation in gcloud any different, better, faster, more robust than standard?

When it reaches about 30MB database space, it gets really slow and eventually it just stops working. 
What happens is either database corruption or the GAE fails to load it at startup and deletes it altogether.
Increasing the JVM ram size help pushing this limit, I'm now allocating 4GB! 
Still, that doesn't help with the Datastore emulator speed.
I've got a recent copy of the local datastore that I keep restoring but it's just so unpredictable when it crashes.

What the maximum size datastore you guys have been able to reach on the local emulator? 
30MB seems to small by any standard. But I've read on SO that GAE basically reads it all at once as a file, that's why it runs out of memory eventually.

George (Cloud Platform Support)

unread,
Nov 3, 2016, 6:00:37 PM11/3/16
to Google App Engine

Hi PK,

An interesting question, thanks.

In fact, gcloud is a part of the Google Cloud SDK. You must download and install the SDK on your system and initialize it before you can use gcloud. There is no border between gcloud and the SDK, and no mutually exclusive choices.

Generally, tools that are in development might show some gotchas from time to time, as you noticed. The commands within the gcloud CLI, as within the SDK, are developed continuously, and new ones added from time to time.

If you would like to only use the console with the gcloud commands in the shell, you may choose to do that to facilitate development, and it’s helpful to a large extent. A web editor is provided as well, that you can access from the toolbar by clicking the file icon.

Choosing your proper tools might end being a matter of personal choice.

Peter K

unread,
Nov 3, 2016, 6:16:24 PM11/3/16
to google-a...@googlegroups.com
Maybe I did not make myself clear: It appears that right now there are two ways to develop with GAE Standard. 

(1) The original way: Use the Google App Engine SDK  (GAESDK) (see the optional step in https://cloud.google.com/appengine/docs/python/download)
(2) Using the Google Cloud SDK (GCSDK) (this is what I meant by ‘gcloud' in my original post). It now seems to be the recommended way.

I have been developing with GAE Standard since before the GCSDK so I have been happily using the GAESDK. My question is whether the GCSKD is in parity with the GAESDK and can now attempt to switch, whether there are any gotchas I should be aware etc.

My environment is Python.

Thanks

PS Although the Google Platform Support answer is always welcome, I would mostly appreciate an answer from somebody who has gone through this, and has some hands on experience.

--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/3e6ffba4-a8ec-4aa9-a67c-e438b849a62c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

PK

unread,
Nov 4, 2016, 1:04:54 AM11/4/16
to google-a...@googlegroups.com
I had issues like that with the first generation of the development server but I have been very happy with the current one. I just checked and here is what I see in terms of storage, the latency is really good.

177M  datastore.db
2.4G   logs.db

This development server has been up and down for months with no corruption or other issues. 

Like I said I use the Python SDK, the Java experience might be different.

--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
Reply all
Reply to author
Forward
0 new messages