Elasticsearch on App Engine

[Mike Hardy]

Hi, we have an application that runs on App Engine Flexible. This application uses Elasticsearch, which runs on a compute engine instance, but we want to GAEize the elasticsearch component to run as a managed service; however, we're not quite sure if this is even possible.

1. Is it possible to run elasticsearch as a service on GAE?

2. If it is possible, how would one connect to Elasticsearch from other GAE services given that GAE has ephemeral IP addresses?

Thanks!

[Barry Hunter]

1. Is it possible to run elasticsearch as a service on GAE?

In theory with the Flex enviroment. Basically run custom docker images. 

https://cloud.google.com/appengine/docs/flexible/custom-runtimes/about-custom-runtimes

https://www.google.com/search?q=elasticsearch+docker

The main issue I imagine would there isn't a 'persistent' disk as such (to store the index). The docker image at startup would have to download the index from say Cloud Storage

 

2. If it is possible, how would one connect to Elasticsearch from other GAE services given that GAE has ephemeral IP addresses?

I imagine be able setup ES to just listen to port 8080 with the its HTTP API

http://nocf-www.elastic.co/guide/en/elasticsearch/reference/current/modules-http.html

Then can just connect to the instance(s) using the 'appspot.com' hostname. 

Maybe the healthcheck pings might need a bit of special consideation

https://cloud.google.com/appengine/docs/flexible/python/how-instances-are-managed

Although might be better to use say nginx as the front end as can add an 'authentication' layer, to prevent direct access to your ES instances. 

 

Thanks!

--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscribe@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/d1f42fab-0a8a-485a-a2cb-33ccc3f2807c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.