Firebase + Elasticsearch: what's your setup?

[5785...@gmail.com]

Hello everyone,

as se title suggests, I would like to ask community about your solution on extending Firebase platform with Elasticsearch.

According to my needs, I'm looking to link Firestore with Elasticsearch to improve the search experience: mobile users should be able to find content within the app.

I already use Firebase Auth, Firestore and Firebase functions, I'm aware about Google Cloud Launcher but I don't know how to combine it within my Firebase project:

- according to Elastic devs, directly  exposing ES instances to clients is a bad idea (even with their X-Pack security feature)

- using Firebase Functions to interact with ES requires opening up firewall ports and setting up a proxy (see this).

So my question is: how did you integrate ES on your Firebase project both for indexing and querying data?

Since my poor experience on security and backend management, I was wondering if any "Firebase way" exists at all (I mean clean and easy to adopt).

Thanks in advance for sharing

Alessandro

[Kato Richardson]

Hi Allessandro,

I've done both the Functions route and also a local solution. By far the easiest answer for me (to avoid firewalls and proxies and crazies) seemed to be a localized node.js or similar that listens for changes on Firebase data and applies them to ES. However, batching is uber important here, and dealing with service restarts is complex and error prone, as I learned when I wrote Flashlight (outdated) some years back.

These days, I'm liking the Algolia / Functions approach just for the simplicity. But these days, I'm very much an everything-as-a-service fan.

☼, Kato

--
You received this message because you are subscribed to the Google Groups "Firebase Google Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to firebase-talk+unsubscribe@googlegroups.com.
To post to this group, send email to fireba...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/firebase-talk/2ddaad02-feef-4416-8fec-a3ae6bdc5429%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Kato Richardson |

Developer Programs Eng |

kato...@google.com |

775-235-8398

[5785...@gmail.com]

Hello Kato,

super pleased for your reply :-)

I'm aware about Flashlight but I'm not convinced that this type of solution works for fetching data in realtime as mobile users expect(just an impression - never tried).

It would have been fantastic if a service like google cloud identity-aware proxy had allowed to access private GCE only from firebase functions using the serverless for writing and querying but.... I think I will second you about Algolia for now!

Many thanks for your time

Alessandro

Il giorno giovedì 22 marzo 2018 17:45:23 UTC+1, Kato Richardson ha scritto:

Hi Allessandro,

I've done both the Functions route and also a local solution. By far the easiest answer for me (to avoid firewalls and proxies and crazies) seemed to be a localized node.js or similar that listens for changes on Firebase data and applies them to ES. However, batching is uber important here, and dealing with service restarts is complex and error prone, as I learned when I wrote Flashlight (outdated) some years back.

These days, I'm liking the Algolia / Functions approach just for the simplicity. But these days, I'm very much an everything-as-a-service fan.

☼, Kato

On Thu, Mar 22, 2018 at 8:18 AM, <5785...@gmail.com> wrote:

Hello everyone,

as se title suggests, I would like to ask community about your solution on extending Firebase platform with Elasticsearch.

According to my needs, I'm looking to link Firestore with Elasticsearch to improve the search experience: mobile users should be able to find content within the app.

I already use Firebase Auth, Firestore and Firebase functions, I'm aware about Google Cloud Launcher but I don't know how to combine it within my Firebase project:

- according to Elastic devs, directly  exposing ES instances to clients is a bad idea (even with their X-Pack security feature)

- using Firebase Functions to interact with ES requires opening up firewall ports and setting up a proxy (see this).

So my question is: how did you integrate ES on your Firebase project both for indexing and querying data?

Since my poor experience on security and backend management, I was wondering if any "Firebase way" exists at all (I mean clean and easy to adopt).

Thanks in advance for sharing

Alessandro

--
You received this message because you are subscribed to the Google Groups "Firebase Google Group" group.

To unsubscribe from this group and stop receiving emails from it, send an email to firebase-tal...@googlegroups.com.

To post to this group, send email to fireba...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/firebase-talk/2ddaad02-feef-4416-8fec-a3ae6bdc5429%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.