What is the best approach for BI/Big Data with Firebase?

[Kaue Machado]

What would be the best way to implement BI/Big Data using firebase data?

Let's say I have something similar to Shopify (shopify.com) and I wan't to provide my f with the following informations about their stores:
- Top selling countries
- Revenue per country (for each of the top selling countries)
- Top selling products

What would be the best way to provide this data to my customer? Running server side applications that compile this information from time to time? Using 3rd party services for this? If so, are there any suggestions?

Does anyone have a use case this complex of Firebase?

[Simeon Vincent]

Relatively new Firebase user here, so take this with a grain of salt.

By itself, I don't think Firebase is the right tool for BI/Big Data. Firebase seems like a great production data store because of it's speed, scaleability, etc., but those are production concerns. BI concerns tend to be a bit different; you often want to collect huge amounts of stateful data, then map-reduce it. That's a rather different problem.

I think the solution is to integrate your Firebase with a BI/DW tool like Amazon Elastic Map Reduce or Google's Hadoop on CCE. It should be possible to set up a custom server to stream updates from Firebase to your Hadoop cluster. When the Hadoop jobs finish, you could push data back into Firebase in order to provide the application with a consistent API for data retrieval.

That was all pretty hand-wavy, but long story short I don't think Firebase alone will solve the problem.

Cheers,

Simeon

[Kaue Machado]

Thanks Simeon, actually I wasn't planning on using Firebase on its own for the BI. I already have an application with data so what I needed was a way (the best way) to go through the data and generate BI from it.

I'm not familiar with Elastic Map Reduce or Hadoop, but now I know what to search for, thanks a lot! I'm going to search about them.

--
You received this message because you are subscribed to a topic in the Google Groups "Firebase Google Group" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/firebase-talk/QQ6_S_BLMuk/unsubscribe.
To unsubscribe from this group and all its topics, send an email to firebase-tal...@googlegroups.com.
To post to this group, send email to fireba...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/firebase-talk/bc68e72d-98e9-44d3-b32f-238c340b5c2a%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.