Using Lovefield as a cache for analytical data

[VJ]

I wanted some feedback if Lovefield is the right choice for us in the following scenario:

• We fetch ~50K rows from the server. The schema is dynamic (changes for each user and sometimes in the same session).
•  We need to create a table and populate the table with the ~50K rows
• We / User performs a variety of groupby/filtering queries on the data. Based on the benchmark - we expect most queries to be completed in less than 50 ms
• We might need to drop the table and load some other data with a potentially different schema. --> this is a common operation.

Given the above - do you think it is a good idea to use Lovefield. Do you see any potential problems with our use case.

[john dimm]

I'm doing something quite similar and am impressed with the results.

https://chrome.google.com/webstore/detail/breakdown-for-mint-and-pe/npkcbabhgmplkmaaljpcbombbgkggilm

It took awhile to figure out how this thing works.

https://github.com/johndimm/breakdown/blob/master/breakdown/javascript/lovefield.js