DB as a Modin Backend

[Ali Panahi]

Hi Modin team!

I'm wondering if there are any facilities to use a database directly as a backend. One idea is to convert the low-level algebra to SQL and then use the SQL to retrieve the results from the DB. Any suggestions on how this could be achieved are greatly appreciated.

If this could be done generically, then we might be able to integrate many other SQL-based (distributed) database systems as a backend for free.

Best,

Ali

[Devin Petersohn]

Hi Ali,

Thanks for reaching out! We have SQL database support (through Calcite) with OmnisciDB here: https://github.com/modin-project/modin/tree/master/modin/experimental/engines/omnisci_on_native/frame. Happy to explore this further with more specifics.

What SQL database are you planning on integrating?

Devin

--
You received this message because you are subscribed to the Google Groups "modin-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to modin-dev+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/modin-dev/10e01c1b-7d70-4c00-8902-2f2db8c0394fn%40googlegroups.com.

[Ali Panahi]

Thanks, Devin.

The Calcite integration would be helpful. I was thinking of integrating with Postgres SQL and Cassandra. I see both have Calcite adapters. 

Ali

--

Ali Panahi