Cypher in Apache Spark

[Mats Rydberg]

Hello dear openCypher community

As you may already be aware, there is a project called Cypher for Apache Spark (CAPS)[1], which has endeavoured to implement a Cypher query engine on top of Apache Spark. CAPS has now reached enough maturity to attract interest from Databricks, and it has been suggested[2] as a Spark Project Improvement Proposal (SPIP)[3] for addition in Apache Spark 3.0.

Now, we would like to engage you in this process. The SPIP needs to receive some amount of public support in order to pass the Spark PMC vote for addition in the main codebase. If you would like to find Cypher as a default module in Apache Spark, you can help us achieve this by:

- Vote, watch, discuss and show support on the JIRA ticket: https://issues.apache.org/jira/browse/SPARK-25994

- Discuss and show support on the developer email list thread: http://apache-spark-developers-list.1001551.n3.nabble.com/Re-SPIP-Property-Graphs-Cypher-Queries-and-Algorithms-td25728.html

For a more detailed view of the proposal, including which parts of CAPS that are being suggested for addition, please view the design documents which you will find via the JIRA ticket.

All the best

Mats

[1]: https://github.com/opencypher/cypher-for-apache-spark

[2]: https://issues.apache.org/jira/browse/SPARK-25994

[3]: https://spark.apache.org/improvement-proposals.html

[Mats Rydberg]

Hello all

The SPIP has now entered the voting phase, and you are all invited to participate by expressing your opinion in the Spark developers mailing list, which may be found through either of these two links:

Link 1

Link 2

In order to post to the mailing list you need to subscribe, which you find instructions for on the Spark community page. The vote ends on February 1st (2 days from sending this message).

This information may also be found on our website: https://www.opencypher.org/

All the best

Mats