[ANN] cpython bindings for clojure

[Chris Nuernberger]

Good morning Clojurians,

About 2 months ago during a talk about the tech.ml systems the point was made that if we could load the python C libraries then that would provide us with a lot more libraries to draw from.  In addition, I seem to remember one of the ML talks a concern about lack of libraries being the problem.

So, in the spirit of building bridges and providing clojure with the best possible libraries for any particular problem on the planet, I took the last month and built out raw cpython (libpython3.X) bindings based on JNA.

So, today after cleaning things up just a little bit I decided it was time to announce libpython-clj.  My hope is that there are enough clojuian pythonistas that we can take this library and make it an absolute joy to work with; the best python hosting environment that exists.

https://github.com/cnuernber/libpython-clj

Some features include:

* Python dicts are represented in java as java.util.Map's.

* stdout,stderr are overridden to write to *out* and *err*, respectively.

* transparent access to the python interpreter from any thread.

* zero-copy pathways for numpy->tech.datatype tensors and back.  So you can intermix heavy processing between clojure and python without pay a large conversion cost.

* Decent performance.  This is built on the raw cpython shared library so our cost of executing or interoperating with python should not be any higher than anyone else's.

* two way bridging.  Expose your JVM objects to python and vice versa.

I have a simple keras demo where I use Keras from clojure to train a neural network included in the examples.  So that proves out keras and tensorflow access from clojure.

I think this soundly addresses our ability to load cutting edge math and machine learning libraries.

[Jonah Benton]

Wow, that is incredibly cool. Eager to check it out.

--
You received this message because you are subscribed to the Google
Groups "Clojure" group.
To post to this group, send email to clo...@googlegroups.com
Note that posts from new members are moderated - please be patient with your first post.
To unsubscribe from this group, send email to
clojure+u...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/clojure?hl=en
---
You received this message because you are subscribed to the Google Groups "Clojure" group.
To unsubscribe from this group and stop receiving emails from it, send an email to clojure+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/clojure/CADbpEJvOWoxZu0Y_LHi%2B36bEbcOfxCV5n0jd7mhvq8TO9MaD_w%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

[John Newman]

👏👏👏👏👏

To view this discussion on the web visit https://groups.google.com/d/msgid/clojure/CANoO%3DwR%3Dwau9Ci%2BbCxaO_vRJXbbPoE%2B8bg_tYsUTEU9Wz3LrSA%40mail.gmail.com.

[Rick Mangi]

OMG, maybe this will get my DS team more interested in clojure.

Fantastic job!

To view this discussion on the web visit https://groups.google.com/d/msgid/clojure/CAPaaNq2Prt268YX2BQwHrcfgjOMqrVu4fqNdfTyZS%3D4ZMxd-4Q%40mail.gmail.com.

For more options, visit https://groups.google.com/d/optout.

--

Rick Mangi

Senior Director of Data Engineering

Chartbeat

917.848.3619 | @rmangi | ri...@chartbeat.com

826 Broadway, 6th Fl., New York, NY 10003

[Alan Moore]

Awesome!

Alan

[Daniel Carleton]

Excellent! I'd just been considering with trepidation trying to use jython for something when your message appeared. 

On Wed, Jun 5, 2019, 5:40 PM Alan Moore <kahun...@coopsource.org> wrote:

Awesome!

Alan

--
You received this message because you are subscribed to the Google
Groups "Clojure" group.
To post to this group, send email to clo...@googlegroups.com
Note that posts from new members are moderated - please be patient with your first post.
To unsubscribe from this group, send email to
clojure+u...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/clojure?hl=en
---
You received this message because you are subscribed to the Google Groups "Clojure" group.
To unsubscribe from this group and stop receiving emails from it, send an email to clojure+u...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/clojure/234d90b5-089f-49e2-9102-1f14d28f5c9a%40googlegroups.com.

[Mattias Arro]

This is beyond cool. Thank you so much for putting this together!