PyMySQL and Openstack

[mike bayer]

Greetings PyMySQL -

I'm posting from the Openstack community, to let you know that we are seriously considering moving the Openstack platform to make use of the PyMySQL driver as the default MySQL driver for Openstack.   The rationale for moving to PyMySQL from MySQL-Python comes down essentially to PyMySQL's ability to be eventlet/gevent monkeypatched, its Python 3 support, its availability on Pypi, as well as its generally active community and development pace.

Within Openstack-land, nothing really happens without some level of consensus around things, so in order to make PyMySQL a known quantity I've written up a summary of the MySQL driver situation here: https://wiki.openstack.org/wiki/PyMySQL_evaluation.   This document goes over the drivers that are available and then goes into a dive of PyMySQL's source code and documentation.   This is meant to be a constructive critique, so I ask that as you read it, note that virtually all of the various "issues" reported are documented in the spirit of how minor and quickly fixable they are.   This document is focused around the potential for improvement of the PyMySQL driver, which has already proven itself as potentially the most promising MySQL driver for Python right now.

As the creator/maintainer of SQLAlchemy, I've already been working with PyMySQL since 2010 when I first got a patch for a SQLAlchemy support.  Now that I've looked a bit at PyMySQL, I have all kinds of ideas for improving it.  However, it's not my project!  So one thing I ask is that when reviewing my evaluation, maybe give me a heads up on how open the PyMySQL project would be towards pull requests in the areas of tests, documentation, and performance improvements, if me or others started sending pull requests along.     I'd also be curious longer term what the PyMySQL project's appetite would be for things like optional C speedups (like those that SQLAlchemy has for data processing result rows) as well as more APIs for explicit async support (it's general knowledge that I'm not particularly enthusiastic about the async case, but we do really need DBAPIs to begin taking this use case more seriously).

Thanks for the great work on PyMySQL!

- mike

[Patrick Dunnigan]

Hi Mike,

It is funny you posted this note on the 28th, I was just having a conversation that day with a colleague and the gist of the conversation was how we made the right choice with pymysql vs the others 3 years ago. It has been one of the most stable libraries we rely on.

I am a very minor contributor to pymysql, but here's my two cents. I think more unit testing would be great especially if there are more frequent contributions and releases. Next, the biggest hump when we started using it was that the documentation relied on the documentation of other mysql python projects. Docs and examples could use attention. I agree with the C speedups as long as that is optional. The pure python aspect is one of the main appeals of this library. Lastly, another of the strengths of this library is that it doesn't rely on other non-standard python libraries. That is a major plus in my opinion.

If you are leaning towards pymysql you are on the right track. Keep us informed on your progress.

Thanks,
Patrick

mike bayer

January 28, 2015 at 5:19 PM

--
You received this message because you are subscribed to the Google Groups "PyMySQL Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pymysql-user...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[INADA Naoki]

Hi, Mike.

First of all, very thanks for your post and proposal.

I worried about Python/MySQL world, since I'm only active maintainer
while my time and skill are very limited.
Especially, I'm not good at English to write document.

So I'm very welcome and exited if you join us.
As an user of SQLAlchemy, I trust you more than me.
May I add you to PyMySQL organization on Github?

> --
> You received this message because you are subscribed to the Google Groups
> "PyMySQL Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to pymysql-user...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.

--
INADA Naoki <songof...@gmail.com>

[mike bayer]

Hi Naoki -

Sure thing.  There's already been interest on the openstack-dev list in submitting some performance improvements to the internals of connection.py and cursor.py.   I'd be glad to help review these.

- mike