Python Driver using too much CPU

[Gabriel Menegatti]

Hello,

We use the latest version of Python Driver (2.1.4), using Unthrottled Futures and we create one session for each one of the 6 process that we run inside a single server, so 6 sessions in total per server.

The thing is that when our processes finish to execute, we notice that the CPU consumption keeps around 20% to 30%, what we think its really a lot for just a driver.

We have a 4 core / 4 thread (Core i5-3570S, 3.1 GHz+) server with 16 GB of RAM and spinning disks.

Please, is it really "normal" to have the Python Driver (with 6 sessions created) using 20% to 30% of the CPU?

Thanks in advance.

Regards,

Gabriel.

[Gabriel Menegatti]

Hi,

Just complementing...

We made a test closing each session once the process finished running and the CPU utilization simply disappeared.

So, I think the problem was the sessions using too much CPU.

Thanks

[Adam Holmberg]

This depends on which reactor you are using. Unfortunately the asyncore reactor does use CPU at idle. Asyncore is the default connection class if the libev extension is not built.

If possible, make sure libev is present when building/installing the driver:

http://datastax.github.io/python-driver/installation.html?highlight=installation#libev-support

Adam Holmberg

To unsubscribe from this group and stop receiving emails from it, send an email to python-driver-u...@lists.datastax.com.