how to set grpc serving options to improve performance (python)

[mouse]

I make a backend service by using grpc, and the programing language is python.

how to choice network module, blocking or non-blocking. 

usually, we can set thread num to get more qps. how can i do something like this with grpc + python.

[Guo Jing]

The simplest way is to use thread pool.

from concurrent.futures import ThreadPoolExecutor

pool = ThreadPoolExecutor(max_workers=GRPC_POOL_MAX_WORKER)

server = server_pb2.beta_create_SomeService_server(

            Impl(), pool=pool, pool_size=GRPC_POOL_SIZE,

            default_timeout=5, maximum_timeout=30)

gRPC Python is based on gRPC C Core. You can't change much. The best way I think is to use multi process, I wrote a simple tool called grma. Hope this may help.

https://github.com/qiajigou/grma

[Nathaniel Manista]

Among which network modules are you choosing?

Independent of steps that you can take, know that we've recently completed a large (10x) performance improvement effort for gRPC Python. It's available now at source control head and will be included in grpcio 0.15 (to be released in the next week or two) and later.

-Nathaniel

[mouse]

thank you very much.

在 2016年6月9日星期四 UTC+8上午1:24:28，Guo Jing写道：

[mouse]

在 2016年6月13日星期一 UTC+8上午4:34:33，Nathaniel Manista写道：

On Mon, Jun 6, 2016 at 7:35 PM, mouse <runm...@gmail.com> wrote:

I make a backend service by using grpc, and the programing language is python.

how to choice network module, blocking or non-blocking. 

usually, we can set thread num to get more qps. how can i do something like this with grpc + python.

Among which network modules are you choosing?

 

like thrift , there are simple, thread pool, and non blocking. 

Independent of steps that you can take, know that we've recently completed a large (10x) performance improvement effort for gRPC Python. It's available now at source control head and will be included in grpcio 0.15 (to be released in the next week or two) and later.

-Nathaniel

I expect it.