Nsq performance?

[Wickman]

Hi

I came across this article. I compares performance between queues, including nsq.  There is a graph in there which shows nsq having some performance issues compared to the other players (about 12.000msg/second.)

I'm a bit surprised with the results to be honest, considering nsq is lightweight and not as bloated/complex as some of the other queues.

Now, 12k msgs/second is good enough for my case, and I'm not trying to ignite anything here, but I'd like to know what your experiences are when it comes to throughput in nsq?

Thanks!

[Shane Hansen]

Your throughput obviously depends on the hardware and messages you're sending, but

12k is low. I think I normally get anywhere from 25k to 70k. I think there might be

benchmarks in the nsq source that do even better.

Also, that article compared wildly differing things. It's like comparing memcached to postgres to s3 for data storage. It's more important to understand what semantics each message queue gives you imo.

[Matt Reiferson]

Hi Martin,

Thanks for your question.

Shane made some great points.  I’d like to re-iterate that the performance comparison aspects of that article need to be taken with a grain of salt.  There are lies, damn lies, and benchmarks.

NSQ performance is solid, see http://nsq.io/overview/performance.html.  As stated on that page, single node performance isn’t very interesting for a platform like NSQ because it’s designed to be deployed in a distributed manner, with many nodes participating in the delivery of messages to consumers.

It’s been on my TODO list to publish benchmarks performed on a larger cluster.  In my previous throughput testing I’ve been able to easy saturate gigabit links on multiple producing/consuming machines, but this deserves a more thorough examination.

The real power of NSQ, that I’m sure the community can attest to, is how easy it is to build real systems on top of.  I sincerely doubt it will be your bottleneck but I can damn near guarantee you’ll enjoy working with it.

Hope this helps.

Regards,

Matt