Proper Send Batching

[Brandon Darling]

Is it possible to actually send messages in an actual batch. Lets say I have a batch of 10 messages, the current implementation just kicks off 10 threads and calls send on each one (implementation below).

Current Implementation:

 Task.WhenAll(messages.Select(x => endpoint.Send(x, pipe, cancellationToken)));

From a performance and cost perspective this is bad. I want one call made to Azure, not 10.

Thanks,

Brandon

[Chris Patterson]

MassTransit does not have a publicly surfaced batch send/publish API, primarily due to the transport requirements and how much they differ when it comes to batching.

And, if you've benchmarked (I have), there is no significant advantage to sending messages as a batch compared to using the .SendBatch() extension methods. I know, I've measured it.

https://twitter.com/PhatBoyG/status/1382128095474372612?s=20

The Azure client is a streaming client, so it doesn't do a full RPC handshake per message send.

--
You received this message because you are subscribed to the Google Groups "masstransit-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to masstransit-dis...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/masstransit-discuss/b1571e86-3343-4f4d-abbd-e2afca79a2ebn%40googlegroups.com.

[Brandon Darling]

Thanks for the prompt response. It does make me feel better that the performance is on par; however, from a cost perspective it is still an order of magnitude higher. It would be a nice feature to have the ability to send all messages in actual batch vs one at a time.

[Chris Patterson]

Well, as I said, nothing in MassTransit is going to do that at this point.

To view this discussion on the web visit https://groups.google.com/d/msgid/masstransit-discuss/32390b60-ca6c-4392-afe4-9a0f7d4ee14fn%40googlegroups.com.