UseConcurrencyLimit > 1 losing messages

[Jeff Borden]

I've found that if I set UseConcurrencyLimit to any value great than one on my saga, that I'll lose typically 1 to 2 messages per thousand.  They just seem to disappear into the ether.  Nothing in the error queues.

Is there a way I can up the concurrency limit without losing messages?

[Chris Patterson]

It's likely you have a timing issue in your saga. 

What repository are you using? Are you using the InMemoryOutBox to defer messages until the saga is saved? And what transport are you using?

__
Chris Patterson

On Sat, Dec 10, 2016 at 2:59 PM -0800, "Jeff Borden" <jbor...@gmail.com> wrote:

I've found that if I set UseConcurrencyLimit to any value great than one on my saga, that I'll lose typically 1 to 2 messages per thousand.  They just seem to disappear into the ether.  Nothing in the error queues.

Is there a way I can up the concurrency limit without losing messages?

--
You received this message because you are subscribed to the Google Groups "masstransit-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to masstransit-dis...@googlegroups.com.
To post to this group, send email to masstrans...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/masstransit-discuss/2530f923-eb04-4929-8b0a-293cdf4a1980%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Jeff Borden]

Hey Chris,

I'm using Rabbit & EF.  I'm not using InMemoryOutBox, is that recommended?

On Saturday, December 10, 2016 at 6:22:14 PM UTC-6, Chris Patterson wrote:

It's likely you have a timing issue in your saga. 

What repository are you using? Are you using the InMemoryOutBox to defer messages until the saga is saved? And what transport are you using?

__
Chris Patterson

On Sat, Dec 10, 2016 at 2:59 PM -0800, "Jeff Borden" <jbor...@gmail.com> wrote:

I've found that if I set UseConcurrencyLimit to any value great than one on my saga, that I'll lose typically 1 to 2 messages per thousand.  They just seem to disappear into the ether.  Nothing in the error queues.

Is there a way I can up the concurrency limit without losing messages?

--
You received this message because you are subscribed to the Google Groups "masstransit-discuss" group.

To unsubscribe from this group and stop receiving emails from it, send an email to masstransit-discuss+unsub...@googlegroups.com.

[Alexey Zimarev]

Jeff, using the outbox will prevent publishing messages that are part of the step process, before saga state is properly persisted. If you do not use it, your messages can be sent out but saga persistence fails for some reason and in such case the saga will be in an invalid state.

When you have many messages come to the same saga instance in parallel, you can get the database record overwritten. If the record is locked, then you can get an exception when persisting the saga and in such case definitely the outbox can help.

[Jeff Borden]

Alexey,

Thank you.  I've implemented the outbox and my saga is finally behaving like I had hoped.  I was going nuts trying to track down missing messages.  I'm hoping some documentation gets added regarding the feature, as it seems to be an important one and a difficult one to troubleshoot.

[Alexey Zimarev]

Welcome to the club, I had exactly the same issue but I traced the saga repository errors in the log so it was quite clear what is going on but I did not know how to fix it.

I will try to update the docs or may be Chris will do it before me :)

[Alexey Zimarev]

This question was also asked on StackOverflow http://stackoverflow.com/questions/38716143/masstransit-saga-running-with-prefetch-1

[Dru Sellers]

re: docs - I'm working on this now - http://masstransit-project.com/

The question, is. Where would I put this. :)

Open to ideas and review.

On Sun, Dec 11, 2016 at 2:00 PM, Alexey Zimarev <azim...@gmail.com> wrote:

This question was also asked on StackOverflow http://stackoverflow.com/questions/38716143/masstransit-saga-running-with-prefetch-1

--

You received this message because you are subscribed to the Google Groups "masstransit-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to masstransit-discuss+unsub...@googlegroups.com.

To post to this group, send email to masstransit-discuss@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/masstransit-discuss/be623313-48d3-4456-96d3-38e5ab2f5f33%40googlegroups.com.

[Chris Patterson]

It's here now: 

http://docs.masstransit-project.com/en/latest/sagas/persistence.html?highlight=outbox#publishing-and-sending-from-sagas

On Mon, Dec 12, 2016 at 7:07 AM, Dru Sellers <d...@drusellers.com> wrote:

re: docs - I'm working on this now - http://masstransit-project.com/

The question, is. Where would I put this. :)

Open to ideas and review.

On Sun, Dec 11, 2016 at 2:00 PM, Alexey Zimarev <azim...@gmail.com> wrote:

This question was also asked on StackOverflow http://stackoverflow.com/questions/38716143/masstransit-saga-running-with-prefetch-1

--
You received this message because you are subscribed to the Google Groups "masstransit-discuss" group.

To unsubscribe from this group and stop receiving emails from it, send an email to masstransit-discuss+unsubscribe...@googlegroups.com.

To post to this group, send email to masstransit-discuss@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/masstransit-discuss/be623313-48d3-4456-96d3-38e5ab2f5f33%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "masstransit-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to masstransit-discuss+unsub...@googlegroups.com.
To post to this group, send email to masstransit-discuss@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/masstransit-discuss/CAHwtU2mNTzZXy2Wwc1NK5x8DjF5Qp_RTtVWHD56MKzC4Ugdgaw%40mail.gmail.com.

[Dru Sellers]

added here as well. http://masstransit-project.com/usecases/sagas/#publishing-and-sending-from-sagas

thank you

On Mon, Dec 12, 2016 at 9:09 AM, Chris Patterson <ch...@phatboyg.com> wrote:

It's here now: 

http://docs.masstransit-project.com/en/latest/sagas/persistence.html?highlight=outbox#publishing-and-sending-from-sagas

On Mon, Dec 12, 2016 at 7:07 AM, Dru Sellers <d...@drusellers.com> wrote:

re: docs - I'm working on this now - http://masstransit-project.com/

The question, is. Where would I put this. :)

Open to ideas and review.

On Sun, Dec 11, 2016 at 2:00 PM, Alexey Zimarev <azim...@gmail.com> wrote:

This question was also asked on StackOverflow http://stackoverflow.com/questions/38716143/masstransit-saga-running-with-prefetch-1

--
You received this message because you are subscribed to the Google Groups "masstransit-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to masstransit-discuss+unsubscribe...@googlegroups.com.
To post to this group, send email to masstransit-discuss@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/masstransit-discuss/be623313-48d3-4456-96d3-38e5ab2f5f33%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "masstransit-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to masstransit-discuss+unsubscribe...@googlegroups.com.
To post to this group, send email to masstransit-discuss@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/masstransit-discuss/CAHwtU2mNTzZXy2Wwc1NK5x8DjF5Qp_RTtVWHD56MKzC4Ugdgaw%40mail.gmail.com.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "masstransit-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to masstransit-discuss+unsub...@googlegroups.com.
To post to this group, send email to masstransit-discuss@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/masstransit-discuss/CAHX4WYd2u_uE7y_sm-Y95qdM0_fxb%2B-2uMv7iaGs2eCCUQL%3DvQ%40mail.gmail.com.

[Alexey Zimarev]

Dru, documentation sites split now, do you have plans to include it to the main repo and accept PRs?

[Chris Patterson]

The documentation site (MassTransit/masstransit.github.io) will absolutely accept PR's, we're slowly migrating the content over to the new site and still trying to figure out TOC/indexing strategies to make it as useful at the existing RTD site.

On Mon, Dec 12, 2016 at 7:49 AM, Alexey Zimarev <azim...@gmail.com> wrote:

Dru, documentation sites split now, do you have plans to include it to the main repo and accept PRs?

--

You received this message because you are subscribed to the Google Groups "masstransit-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to masstransit-discuss+unsub...@googlegroups.com.
To post to this group, send email to masstransit-discuss@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/masstransit-discuss/82825f7c-867f-4131-807a-104f45f61f59%40googlegroups.com.

[Alexey Zimarev]

http://docs.servicestack.net/ uses Github Pages and has perfect ToC