Event sourcing backend with scalable pub/sub

[leo...@liveperson.com]

One of the possible use cases of event sourcing we’d like to implement is subscribing to domain events changes.

The requirements are quite high:

Over 100000 live topics/entities, preferably up to 1,000,000

Up to 50000 updates per second

Low latency - less than 10msec, average

Topic scale seems to be the most challenging on this list.

Can anyone recommend a data store that can provide the above (or close to above) requirements?

Thanks,

Leonid

[Greg Young]

event store can easily handle the first requirement even 50m isn't
much of a question for #2 I would need to know more about the
requirement/hardware/etc

> This message may contain confidential and/or privileged information.
> If you are not the addressee or authorized to receive this on behalf of the
> addressee you must not use, copy, disclose or take action based on this
> message or any information herein.
> If you have received this message in error, please advise the sender
> immediately by reply email and delete this message. Thank you.
>
> --
> You received this message because you are subscribed to the Google Groups
> "DDD/CQRS" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dddcqrs+u...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.



--
Studying for the Turing test

[leo...@liveperson.com]

You mean the hardware potentially running Event Store? What would you like to know specifically?

What about #3? When I've mentioned topic scale as the most challenging, I've actually meant topic scale at low latency.

[Greg Young]

#3 isn't much of a problem depending on setup/throughput etc.

#2 there is a lot of questions that go into it and they obviously
relate to #3 as well.

[leo...@liveperson.com]

Can we setup a conference call/chat tomorrow to go into more details regarding the requirements?

If so, what time is convenient for you?

Thanks,

Leonid