real-time computations on them. I think Flume is less about
On Nov 5, 9:24 pm, Ted Dunning <
ted.dunn...@gmail.com> wrote:
> I think you could do this with a substrate like JMS, but the purely
> functional contract of map-reduce gives
> you more freedom in terms of semantics than most other frameworks. This
> contract allows, for instance,
> substantial rewrites of the map-reduce dataflow graph that are not allowable
> with a general JMS framework,
> better framework initiated failure tolerance and lighter weight messaging.
> It isn't clear that S4 delivers on
> all of those potentials, but I could imagine that S4 with the equivalent of
> speculative execution and an
> optimization framework like Plume (clone of FlumeJava which is not Flume)
> might give you many of them.
>
> Whether Flume gives you these capabilities, I couldn't say.
>