Topology Optimiser

[Suminda Dharmasena]

Also it is good to have a topology optimiser which would be like a super compiler.

[Jordan Halterman]

That is an awesome idea. I think it's easy to implement aggregations on Vertigo, but compiling things into efficient topologies will be where the true gains can be made.

On Jan 29, 2015, at 6:54 PM, Suminda Dharmasena <sirina...@gmail.com> wrote:

Also it is good to have a topology optimiser which would be like a super compiler.

--
You received this message because you are subscribed to the Google Groups "vertigo" group.
To unsubscribe from this group and stop receiving emails from it, send an email to vertx-vertig...@googlegroups.com.
To post to this group, send email to vertx-...@googlegroups.com.
Visit this group at http://groups.google.com/group/vertx-vertigo.
To view this discussion on the web visit https://groups.google.com/d/msgid/vertx-vertigo/bb37e027-3703-4df7-8b61-a4d1cb8bfc57%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Suminda Dharmasena]

In this process you can look into convert higher abstract operation into simpler ones also. Also some runtime matrix based optimisation for cluster resources.

[Oliver Rolle]

We might get inspired by the optimizer of flink https://github.com/apache/flink/tree/master/flink-compiler. Flink is comparable to spark.