How can I run multiple task managers on my development machine

[Asterios Katsifodimos]

I would like to spawn multiple task managers listening to different ports (and JVMs) on my machine for testing. 

How can I do this with e.g. a simple WordCount example? It seems that the 

ExecutionEnvironment.setDefaultLocalParallelism(INT);  

does not do the trick.

Thanks,
Asterios

[Ufuk Celebi]

The local environment only uses a single TaskManager thread. If you JavaProgramTestBase you can set the number of TaskManagers. See WordCountITCase as an example.

Does this help? Or do you think we should expose this via ExecutionEnvironment?

--
You received this message because you are subscribed to the Google Groups "stratosphere-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to stratosphere-d...@googlegroups.com.
Visit this group at http://groups.google.com/group/stratosphere-dev.
For more options, visit https://groups.google.com/d/optout.

[Asterios Katsifodimos]

I see. Yes, that does the trick.

I would love to have it in the ExecutionEnvironment. But then, is this something that the users might use or just a dev tool for Stratosphere developers? I can imagine cases where  jobs running in separate task managers/JVMs makes sense for testing reasons.

Asterios

[Stephan Ewen]

I currently think of it as a tool for the system developers. That is why we did not expose it through the environments.

Do you think it is useful for program developers as well?

[Ufuk Celebi]

On 04 Jun 2014, at 00:42, Stephan Ewen <se...@apache.org> wrote:

I currently think of it as a tool for the system developers. That is why we did not expose it through the environments.

+1

Do you think it is useful for program developers as well?

I think the answer is a clear no. It also might have the added benefit of enforcing system developers to write a proper test based on the base test classes.