In Cascading flink unable to add listener in local mode.

[santlal gupta]

Hi,

I have run cascading job(local) in which i am checking whether flow is local or not using stepsAreLocal().  

I want to add listener on flowStepStats to get stats if flow is local.

But in cascading-flink, stepsAreLocal() of FlinkFlow class is always returning false, even when job runs in local.

Hence i am unable to add listener to get stats.

I have tested above scenario using Hadoop2MR1FlowConnector and Hadoop2TezFlowConnector, stepsAreLocal() returns true for  cascading job(local). 

I am using below version of jar : 

cascading          :  3.1.0

cascading-flink :  0.3.0

hadoop              :  2.6.0

Can someone please help why stepsAreLocal() method in FlinkFlow class is returning false while running jobs in local?

Thanks

Santlal Gupta

[Fabian Hueske]

Hi,

it's possible that this method was not correctly implemented in the Cascading Flink runner.

Would you mind opening an issue at the Github project?

-> https://github.com/dataArtisans/cascading-flink

Thanks,

Fabian

--
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cascading-user+unsubscribe@googlegroups.com.
To post to this group, send email to cascading-user@googlegroups.com.
Visit this group at https://groups.google.com/group/cascading-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/cascading-user/f127194a-133a-4ecd-a5fb-f097bd9e3a1d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[santlal gupta]

Hi Fabian,

Thanks for you reply Fabian.

I have opened issue on cascading-flink  https://github.com/dataArtisans/cascading-flink/issues/69 for this issue.

Thanks

Santlal Gupta