How Can I change the LOG LEVEL for Class : cascading.tap.hadoop.io.TapOutputCollector

[ajay wisawe]

Hello Folks

I am new to Cascading.

I wanted to increase the logging level of the MapReduce job which uses cascading. 

I am running into an issue where the Task attempt is stuck after 

INFO [main] cascading.tap.hadoop.io.TapOutputCollector: creating path: 20200901_0900/part-00420-00000

When I kill the attempt it runs successfully on another node with below lines :

INFO [main] cascading.tap.hadoop.io.TapOutputCollector: creating path: 20200901_0900/part-00420-00000

 INFO [main] cascading.tap.hadoop.io.TapOutputCollector: closing tap collector for: /abc/2/20/part-00420-00000

I want to know what happens in between "Creating" and "Closing tap"

Please suggest any DEBUG log level if i can set to print more lines.

Thanks

Ajay

[Chris K Wensel]

If you stick log4j log declarations into your JobConf, that is then passed to the planner, they will be honored on the cluster side.

jobConf.set( “log4j.logger”, “cascading=DEBUG” );

ckw

--
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cascading-use...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cascading-user/5a1200f0-bd83-4bc9-bb17-1982c99ec936n%40googlegroups.com.