How to get and set a job configuration

[Emad Mohammed]

Hi
I would like to know hoe to get and set a job configuration. I want to read the data chunck offset in the map phase
Regards
Emad

[Antonio Piccolboni]

Some of the job conf information is available as environment variables, e.g. with sys.getenv

I run a job  like this one to get a list

hadoop jar $HADOOP_STREAMING -input small-text-file -mapper env -output /tmp/env

Then get the output to local do a sort output | uniq and you will get a list of variables. The one you want may be in there. I don't think setting them has any effect, but I may be wrong.

I found two variables that may be of interest

mapreduce_map_input_length

mapreduce_map_input_start

The related properties should have the same names but with dots instead of underscores.

--
post: rha...@googlegroups.com ||
unsubscribe: rhadoop+u...@googlegroups.com ||
web: https://groups.google.com/d/forum/rhadoop?hl=en-US
---
You received this message because you are subscribed to the Google Groups "RHadoop" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rhadoop+u...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Emad Mohammed]

Thanks Antonio