Make EMR aware of cluster status via Hadoop

10 views
Skip to first unread message

Xuchen Yao

unread,
Oct 4, 2019, 7:23:27 PM10/4/19
to mrjob
I log into Master node to submit job like this:

python my_mrjob.py -r hadoop ...

Job runs OK, I can see the Hadoop UI. But the EMR status always shows:

WaitingCluster ready to run steps.

When I submit via `-r emr` I can see cluster status changes to "Running".

Is there a way to make EMR aware of job status when submitting a job via Hadoop?
Reply all
Reply to author
Forward
0 new messages