Using Counters in Dumbo

26 views
Skip to first unread message

Samarth Gahire

unread,
Oct 15, 2012, 3:29:00 AM10/15/12
to dumbo...@googlegroups.com
Hi ,
    I have written a hadoop job which retrieves some mapping values from the Database, and if the mapping is not present in the database it makes a call to webservice.
I have to count how many webservice call my job did in a single run.
I think this is possible with counters in dumbo{ e.g self.counters["No Of Call To Webservice"] += 1 } but not getting  where to look for this counter value.

Tobias Speckbacher

unread,
Oct 15, 2012, 3:31:54 AM10/15/12
to dumbo...@googlegroups.com
should be in the stats of your job, look at the job tracker page it should be there.

-T
--
You received this message because you are subscribed to the Google Groups "dumbo-user" group.
To view this discussion on the web visit https://groups.google.com/d/msg/dumbo-user/-/L1kOQIyDFAcJ.
To post to this group, send email to dumbo...@googlegroups.com.
To unsubscribe from this group, send email to dumbo-user+...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/dumbo-user?hl=en.

Gilles

unread,
Oct 15, 2012, 4:04:59 AM10/15/12
to dumbo...@googlegroups.com
You can run the command:

hadoop job -counter <job-id> Program "No Of Call To Webservice"

or for a full list:

hadoop job -status <job-id>
Message has been deleted

Samarth Gahire

unread,
Oct 17, 2012, 1:46:42 AM10/17/12
to dumbo...@googlegroups.com
Thanks Tobias and Gilles ,
                                      I found the stats on Jobtracker UI.
Reply all
Reply to author
Forward
0 new messages