InMobi's contribution to hRaven

[Angad Singh]

Hello,

I am about to send 13 pull requests to hraven, on various changes that I have done:

https://github.com/InMobi/hraven/compare/twitter:master...master

Setting some context here before sending them.

I have been working adopting/using hraven at InMobi since a couple of months. While the storage of metrics to Hbase + the REST APIs have been useful for adhoc analysis of issues and having a more queryable job history than hadoop's, we needed a way to visualize / trend the metrics over time in graphite, and found hraven's robust handling of hadoop job history (both v1 & v2 support, identification of flows, app layer specific logic for pig and cascading, etc.) to be the perfect choice over other means.

Happy to announce that hraven has been running in production at InMobi for around 2 months, processing over 2 million hadoop job history files a month and sending over all the metrics to graphite. Over the course of hraven's adoption we have made some changes like refactoring it for multiple sink support, making it compatible to run on oozie/falcon, ability to have path exclusion/inclusion filters, hbase 0.90.x compatibility, bug fixes, etc.

Hope to get good cooperation from hraven-devs on accepting these changes to upstream.

Thanks,

Angad Singh

Senior Software Engineer, InMobi

_____________________________________________________________

The information contained in this communication is intended solely for the use of the individual or entity to whom it is addressed and others authorized to receive it. It may contain confidential or legally privileged information. If you are not the intended recipient you are hereby notified that any disclosure, copying, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. If you have received this communication in error, please notify us immediately by responding to this email and then delete it from your system. The firm is neither liable for the proper and complete transmission of the information contained in this communication nor for any delay in its receipt.

[Vrushali Channapattan]

Hi Angad

This is wonderful to hear! Appreciate your good words about hRaven very much and we are looking forward to your pull requests (I see some have come in as I type).

Thanks

Vrushali 

--
You received this message because you are subscribed to the Google Groups "hraven-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hraven-user...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.