Metrics and Logs into Splunk

93 views
Skip to first unread message

Sam Trapp

unread,
Oct 13, 2014, 1:41:01 PM10/13/14
to cdap...@googlegroups.com
We use splunk for all of our log and metrics aggregation. Is there a easy way to pull all the logs and metrics and feed it to splunk. I see that cdap provides rest apis to pull metrics and logs for mr and spark jobs I run in cdap. Is there an easier way to integrate splunk or I have to write something to do that. Help here would be much appreciated.

Cheers,
Sam

Alex Baranau

unread,
Oct 14, 2014, 2:14:22 PM10/14/14
to Sam Trapp, cdap...@googlegroups.com
Hi Sam,

As of now, the REST API is the only way to pull metrics and logs out. We definitely want to have pluggable mechanism to push metrics & logs to external systems.

Could you please file a JIRA specifically for Splunk? To me it makes sense to support it out of the box.

Thank you,
Sasha

--
You received this message because you are subscribed to the Google Groups "CDAP User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cdap-user+...@googlegroups.com.
To post to this group, send email to cdap...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/1413221893.55626.YahooMailIosMobile%40web122204.mail.ne1.yahoo.com.
For more options, visit https://groups.google.com/d/optout.

Nitin Motgi

unread,
Oct 14, 2014, 2:39:58 PM10/14/14
to Alex Baranau, Sam Trapp, cdap...@googlegroups.com
Hi Sam, 

Splunk already provides a way to get data from REST API. Following is the link to how it can done

Nitin



Sam Trapp

unread,
Oct 15, 2014, 12:36:25 AM10/15/14
to ni...@cask.co, al...@cask.co, cdap...@googlegroups.com
Thanks alex and nitin. The splunk rest solution might work for us. Will give it a try.

Cheers,
Sam


From: Nitin Motgi <ni...@cask.co>;
To: Alex Baranau <al...@cask.co>;
Cc: Sam Trapp <samtr...@yahoo.com>; cdap...@googlegroups.com <cdap...@googlegroups.com>;
Subject: Re: Metrics and Logs into Splunk
Sent: Tue, Oct 14, 2014 6:39:58 PM

Reply all
Reply to author
Forward
0 new messages