Spark application id fetching issue

[AnilKumar B]

Hi,

My spark applications are not reflecting in Dr Elephant. I followed https://github.com/linkedin/dr-elephant/issues/77 issue and resolved multiple intermediate issues, but now stuck with below issue.

The issue is when I submit spark job, the application id is  http://MTVL140e6a9fb.local/proxy/application_1498847865371_0013/ but in HDFS the corresponding event log is created with application_1498847865371_0013_1, but Dr elephant is looking for application_1498847865371_0013. 

Is it a known issue? 

Thanks,

B Anil Kumar.

[AnilKumar B]

After going through multiple PR's. Finally able to resolve issues. Based on my experience with Dr elephant, created doc for end to end set up.

If you guys thinks, this is useful for the community, then will create a blog.

[Akshay Rai]

Hi Anil,

Awesome work. Thank you for creating this document detailing all the issues you faced and how you resolved them. This will be very helpful to the community.

Regards,

Akshay

[AnilKumar B]

Thanks a lot Akshay. Dr elephant is Awesome. 

--
You received this message because you are subscribed to a topic in the Google Groups "dr-elephant-users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/dr-elephant-users/pVWbtHWvP5I/unsubscribe.
To unsubscribe from this group and all its topics, send an email to dr-elephant-us...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/dr-elephant-users/79aa138a-145e-435a-8820-48f34303f6a8%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Thanks & Regards,
B Anil Kumar.