spark logs are not captured by Dr elephant

[ketanm k]

hello all

Please assist me in this issue.

I have set up Dr elephant and can see all the MR jobs but unable to see spark jobs.

this is the error message i see in the logs - 

07-25-2018 07:35:27 INFO  [ForkJoinPool-3-worker-13] com.linkedin.drelephant.spark.fetchers.SparkRestClient : calling REST API at http://itsusraedld01.com:18488/api/v1/applications/application_1532278950996_2287

07-25-2018 07:35:27 ERROR [ForkJoinPool-3-worker-13] com.linkedin.drelephant.spark.fetchers.SparkRestClient : error reading applicationInfo http://itsusraedld01.com:18488/api/v1/applications/application_1532278950996_2287

javax.ws.rs.ProcessingException: java.net.SocketException: Unexpected end of file from server

        at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:287)

        at org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:252)

        at org.glassfish.jersey.client.JerseyInvocation$2.call(JerseyInvocation.java:701)

        at org.glassfish.jersey.internal.Errors.process(Errors.java:315)

        at org.glassfish.jersey.internal.Errors.process(Errors.java:297)

        at org.glassfish.jersey.internal.Errors.process(Errors.java:228)

        at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:444)

        at org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:697)

        at org.glassfish.jersey.client.JerseyInvocation$Builder.method(JerseyInvocation.java:420)

        at org.glassfish.jersey.client.JerseyInvocation$Builder.get(JerseyInvocation.java:316)

        at com.linkedin.drelephant.spark.fetchers.SparkRestClient$.get(SparkRestClient.scala:243)

        at com.linkedin.drelephant.spark.fetchers.SparkRestClient.getApplicationInfo(SparkRestClient.scala:134)

        at com.linkedin.drelephant.spark.fetchers.SparkRestClient.getApplicationMetaData(SparkRestClient.scala:123)

        at com.linkedin.drelephant.spark.fetchers.SparkRestClient.fetchEventLogAndParse(SparkRestClient.scala:104)

        at com.linkedin.drelephant.spark.fetchers.SparkFetcher$$anonfun$com$linkedin$drelephant$spark$fetchers$SparkFetcher$$doFetchSparkApplicationData$1.apply(SparkFetcher.scala:106)

        at com.linkedin.drelephant.spark.fetchers.SparkFetcher$$anonfun$com$linkedin$drelephant$spark$fetchers$SparkFetcher$$doFetchSparkApplicationData$1.apply(SparkFetcher.scala:106)

        at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)

        at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)

        at scala.concurrent.impl.ExecutionContextImpl$$anon$3.exec(ExecutionContextImpl.scala:107)

        at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)

        at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)

        at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)

        at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

Caused by: java.net.SocketException: Unexpected end of file from server

        at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:792)

        at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:647)

        at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:789)

        at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:647)

        at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1536)

        at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441)

        at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480)

        at org.glassfish.jersey.client.internal.HttpUrlConnector._apply(HttpUrlConnector.java:394)

        at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:285)

        ... 22 more

Any idea whats missing in my configuration.

thanks in advance.