spark cluster loggin

[ilya.anisimov]

How can I write into interpreter log which in my case can be found over here https://api.qubole.com/spark-notebook-11690/logs/zeppelin-interpreter-spark--Ilya-ip-172-31-42-51.log?

[Mayank Ahuja]

Hello,

To understand the requirement, are you looking for access to the interpreter log file in S3 or within the cluster?

Thanks

Mayank

On Tue, May 17, 2016 at 4:37 PM, ilya.anisimov <ilya.a...@thomsonreuters.com> wrote:

How can I write into interpreter log which in my case can be found over here https://api.qubole.com/spark-notebook-11690/logs/zeppelin-interpreter-spark--Ilya-ip-172-31-42-51.log?

--
You received this message because you are subscribed to the Google Groups "Qubole Public Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to qubole-users...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/qubole-users/573bab471b2e0_284c2b229afea924464fc%40ip-10-69-176-81.mail.
For more options, visit https://groups.google.com/d/optout.

[Bharath Bhushan]

The spark interpreter log file is basically the spark driver's logs. If you want to add more logging messages into the driver logs you can use the spark logging classes and use any of the logInfo/logError/log* methods. Or you can use logging apis like slf4j. Or you can just write to stderr.

To view this discussion on the web visit https://groups.google.com/d/msgid/qubole-users/CANpESM5k2zWtuw95p4dfj8bmO_hJwtTa4wPdPy%2BzHe8%3Dv88OZw%40mail.gmail.com.

For more options, visit https://groups.google.com/d/optout.

--

Bharath (ಭರತ್)