Spark application logs
503 views
Skip to first unread message
Zeel Patel
May 9, 2024, 12:53:34 PMMay 9
to wg-batch
Hi folks,
What is the general production level practice to see batch job logs on some UI. Generally batch job logs tend to be of huge size and kubectl logs is not very efficient. What do folks do to collect and see pod logs. Downloading the entire pod log file in machine does not seem to be a very good idea. We want a solution with which we can tail pod logs or query pod logs with some offset.
Thanks.
What is the general production level practice to see batch job logs on some UI. Generally batch job logs tend to be of huge size and kubectl logs is not very efficient. What do folks do to collect and see pod logs. Downloading the entire pod log file in machine does not seem to be a very good idea. We want a solution with which we can tail pod logs or query pod logs with some offset.
Thanks.
Reply all
Reply to author
Forward
0 new messages