I'm working on Marley
, which is a framework for multi-agent reinforcement learning that I'll use for my research.
I recently added logging, and I'm logging interesting events from various different modules. Right now the logs are simply written to a text file that looks like this
. I've got multiple threads and multiple processes writing to the same log file.
At some point I'm going to have to use a better log architecture. The multiline entries are ugly, it's difficult to filter log entries, etc. I'm guessing that a better architecture would involve the log entries being JSON objects which will be read by a program that's more intelligent than a text editor, and that allows the user to filter and do other fancy things. Of course, I dread having to look at JSON logs in a text editor.
Can you guys recommend a good solution for log management?
I'm hoping for something that isn't a SaaS. I want to use it locally.