Suggest an open-source log analyser?

[Alec Taylor]

I use the Python logger class; with the example syntax of:
Formatter('%(asctime)s - %(name)s - %(levelname)s - %(message)s')

Can of course easily use e.g.: a JSON syntax here instead.

Are there any open-source log viewers (e.g.: with a web-interface)
that you'd recommend; for drilling down into my logs?

Thanks for your suggestions,

Alec Taylor

[Roy Smith]

In article <mailman.4787.1388641...@python.org>,

I've been experimenting with elasticsearch (to store JSON-format log
messages) and kibana (as a front-end search tool). The jury is still
out on how well it's going to work. It seems like a pretty powerful
combination, but there's definitely a bit of a learning curve to using
it.

I certainly like the idea of logging structured data, as opposed to
plain text. It opens up a world of better ways to search, slice, and
dice your log data.

[Alec Taylor]

Web interface (and/or SQL-like query interface); is useful for
drilling down and rolling up multiparametric analyses.

Currently looking at logstash, kibana, graylog2 and a few others.
Might end up writing my own to escape the Java dependency.

Would welcome further suggestions.

On Fri, Jan 3, 2014 at 1:13 AM, William Ray Wing <w...@mac.com> wrote:

> On Jan 2, 2014, at 12:40 AM, Alec Taylor <alec.t...@gmail.com> wrote:
>
>> I use the Python logger class; with the example syntax of:
>> Formatter('%(asctime)s - %(name)s - %(levelname)s - %(message)s')
>>
>> Can of course easily use e.g.: a JSON syntax here instead.
>>
>> Are there any open-source log viewers (e.g.: with a web-interface)
>> that you'd recommend; for drilling down into my logs?
>>
>> Thanks for your suggestions,
>>
>> Alec Taylor

>> --
>> https://mail.python.org/mailman/listinfo/python-list
>
> Why web interface? That's a ton of overhead just to look at a text file.
> If you are on UNIX or Linux, I'd just use my favorite editor (or possibly View, which is vi in read-only mode, or More or Less).
> If you give them the extension .log you can use whatever app you use to look at console logs.
>
> -Bill

[Walter Hurry]

On Thu, 02 Jan 2014 16:40:19 +1100, Alec Taylor wrote:

> I use the Python logger class; with the example syntax of:
> Formatter('%(asctime)s - %(name)s - %(levelname)s - %(message)s')
>
> Can of course easily use e.g.: a JSON syntax here instead.
>
> Are there any open-source log viewers (e.g.: with a web-interface)
> that you'd recommend; for drilling down into my logs?
>

If you want to do in-depth analysis, why not just stick it into an SQL
database; e.g. SQLite or Postgres?

[Alec Taylor]

Because I'm thinking that something with a much less expressive query
interface would serve me better in the long run... e.g.: Redis or
maybe Hadoop

> --
> https://mail.python.org/mailman/listinfo/python-list

[Alec Taylor]

So yeah, if you know of a good one; please share.

Thanks

On Sun, Jan 5, 2014 at 2:50 PM, Alec Taylor <alec.t...@gmail.com> wrote:
> Because I'm thinking that something with a much less expressive query
> interface would serve me better in the long run... e.g.: Redis or
> maybe Hadoop
>
> On Sat, Jan 4, 2014 at 5:35 PM, Walter Hurry <walte...@lavabit.com> wrote:

>> --
>> https://mail.python.org/mailman/listinfo/python-list