Kibana Logstash frontend

2,187 views
Skip to first unread message

Jens Braeuer

unread,
Mar 27, 2012, 10:41:05 AM3/27/12
to devops-t...@googlegroups.com
Hi everyone,

I wonder who of you is using Kibana
(https://github.com/rashidkpc/Kibana) and what are your experiences with
it so far. How do the features compare to the built-in webinterface of
logstash?

Thanks,
Jens

Joe Miller

unread,
Mar 27, 2012, 10:58:17 AM3/27/12
to devops-t...@googlegroups.com
Any screenshots available of Kibana?

Jeremiah Shirk

unread,
Mar 27, 2012, 11:04:52 AM3/27/12
to devops-t...@googlegroups.com

-- 
Jeremiah Shirk

Matt Moor

unread,
Mar 27, 2012, 10:05:20 PM3/27/12
to devops-toolchain
We're using it, and are pretty happy so far. We have 320M messages in
ElasticSearch, increasing at a rate of about 250/s and it's pretty
responsive (this probably comes down to scaling ES). UI is definitely
a lot easier than logstash-web, though there are a few quirks (the
time-range filter only operates on the set returned by the search,
which also has a time filter... easy to forget and wonder why you're
not showing any messages!)

Early days for us, though - we're certainly not splitting on fields as
much as we should be, so our searches tend to be quite broad and not
take advantage of browsing and filtering results by field.

Cheers,

Matt

JaimeGago

unread,
Mar 28, 2012, 12:23:03 AM3/28/12
to devops-t...@googlegroups.com
Matt,
Any reason you went for Kibana? I'm currently looking at Logstash and it seems many folks prefer the graylog2 web UI with which logstash supposedly integrates easily.

J.

Dick Davies

unread,
Mar 28, 2012, 7:49:39 AM3/28/12
to devops-t...@googlegroups.com
Graylog2 is a bit heavyweight. Also: mongodb <shudder/>.

Matt Moor

unread,
Mar 28, 2012, 7:00:39 PM3/28/12
to devops-toolchain
Hi Jaime,

We did a lot of scalability testing around the ES backend (we're
expecting to increase our log throughput by at least an order of
magnitude in the near future), and wanted to stay as close to that as
possible. Early research left us pretty skeptical as to how graylog2
(well, mongoDB) would cope with the volume we expect.

Cheers,

Matt

Dick Davies

unread,
Mar 29, 2012, 6:04:57 AM3/29/12
to devops-t...@googlegroups.com
In fairness they're not using the mongo instance for storing
the messages any more, but unfortunately all user settings, accounts,
streams, and other essential bits of the Graylog UI are still in there.

It's not so much a throughput issue as a 'oh god am I going
to have to recover all this every time the box reboots' one :)

Reply all
Reply to author
Forward
0 new messages