NXLOG JSON Output to FluentD

550 views
Skip to first unread message

Kyle

unread,
Nov 25, 2014, 8:50:32 AM11/25/14
to flu...@googlegroups.com
Has anyone had any success in outputting JSON format via NXLOG to FluentD successfully?

It really seems to be hit or miss for me and most of the time in the NXLOG I will get an error: ERROR HTTP response status is not OK: 400 Bad Request

My ultimate goal is to natively export JSON format to FluentD. If there are other more stable agents that someone could recommend that work and will allow tailing files and sending that via JSON as well, would really appreciate the information.

If anyone has a working config or can point me in the right direction, would greatly appreciate it.

Thank you,

Kyle

Kiyoto Tamura

unread,
Nov 25, 2014, 11:41:45 AM11/25/14
to flu...@googlegroups.com
Hi Kyle

What's your input on Windows? If it is Fluentd's protocol over TCP (as in, using fluent-logger), then you might want to look at github.com/fluent/fluentd-forwarder

If not, still let me know what it is, and we can think of a workaround.

--
You received this message because you are subscribed to the Google Groups "Fluentd Google Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to fluentd+u...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.



--
Check out Fluentd, the open source data collector to unify log management.

Kyle Kniffin

unread,
Nov 25, 2014, 7:30:40 PM11/25/14
to flu...@googlegroups.com
On the Windows Servers my input is the Built-in eventlog and some DHCP/IIS Log Files.

I tried using something similar to the following config at the URL but that is where it only works hit/miss. Mainly I get the ERROR HTTP response status is not OK: 400




--
You received this message because you are subscribed to a topic in the Google Groups "Fluentd Google Group" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/fluentd/3LRxDYqHNi8/unsubscribe.
To unsubscribe from this group and all its topics, send an email to fluentd+u...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.



--
Thanks,

Kyle Kniffin
ky...@kniffins.com

Kiyoto Tamura

unread,
Nov 25, 2014, 7:43:40 PM11/25/14
to flu...@googlegroups.com
Kyle-

I see. You can also try running the Windows branch of Fluentd itself: https://github.com/fluent/fluentd/tree/windows

Beware that the Windows branch is highly experimental, and it tends to lag several months in terms of merging changes from the master.

Kyle Kniffin

unread,
Nov 25, 2014, 8:00:02 PM11/25/14
to flu...@googlegroups.com
Is there any options of getting nxlog to work with Fluentd over JSON properly as in the link I sent in my last email?

NXLog seems to be the most widely used for transporting windows logs.

Mr. Fiber

unread,
Nov 26, 2014, 7:46:17 PM11/26/14
to flu...@googlegroups.com
This is not my nxlog configuration but
one Fluentd user uses NXLOG and in_http with following configuration.


Sebastian Krohn

unread,
Nov 29, 2014, 4:31:48 PM11/29/14
to flu...@googlegroups.com

On Thursday, November 27, 2014 1:46:17 AM UTC+1, repeatedly wrote:
This is not my nxlog configuration but
one Fluentd user uses NXLOG and in_http with following configuration.

 
I based my config on that but ran into the same issues as Kyle. I got it to work after adding more substitutions to do some crude url encoding:



The fluentd side of things is a normal in_http:

<source>
  type http
  port 8888
</source>


Cheers,

   Sebastian

Kyle Kniffin

unread,
Dec 2, 2014, 6:28:34 AM12/2/14
to flu...@googlegroups.com

Thanks, I will try that out.

Kyle Kniffin

unread,
Dec 4, 2014, 4:30:24 PM12/4/14
to flu...@googlegroups.com
Sebastian,

What version of fluentd are you running? Still getting http 400 bad request when using your config as well.
Reply all
Reply to author
Forward
0 new messages