Regarding the Fluentd google_cloud plugin to send logs to stackdriver.

263 views
Skip to first unread message

Charith Dilshan

unread,
Sep 5, 2019, 9:51:10 PM9/5/19
to Google Stackdriver Discussion Forum
Hi,
I have used fluetnd out_file and cloudwatch plugins to output my log lines to log files, Now I want to send the output to stackdriver. I tried the official documentation for that. But a lot of configuration parameters are missing . For example in cloudwatch_logs we can authenticate easily by using aws_key_id and aws_sec_key. Instead here we have to use a private key file. But I don't know where to specify(parameter) it in the configuration file.
Also in cloudwatch I can send the one field that has data by using message_keys msg. I also used log_group_name and log_stream_name with ${key} to accommodate as variables.
Can I use buffer to specify chunks in this plugin with fields in the json object(custom keys)?
Is stack-driver plugin is capable in something simillar to these?
Also can anyone share a example configuration of stack-driver in using for logging!
I am not using specifically google fluentd but fluentd. I have installed the required gem.
Any help is highly appreciated!
Thanks!

Igor Peshansky

unread,
Sep 5, 2019, 10:05:21 PM9/5/19
to Charith Dilshan, Google Stackdriver Discussion Forum
Hi, Charith,

The instructions for using the Stackdriver logging agent are at https://cloud.google.com/logging/docs/agent. These include both installation and configuration.

We do not support using the gem separately, without installing the full package. This is because the package comes with all of the necessary dependencies, as well as a default configuration that is tuned to maximize logging ingestion performance for the common cases. This configuration should work out of the box on GCE and AWS, and is the example configuration you've asked for.
See https://cloud.google.com/logging/docs/agent/authorization for instructions on using private keys with the agent.

It's possible to configure the output plugin to convert certain payload fields into Stackdriver logging labels, which can be used for grouping and filtering. See https://cloud.google.com/logging/docs/agent/configuration#label-setup.

Hope this helps.
        Igor
-- sent from a mobile device, please excuse tyops and omissns

--
© 2016 Google Inc. 1600 Amphitheatre Parkway, Mountain View, CA 94043
 
Email preferences: You received this email because you signed up for the Google Stackdriver Discussion Google Group (google-stackdr...@googlegroups.com) to participate in discussions with other members of the GoogleStackdriver community.
---
You received this message because you are subscribed to the Google Groups "Google Stackdriver Discussion Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-stackdriver-d...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-stackdriver-discussion/138d7b84-878b-4d13-9886-da34bef8c206%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages