Compute Engine Logs in Cloud Logging: Launch Update

[Deepak Tiwari]

All,

Just wanted to update on this thread that we launched beta availability of Google Cloud Logging for GCE in March.

You can now easily collect, view, analyze, and export your Google Compute Engine and Google App Engine logs. Some highlights of this release:

• You can now ingest Compute Engine application and system (VM) logs into Cloud Logging, including syslog, Apache request logs, and logs from more than two dozen other preconfigured open-source packages.

• The google-fluentd logging agent runs on all the top Linux-based GCE operating systems. A single command installs the agent and all new VM instances include by default the necessary OAuth scopes to ingest logs.

• The Google Cloud Logging API is now publicly accessible, allowing you to ingest logs and configure log export programmatically or through the gcloud CLI in the Cloud SDK.

• Compute Engine Activity logs are now part of Cloud Logging. These logs allow you to track all GCE configuration changes and all GCE API calls.

• All logs are now accessible through Cloud Logging export endpoints.  You can now send their logs to GCS (nearline) for long term archival or to BigQuery for in-depth BI analysis.

• The Logs Viewer refresh brings more search options and quicker access to logs export configurations.

As part of  this launch we also improved our documentation, with more setup options, simpler procedures, and more examples.

We would love for you to try Cloud Logging for GCE and hear your feedback.  We are also happy to set up sessions to demo the product and help you set-up GCE logging.  Please feel free to send your feedback to cloud-logging-feedback@google.com.

Thanks,

Google Compute Engine and Cloud Logging Teams

[pitbred]

Hello.

Is any way for monitoring Cloud DNS queries? 

I mean queries per month by some zone.

We would love for you to try Cloud Logging for GCE and hear your feedback.  We are also happy to set up sessions to demo the product and help you set-up GCE logging.  Please feel free to send your feedback to cloud-loggi...@google.com.

[Ward Harold]

I have a bunch of logs that we ingested prior to setting up exporting to a cloud storage bucket. Is there a way to get the existing logs exported to a file or a bucket?

We would love for you to try Cloud Logging for GCE and hear your feedback.  We are also happy to set up sessions to demo the product and help you set-up GCE logging.  Please feel free to send your feedback to cloud-loggi...@google.com.