StackDriver-How to create alert for instance up/down

[cvg.h...@gmail.com]

Hi,

I am using Stack Driver (Not Premier just basic Account) to and want to create an alert based on whether a GCE instance (Linux) is up or down.

Metric is available in the Metrics Explorer but not available in the metrics drop down section while creating Alert policy.

Is this option only available in Stack Driver Premier Account? If not please suggest how can I create alert for an instance up/down.

Thanks in advance.

[Yuri Grinshteyn]

I don't know if this is the officially recommended approach, but you could use Metric Absence for any metric that should be always collected, like this:

--
© 2016 Google Inc. 1600 Amphitheatre Parkway, Mountain View, CA 94043
 
Email preferences: You received this email because you signed up for the Google Stackdriver Discussion Google Group (google-stackdr...@googlegroups.com) to participate in discussions with other members of the GoogleStackdriver community.
---
You received this message because you are subscribed to the Google Groups "Google Stackdriver Discussion Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-stackdriver-d...@googlegroups.com.
To post to this group, send email to google-stackdr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-stackdriver-discussion/84bbb457-3f7e-4096-92e9-9e734af12918%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

• Yuri "The Grinch" Grinshteyn • Google Cloud Customer Engineer • theg...@google.com • This week in GCP

[Harith J]

Thanks Yuri. I think this will serve the purpose. Get back to you with the update

On Wed, Aug 22, 2018 at 10:04 AM, Yuri Grinshteyn <theg...@google.com> wrote:

I don't know if this is the officially recommended approach, but you could use Metric Absence for any metric that should be always collected, like this:

On Wed, Aug 22, 2018 at 9:52 AM <cvg.h...@gmail.com> wrote:

Hi,

I am using Stack Driver (Not Premier just basic Account) to and want to create an alert based on whether a GCE instance (Linux) is up or down.

Metric is available in the Metrics Explorer but not available in the metrics drop down section while creating Alert policy.

Is this option only available in Stack Driver Premier Account? If not please suggest how can I create alert for an instance up/down.

Thanks in advance.

--
© 2016 Google Inc. 1600 Amphitheatre Parkway, Mountain View, CA 94043
 

Email preferences: You received this email because you signed up for the Google Stackdriver Discussion Google Group (google-stackdriver-discu...@googlegroups.com) to participate in discussions with other members of the GoogleStackdriver community.

---
You received this message because you are subscribed to the Google Groups "Google Stackdriver Discussion Forum" group.

To unsubscribe from this group and stop receiving emails from it, send an email to google-stackdriver-discussion+unsub...@googlegroups.com.
To post to this group, send email to google-stackdriver-discussion@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/google-stackdriver-discussion/84bbb457-3f7e-4096-92e9-9e734af12918%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Harith J]

Is there any option to create the alert on immediate shut down of the instance? Because the minimum monitoring time of the metric absence time 5 minutes which is more.

Few more questions:

1) what exactly uptime metric will do?

2) can we create our own custom metric for node up/down? If so can it be available for alerting/policies? 

On Wed, Aug 22, 2018 at 11:37 PM, Harith J <cvg.h...@gmail.com> wrote:

Thanks Yuri. I think this will serve the purpose. Get back to you with the update

On Wed, Aug 22, 2018 at 10:04 AM, Yuri Grinshteyn <theg...@google.com> wrote:

I don't know if this is the officially recommended approach, but you could use Metric Absence for any metric that should be always collected, like this:

On Wed, Aug 22, 2018 at 9:52 AM <cvg.h...@gmail.com> wrote:

Hi,

I am using Stack Driver (Not Premier just basic Account) to and want to create an alert based on whether a GCE instance (Linux) is up or down.

Metric is available in the Metrics Explorer but not available in the metrics drop down section while creating Alert policy.

Is this option only available in Stack Driver Premier Account? If not please suggest how can I create alert for an instance up/down.

Thanks in advance.

--
© 2016 Google Inc. 1600 Amphitheatre Parkway, Mountain View, CA 94043
 

Email preferences: You received this email because you signed up for the Google Stackdriver Discussion Google Group (google-stackdriver-discussion@googlegroups.com) to participate in discussions with other members of the GoogleStackdriver community.

---
You received this message because you are subscribed to the Google Groups "Google Stackdriver Discussion Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-stackdriver-discussion+unsub...@googlegroups.com.
To post to this group, send email to google-stackdriver-discussion@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-stackdriver-discussion/84bbb457-3f7e-4096-92e9-9e734af12918%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Harith J]

Metric Absence is not working..

[Yuri Grinshteyn]

Is there any option to create the alert on immediate shut down of the instance? Because the minimum monitoring time of the metric absence time 5 minutes which is more.

- Yes - you could use a log-based metric instead, using the log entry about the VM shutdown as the data source.

1) what exactly uptime metric will do? 

The metrics are defined here: https://cloud.google.com/monitoring/api/metrics_gcp#gcp-compute

2) can we create our own custom metric for node up/down? If so can it be available for alerting/policies? 

Yes - see the Monitoring API documentation for how to create custom metrics and send them to the API. - https://cloud.google.com/monitoring/custom-metrics/creating-metrics

Metric Absence is not working..

- can you provide more information? You may need to work with support to do actual troubleshooting, as that'll be difficult over email.

On Thu, Aug 23, 2018 at 12:16 AM Harith J <cvg.h...@gmail.com> wrote:

Metric Absence is not working..

On Wed, Aug 22, 2018 at 11:45 PM, Harith J <cvg.h...@gmail.com> wrote:

Is there any option to create the alert on immediate shut down of the instance? Because the minimum monitoring time of the metric absence time 5 minutes which is more.

Few more questions:

1) what exactly uptime metric will do?

2) can we create our own custom metric for node up/down? If so can it be available for alerting/policies? 

On Wed, Aug 22, 2018 at 11:37 PM, Harith J <cvg.h...@gmail.com> wrote:

Thanks Yuri. I think this will serve the purpose. Get back to you with the update

On Wed, Aug 22, 2018 at 10:04 AM, Yuri Grinshteyn <theg...@google.com> wrote:

I don't know if this is the officially recommended approach, but you could use Metric Absence for any metric that should be always collected, like this:

On Wed, Aug 22, 2018 at 9:52 AM <cvg.h...@gmail.com> wrote:

Hi,

I am using Stack Driver (Not Premier just basic Account) to and want to create an alert based on whether a GCE instance (Linux) is up or down.

Metric is available in the Metrics Explorer but not available in the metrics drop down section while creating Alert policy.

Is this option only available in Stack Driver Premier Account? If not please suggest how can I create alert for an instance up/down.

Thanks in advance.

--
© 2016 Google Inc. 1600 Amphitheatre Parkway, Mountain View, CA 94043
 

Email preferences: You received this email because you signed up for the Google Stackdriver Discussion Google Group (google-stackdr...@googlegroups.com) to participate in discussions with other members of the GoogleStackdriver community.

---
You received this message because you are subscribed to the Google Groups "Google Stackdriver Discussion Forum" group.

To unsubscribe from this group and stop receiving emails from it, send an email to google-stackdriver-d...@googlegroups.com.
To post to this group, send email to google-stackdr...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/google-stackdriver-discussion/84bbb457-3f7e-4096-92e9-9e734af12918%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

• Yuri "The Grinch" Grinshteyn • Google Cloud Customer Engineer • theg...@google.com • This week in GCP

[shree]

Hi,

I am also facing same issue, i am unable to frame the query to create alerting using stackdriver api. i am totally confusing. please help me on the same. 

Email preferences: You received this email because you signed up for the Google Stackdriver Discussion Google Group (google-stackdriver-discu...@googlegroups.com) to participate in discussions with other members of the GoogleStackdriver community.

---
You received this message because you are subscribed to the Google Groups "Google Stackdriver Discussion Forum" group.

To unsubscribe from this group and stop receiving emails from it, send an email to google-stackdriver-discussion+unsub...@googlegroups.com.

To post to this group, send email to google-stackdr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-stackdriver-discussion/84bbb457-3f7e-4096-92e9-9e734af12918%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

• Yuri "The Grinch" Grinshteyn • Google Cloud Customer Engineer • theg...@google.com • This week in GCP

[Yuri Grinshteyn]

Hi, Shree - can you please create a separate thread in this forum describing what you're trying to do, what you've done so far, and where you're encountering issues?

Thank you,

Yuri

Hi,

Email preferences: You received this email because you signed up for the Google Stackdriver Discussion Google Group (google-stackdr...@googlegroups.com) to participate in discussions with other members of the GoogleStackdriver community.

---
You received this message because you are subscribed to the Google Groups "Google Stackdriver Discussion Forum" group.

To unsubscribe from this group and stop receiving emails from it, send an email to google-stackdriver-d...@googlegroups.com.

To post to this group, send email to google-stackdr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-stackdriver-discussion/84bbb457-3f7e-4096-92e9-9e734af12918%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

• Yuri "The Grinch" Grinshteyn • Google Cloud Customer Engineer • theg...@google.com • This week in GCP

--

• Yuri "The Grinch" Grinshteyn • Google Cloud Customer Engineer • theg...@google.com • This week in GCP

--

© 2016 Google Inc. 1600 Amphitheatre Parkway, Mountain View, CA 94043
 

Email preferences: You received this email because you signed up for the Google Stackdriver Discussion Google Group (google-stackdr...@googlegroups.com) to participate in discussions with other members of the GoogleStackdriver community.

---
You received this message because you are subscribed to the Google Groups "Google Stackdriver Discussion Forum" group.

To unsubscribe from this group and stop receiving emails from it, send an email to google-stackdriver-d...@googlegroups.com.

To post to this group, send email to google-stackdr...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/google-stackdriver-discussion/cdfbcff1-5679-4112-a239-06482abf5e6f%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

[Michael Safyan]

On Wed, Aug 22, 2018 at 12:52 PM <cvg.h...@gmail.com> wrote:

Hi,

I am using Stack Driver (Not Premier just basic Account) to and want to create an alert based on whether a GCE instance (Linux) is up or down.

Can you define what you mean by "up"? In particular, there are two different cases that I think are important to distinguish:

• Given that the instance is in the RUNNING state, detect that the instance is behaving improperly/incorrectly (but don't alert if deliberately paused/stopped).
• Detect that the instance is in the PAUSED or STOPPED states (rather than in the RUNNING state).

 

Metric is available in the Metrics Explorer but not available in the metrics drop down section while creating Alert policy.

Which metric?

 

Is this option only available in Stack Driver Premier Account? If not please suggest how can I create alert for an instance up/down.

There shouldn't be any distinction between Basic and Premium tiers at this point, anymore (see: Stackdriver tiers).

[Michael Safyan]

Quick note with regard to this strategy (of using metric absence); there is an important difference in behavior between "Single", "All", and "Group"....

For "All" and "Group", instances that are in the "PAUSED" or "STOPPED" state will be excluded (so as to not cause false positive alerts, especially when used with managed instance groups, autoscaling, etc.). So the "All"/"Group" strategy cannot detect the RUNNING->{PAUSED,STOPPED} transition if that is what you are trying to detect (it can, however, detect if the instance is nominally running but software on the VM is somehow stuck/non-functioning). If you use "Single", however, since you list a specific instance we assume that you want that specific instance to always be checked and don't filter it out (even if it is in the PAUSED/STOPPED state).

Related to this, you may also want to check out Preventing Accidental VM Deletion.

Michael Safyan Senior Software Engineer · Stackdriver Monitoring 6425 Penn Ave 7th Floor; Pittsburgh, PA 15206 http://www.michaelsafyan.com | michae...@google.com

To view this discussion on the web visit https://groups.google.com/d/msgid/google-stackdriver-discussion/CAOx6fK__3fpPmDL-fiP04vtYqLKediDHjZkbGDGnXCzEPT6vLQ%40mail.gmail.com.