Prometheus.service status failed

[Suryaprakash Kancharlapalli]

Hi All,

As i have setup the Prometheus configuration using from the binary. But in the end when i start the service it shows like Prometheus startup service failed. Please find the attached snap for reference. Can some suggest what could be the reason and how can i resolve it.

Thank You,

Surya

[Wesley Peng]

are you running 64bit program on the 32bit OS, or reverse?

regards.

[Suryaprakash Kancharlapalli]

Hi Wesley,

I am using 64bit program on 64 bit OS

 

Thanks & Regards,

Surya Prakash K

Cloud & Devops Engineer

M:+91-91544 63598.

--
You received this message because you are subscribed to the Google Groups "Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-use...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/57ce9c9b-e7c3-5089-d3f2-2004c047c839%40pobox.com.

[Brian Candler]

Can you show the full line which starts "Stopping scrape discovery" ?

journalctl --no-pager -eu prometheus

(Aside: please copy-paste text, don't submit screenshots)

Also, what command-line flags are you passing to prometheus?  Can you paste your prometheus configuration file, and your systemd unit file.

[Suryaprakash Kancharlapalli]

Hi Brian,

Please find the above snap

Thanks & Regards,

Surya Prakash K

Cloud & Devops Engineer

M:+91-91544 63598.

--

You received this message because you are subscribed to the Google Groups "Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-use...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/621f5b8c-16c7-4066-bd23-d6eaabb5eba9o%40googlegroups.com.

[Brian Candler]

Unfortuantely, that doesn't help.

Please provide contents of:

- your systemd unit file (could be /etc/systemd/system/prometheus.service)

- your prometheus configuration file (/etc/prometheus/prometheus.yml)

Please DON'T make any more screenshots.  Use text copy-paste: that is, select the text, and paste it into the message.

[Suryaprakash Kancharlapalli]

Brian,

Here is the text below

[Unit]
Description=Prometheus
Wants=network-online.target
After=network-online.target

[Service]
User=prometheus
Group=prometheus
Type=simple
ExecStart=/usr/local/bin/prometheus \
    --config.file /etc/prometheus/prometheus.yml \
    --storage.tsdb.path /var/lib/prometheus/ \
    --web.console.templates=/etc/prometheus/consoles \
    --web.console.libraries=/etc/prometheus/console_libraries

[Install]
WantedBy=multi-user.target

Thanks & Regards,

Surya Prakash K

Cloud & Devops Engineer

M:+91-91544 63598.

--

You received this message because you are subscribed to the Google Groups "Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-use...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/b385e3c0-0396-46e5-ab14-d3eebbd34b9fo%40googlegroups.com.

[Brian Candler]

That's much easier to read, thank you.

I can't see any problem with the unit file - as long as /var/lib/prometheus is owned by the "prometheus" user.

What about the contents of the configuration file, /etc/prometheus/prometheus.yml ?

[Suryaprakash Kancharlapalli]

Yes,  /var/lib/prometheus is owned by the "prometheus" user. 

And /etc/prometheus/prometheus.yml content is below

global:
  scrape_interval: 10s

scrape_configs:
  - job_name: 'prometheus'
    scrape_interval: 5s
    static_configs:
      - targets: ['localhost:9090']
      - targets: ['localhost:9100']

 

Thanks & Regards,

Surya Prakash K

Cloud & Devops Engineer

M:+91-91544 63598.

--

You received this message because you are subscribed to the Google Groups "Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-use...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/09c005c0-0251-4440-999d-8067869ce894o%40googlegroups.com.

[sayf.eddi...@gmail.com]

Did you try having only one entry of `targets` where you put both addresses in one list ?

[Brian Candler]

That config ought to be fine.

I just noticed that you appear to be running a pretty ancient version of prometheus (2.3.2 - released July 2018).  Is there any reason for running something so old?  I still don't see why it should crash, but very few people are going to have something so old to compare against.

If you really want to debug this old version, the only other thing I can suggest is running it under strace, so that you can see what system calls it makes just before it decides to crash.

[Suryaprakash Kancharlapalli]

No actually I am just following the below article

https://devopscube.com/install-configure-prometheus-linux/

--

You received this message because you are subscribed to the Google Groups "Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-use...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/258aaeec-5d53-4930-bd4e-dffb1f226411o%40googlegroups.com.

[Suryaprakash Kancharlapalli]

Brian, 

strace command you want me to run

[Brian Candler]

The article looks fine, it's just very old.  Replace 2.3.2 with latest version 2.21.0 from https://github.com/prometheus/prometheus/releases

One of the comments says that using multiple targets under a single static_configs section is problematic.  That seems weird, but to rule it out you could try: 

scrape_configs:
  - job_name: 'prometheus'
    scrape_interval: 5s
    static_configs:
      - targets: ['localhost:9090','localhost:9100']

[Suryaprakash Kancharlapalli]

Thank you Brian, version 2.21 worked for me

--

You received this message because you are subscribed to the Google Groups "Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-use...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/bee4449a-9457-4296-b898-8f7dc950c61eo%40googlegroups.com.