Prometheus startup time

[Sandip Bhattacharya]

Anyone has an idea what happens in those three minutes between when prometheus reads all of WAL and when it reads the config file and starts up.

level=info ts=2022-08-19T14:51:12.433Z caller=head.go:893 component=tsdb msg="WAL segment loaded" segment=49504 maxSegment=49504
level=info ts=2022-08-19T14:51:12.433Z caller=head.go:899 component=tsdb msg="WAL replay completed" checkpoint_replay_duration=8m41.037222785s wal_replay_duration=14m11.107776199s total_replay_duration=23m51.009216893s
level=info ts=2022-08-19T14:54:37.497Z caller=main.go:839 fs_type=EXT4_SUPER_MAGIC
level=info ts=2022-08-19T14:54:37.498Z caller=main.go:842 msg="TSDB started"
level=info ts=2022-08-19T14:54:37.498Z caller=main.go:969 msg="Loading configuration file" filename=/etc/prometheus-shared/prometheus.yml

[Ben Kochie]

You can usually see more detail if you enable `--log.level=debug`.

We run our instances with https://prometheus.io/docs/prometheus/latest/feature_flags/#memory-snapshot-on-shutdown in order to reduce startup time for larger instances.

--
You received this message because you are subscribed to the Google Groups "Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-use...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/ae4d4e7e-a83c-44c6-b421-f3d75bf39dden%40googlegroups.com.