Prometheus won't start after cleaning up WAL segments

115 views
Skip to first unread message

Nurzhamal Eshimbekova

unread,
Mar 9, 2022, 3:37:42 AM3/9/22
to Prometheus Users
Hello. i have an issue with restarting prometheus. It won't come back up after I've manually cleaned up segments in WAL directory. The error I have is:

ts=2022-03-08T18:43:56.509Z caller=main.go:932 level=error err="opening storage failed: repair corrupted WAL: cannot handle error: open WAL segment: 29524: open /data/wal/00029524: no such file or directory"

I have a backup of the files, but can't copy over, since container is not ready. 
Running prometheus on k8s, deploying with helm

Any suggestions are appreciated
Thanks
Reply all
Reply to author
Forward
0 new messages