Hello. i have an issue with restarting prometheus. It won't come back up after I've manually cleaned up segments in WAL directory. The error I have is:
ts=2022-03-08T18:43:56.509Z caller=main.go:932 level=error err="opening storage failed: repair corrupted WAL: cannot handle error: open WAL segment: 29524: open /data/wal/00029524: no such file or directory"
I have a backup of the files, but can't copy over, since container is not ready.
Running prometheus on k8s, deploying with helm
Any suggestions are appreciated
Thanks