Is there any data loss when we upgrade from 2.1.0 to 2.18.0?

42 views
Skip to first unread message

Nandeesh Bharamagoudra

unread,
May 31, 2020, 3:51:31 AM5/31/20
to Prometheus Users

Hi Team,


Need a quick info, we are going to upgrade Prometheus in production from v2.1.0 to v2.18.0.

So is there any data loss of TSDB? ,once we upgrade ?
Path is : /prometheus/data

volume type: PVC --aws ebs volume.


Please guide us here.

Christian Hoffmann

unread,
Jun 1, 2020, 4:19:22 AM6/1/20
to Nandeesh Bharamagoudra, Prometheus Users
Hi,

On 5/31/20 9:51 AM, 'Nandeesh Bharamagoudra' via Prometheus Users wrote:
> Need a quick info, we are going to upgrade Prometheus in production from
> v2.1.0 to v2.18.0.

My gut feeling says: It should work.

However, I am pretty sure that there is at least one (if not more)
change which is forward-only. This means: Once you have upgraded, you
will not be able to go back without data loss. For example, 2.4.0
updates the WAL format. After it has been updated, older versions will
no longer be able to read it.

To be more confident, I suggest the following:

1) Read the changelogs of all versions in-between. There should be
disclaimers for such changes:
https://github.com/prometheus/prometheus/releases

2) Perform your update in your staging environment first in order to
obsevere if anything happens unexpectedly.

3) Create a consistent backup (Prometheus snapshot) of your data before
upgrading.

4) For the future: Try updating more regularly. This is what most users
do and which probably reserved way more real-world test coverage. While
the update you are planning may be expected to work, it could well be
that almost no one has performed such a large jump yet. Your version is
over two years old. This is a long time for any actively developed
software project.


Kind regards,
Christian

Julien Pivotto

unread,
Jun 1, 2020, 4:31:35 AM6/1/20
to Christian Hoffmann, Nandeesh Bharamagoudra, Prometheus Users
To "snapshot" you will have to shut down Prometheus and backup the data.

Snapshot feature was added later in the 2.x release.

--
You received this message because you are subscribed to the Google Groups "Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-use...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/29297589-d553-c754-fd4a-b1ccdd7eee7c%40hoffmann-christian.info.

Nandeesh B

unread,
Jun 1, 2020, 8:50:28 AM6/1/20
to Prometheus Users
If you suggest here ,which version I can go with . Would be much help.
To unsubscribe from this group and stop receiving emails from it, send an email to promethe...@googlegroups.com.

Julien Pivotto

unread,
Jun 1, 2020, 9:17:11 AM6/1/20
to Nandeesh B, Prometheus Users
On 01 Jun 05:50, Nandeesh B wrote:
> If you suggest here ,which version I can go with . Would be much help.


You can go to 2.18.1.


>
> On Monday, June 1, 2020 at 2:01:35 PM UTC+5:30, Julien Pivotto wrote:
> >
> > To "snapshot" you will have to shut down Prometheus and backup the data.
> >
> > Snapshot feature was added later in the 2.x release.
> >
> > Le lun. 1 juin 2020 à 10:19, Christian Hoffmann <
> > ma...@hoffmann-christian.info <javascript:>> a écrit :
> >> email to promethe...@googlegroups.com <javascript:>.
> --
> You received this message because you are subscribed to the Google Groups "Prometheus Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-use...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/35e86a95-bf05-46df-8d1c-ded6451fe58f%40googlegroups.com.


--
Julien Pivotto
@roidelapluie
Reply all
Reply to author
Forward
0 new messages