Multiple backup jobs

[Raja Rajenderan]

Hi,

I have configured just 1 backup repo and scheduled auto backup. But every time it creates three backup jobs, among which 1 gets completed and the other 2 fails. Though the backup is working and getting pushed to the configured repo, I do not understand why there are additional jobs triggered. Here are my backup manifest file and the logs from each job.

Log from Working Backup Job

---------------------------

time="2021-09-19T04:00:13Z" level=info msg="crunchy-pgbackrest starts"

time="2021-09-19T04:00:13Z" level=info msg="debug flag set to false"

time="2021-09-19T04:00:13Z" level=info msg="backrest backup command requested"

time="2021-09-19T04:00:13Z" level=info msg="command to execute is [pgbackrest backup --stanza=db --repo=2 --type=full]"

time="2021-09-19T04:01:02Z" level=info msg="output=[]"

time="2021-09-19T04:01:02Z" level=info msg="stderr=[]"

time="2021-09-19T04:01:02Z" level=info msg="crunchy-pgbackrest ends"

---

Log from Failing Backup Job

---------------------------

time="2021-09-19T04:00:03Z" level=info msg="crunchy-pgbackrest starts"

time="2021-09-19T04:00:03Z" level=info msg="debug flag set to false"

time="2021-09-19T04:00:03Z" level=info msg="backrest backup command requested"

time="2021-09-19T04:00:03Z" level=info msg="command to execute is [pgbackrest backup --stanza=db --repo=2 --type=full]"

time="2021-09-19T04:00:03Z" level=info msg="output=[]"

time="2021-09-19T04:00:03Z" level=info msg="stderr=[ERROR: [050]: unable to acquire lock on file '/tmp/pgbackrest/db-backup.lock': Resource temporarily unavailable\n       HINT: is another pgBackRest process running?\n]"

time="2021-09-19T04:00:03Z" level=fatal msg="command terminated with exit code 50"

---

Log from Failing Backup Job

---------------------------

time="2021-09-19T04:00:01Z" level=info msg="crunchy-pgbackrest starts"

time="2021-09-19T04:00:01Z" level=info msg="debug flag set to false"

time="2021-09-19T04:00:01Z" level=info msg="backrest backup command requested"

time="2021-09-19T04:00:01Z" level=info msg="command to execute is [pgbackrest backup --stanza=db --repo=2 --type=full]"

time="2021-09-19T04:00:01Z" level=info msg="output=[]"

time="2021-09-19T04:00:01Z" level=info msg="stderr=[ERROR: [050]: unable to acquire lock on file '/tmp/pgbackrest/db-backup.lock': Resource temporarily unavailable\n       HINT: is another pgBackRest process running?\n]"

time="2021-09-19T04:00:01Z" level=fatal msg="command terminated with exit code 50"

---

YAML Manifest

-------------

  backups:

    pgbackrest:

      global:

        repo2-path: /pgbackrest/postgres-operator/hippo/repo2

        repo2-retention-full: "7"

        repo2-retention-full-type: time

      image: registry.developers.crunchydata.com/crunchydata/crunchy-pgbackrest:centos8-2.33-2

      repoHost:

        dedicated: {}

      configuration:

      - secret:

          name: pgo-azure-creds

      repos:

      - name: repo2

        azure:

          container: pgo-test

        schedules:

          full: "0 4 * * *"

          incremental: "0 */2 * * *"

Regards,

Raja

[Jonathan S. Katz]

Are there 3 repos set up? You're using "repo2" -- is there a reason you're not using repo1?

Jonathan S. Katz

VP Platform Engineering

Crunchy Data
Enterprise PostgreSQL 

www.crunchydata.com

[Raja Rajenderan]

Only one repo setup. Repo 1 is local [but not using it now, so have commented on it]. Repo 2 is Azure, which is where the backups are pushed to.

--

Regards,

Raja Rajenderan

[Jonathan S. Katz]

Can you please send the full manifest you are using (with the sensitive info redacted) and any logs from the Postgres Operator around the creation of CronJobs?

Can you inspect how many CronJobs were created and share any info from kubectl describe or the manifests?

Thanks,

Jonathan

Jonathan S. Katz

VP Platform Engineering

Crunchy Data
Enterprise PostgreSQL 

www.crunchydata.com