Always Incremental Backup: consolidation fails

[Luca Bonfanti]

Hi,

I'm trying to implement the Always Backup Schema but I have errors during the Consolidation:

2022-04-26 17:00:04 mcrbckxxx JobId 214: Releasing device "AI-Device-Cons" (/mnt2/BAREOS).
2022-04-26 17:00:04 mcrbckxxx JobId 214: Fatal error: stored/acquire.cc:217 No suitable device found to read Volume "Test-AI-Cons-0901"
2022-04-26 17:00:04 mcrbckxxx JobId 214: Releasing device "AI-Device-Inc" (/mnt2/BAREOS).
2022-04-26 17:00:04 mcrbckxxx JobId 214: stored/acquire.cc:158 Changing read device. Want Media Type="File-Cons" have="File-Inc" device="AI-Device-Inc" (/mnt2/BAREOS)
2022-04-26 17:00:04 mcrbckxxx JobId 214: Ready to append to end of Volume "Test-AI-Cons-0903" size=224
2022-04-26 17:00:04 mcrbckxxx JobId 214: Volume "Test-AI-Cons-0903" previously written, moving to end of data.
2022-04-26 17:00:04 bareos-dir JobId 214: Using Device "AI-Device-Cons" to write.
2022-04-26 17:00:04 bareos-dir JobId 214: Using Device "AI-Device-Inc" to read.
2022-04-26 17:00:04 bareos-dir JobId 214: Connected Storage daemon at ***********:9103, encryption: TLS_CHACHA20_POLY1305_SHA256 TLSv1.3
2022-04-26 17:00:04 bareos-dir JobId 214: Bootstrap records written to /var/lib/bareos/bareos-dir.restore.5.bsr
2022-04-26 17:00:04 bareos-dir JobId 214: Consolidating JobIds 202,205,206,210,211
2022-04-26 17:00:04 bareos-dir JobId 214: Start Virtual Backup JobId 214, Job=backup-Test-CL-7499.2022-04-26_17.00.02_18

I think that the problem here is that is trying to read the first Full backup in the Volume "Test-AI-Cons-0901" which has a different MediaType than AI-Device-Inc, but I followed the documentation that declare "Full Backup Pool = AI-Consolidated" in the Job configuration.
I don't know if I'm doing somthing wrong with the Media Type.

Could anyone help me to solve this problem?

Below my configs:

#### SD configurations ####
#/etc/bareos/bareos-sd.d/storage/bareos-sd.conf
Storage {
  Name = bckxxx
  Maximum Concurrent Jobs = 20
}
#/etc/bareos/bareos-sd.d/device/AI-Device-Inc.conf
Device {
  Name = AI-Device-Inc
  Media Type = File-Inc
  Archive Device = /mnt2/BAREOS
  LabelMedia = yes
  Random Access = yes
  AutomaticMount = yes
  RemovableMedia = no
  AlwaysOpen = no
  Maximum Concurrent Jobs = 1
}
#/etc/bareos/bareos-sd.d/device/AI-Device-Cons.conf
Device {
  Name = AI-Device-Cons
  Media Type = File-Cons
  Archive Device = /mnt2/BAREOS
  LabelMedia = yes
  Random Access = yes
  AutomaticMount = yes
  RemovableMedia = no
  AlwaysOpen = no
  Maximum Concurrent Jobs = 1
}
#### DIRECTOR configurations ####
#/etc/bareos/bareos-dir.d/storage/bckxxx-AI-Inc.conf
Storage {
  Name = bckxxx-AI-Inc
  Address = *****
  Password = "*****"
  Device = AI-Device-Inc
  Media Type = File-Inc
  Maximum Concurrent Jobs = 1
}
#/etc/bareos/bareos-dir.d/storage/bckxxx-AI-Cons.conf
Storage {
  Name = bckxxx-AI-Cons
  Address = *****
  Password = "*****"
  Device = AI-Device-Cons
  Media Type = File-Cons
  Maximum Concurrent Jobs = 1
}
#/etc/bareos/bareos-dir.d/pool/Test-AI-Inc.conf
Pool {
  Name = Test-AI-Inc
  Pool Type = Backup
  Storage = bckxxx-AI-Inc
  Recycle = yes
  Auto Prune = yes
  Volume Retention = 360 days
  Maximum Volume Bytes = 50G
  Maximum Volumes = 10
  Volume Use Duration = 23h
  Label Format = "Test-AI-Inc-"
  Next Pool = Test-AI-Cons
}
#/etc/bareos/bareos-dir.d/pool/Test-AI-Cons.conf
Pool {
  Name = Test-AI-Cons
  Pool Type = Backup
  Storage = bckxxx-AI-Cons
  Recycle = yes
  Auto Prune = yes
  Volume Retention = 360 days
  Maximum Volume Bytes = 50G
  Maximum Volumes = 10
  Volume Use Duration = 23h
  Label Format = "Test-AI-Cons-"
}
#/etc/bareos/bareos-dir.d/jobdefs/Test-DefaultJob.conf
JobDefs {
  Name = "Test-DefaultJob"
  Type = Backup
  Level = Incremental
  FileSet = "File-Test"
  Messages = Standard
  Pool = Test-AI-Inc
  Priority = 10
  Write Bootstrap = "/var/lib/bareos/%c.bsr"
  Full Backup Pool = Test-AI-Cons
  Incremental Backup Pool = Test-AI-Inc
}
#/etc/bareos/bareos-dir.d/job/backup-Test-CL-7499.conf
Job {
  Name = "backup-Test-CL-7499"
  Client = "CL-7499"
  Enabled = no
  JobDefs = "Test-DefaultJob"
  AlwaysIncremental = yes
  AlwaysIncrementalJobRetention = 7 days
  Accurate = yes
  Schedule = Cons-Test
}

Thanks in advance.
BR,
Luca

[Brock Palen]

Make sure that you have more than one devices defined that can manage volumes in the pool Test-AI-Cons-901 is in.

If you only have one device defined, that devices is being used to write the consolidated job, you need a second one that can read from the volumes that have the data.

Right now it look slike you only have one device defined.


Brock Palen
bro...@mlds-networks.com
www.mlds-networks.com
Websites, Linux, Hosting, Joomla, Consulting

> --
> You received this message because you are subscribed to the Google Groups "bareos-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to bareos-users...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/bareos-users/CAFd8Gm1_%2Bgb0LFswUYE%3DVFDnYchGAfUHe7EFiA4A3RwYwf3VMw%40mail.gmail.com.

[Luca Bonfanti]

Hi Brock,

first of all, thanks for you reply.

I tryied to follow your advice and I added a second device definition with the Media Type "File-Cons", but it didn't work.

When the Consolidation backup starts, it mounts one device with Media Type " File-Inc" to read and one device with Media Type " File-Cons" to write like before.

Have you any other ideas?

Thanks in advance.

BR,

Luca

[Brock Palen]

Did you add it to the storage config? Eg mine:

Storage {
Name = File
# Do not use "localhost" here
Address = <snip> # N.B. Use a fully qualified name here
LanAddress = 192.168.84.7
Password = “<snip>"
Device = FileStorage
Device = FileStorage2
Device = FileStorage3
Device = FileStorage4
Device = FileStorage5
# number of devices = Maximum Concurrent Jobs
Maximum Concurrent Jobs = 5
Media Type = File
Heartbeat Interval = 60
}

Device {
Name = FileStorage2
Media Type = File
Archive Device = /mnt/bacula
LabelMedia = yes; # lets Bareos label unlabeled media
Random Access = yes;
AutomaticMount = yes; # when device opened, read it
RemovableMedia = no;
AlwaysOpen = no;
Spool Directory = /mnt/spool/server-vfull
Maximum Job Spool Size = 80000000000
Maximum Spool Size = 160000000000

Maximum Concurrent Jobs = 1
}

Device {
Name = FileStorage3
Media Type = File
Archive Device = /mnt/bacula
LabelMedia = yes; # lets Bareos label unlabeled media
Random Access = yes;
AutomaticMount = yes; # when device opened, read it
RemovableMedia = no;
AlwaysOpen = no;
Spool Directory = /mnt/spool/ai-consolidated
Maximum Job Spool Size = 80000000000
Maximum Spool Size = 160000000000

Maximum Concurrent Jobs = 1
}

Brock Palen
bro...@mlds-networks.com
www.mlds-networks.com
Websites, Linux, Hosting, Joomla, Consulting

> To view this discussion on the web visit https://groups.google.com/d/msgid/bareos-users/CAFd8Gm0BCByji2akp5n%2B7TkuNQRhVmZQmLkF5M%3DNzeKAhNPEwQ%40mail.gmail.com.

[Luca Bonfanti]

Hi Brock,

yes, below my last config:

Storage {
  Name = bckxxx-AI-Cons
  Address = *****
  Password = *****
  Device = AI-Device-Cons

  Device = AI-Device-Cons-2
  Media Type = File-Cons
  Maximum Concurrent Jobs = 3
}

Device {
  Name = AI-Device-Cons-2

  Media Type = File-Cons
  Archive Device = /mnt2/BAREOS
  LabelMedia = yes
  Random Access = yes
  AutomaticMount = yes
  RemovableMedia = no
  AlwaysOpen = no
  Maximum Concurrent Jobs = 1
}

Device {
  Name = AI-Device-Cons
  Media Type = File-Cons
  Archive Device = /mnt2/BAREOS
  LabelMedia = yes
  Random Access = yes
  AutomaticMount = yes
  RemovableMedia = no
  AlwaysOpen = no
  Maximum Concurrent Jobs = 1
}

Is it correct that the first Full backup is written using the "File-Cons" Media-Type?

Thanks in advance.

BR,

Luca

[Luca Bonfanti]

Hi Brock,

I have found this post: https://bugs.bareos.org/view.php?id=740 and then I added "Device Reserve by Media Type = yes" to the storage definition in the bareos-sd.

Now it works, but I'm not understanding why the last configuration wasn't right.

Do you know why "Device Reserve by Media Type = yes" is required to make it works?

Thank you so much for the help you gave me!

BR,

Luca