Please use "label" command to create a new volume

[Arjen Van Drie]

Hi all,

I have been trying to understand why in by far most cases, BareOS is
perfectly capable ot finding the next Volume Label, creating the file
and continuing the backup. But, in some cases, and with some (apparently
specific) clients, it refuses to do so. I wonder why, can someone point
me in the right direction ?

Thanks a lot,
Arjen Van Drie.



The message:

04-Jul 12:20 backupstore5801-sd JobId 595: End of medium on Volume
"Incremental-0162" Bytes=5,368,688,893 Blocks=83,220 at 04-Jul-2016 12:20.
04-Jul 12:20 backupstore5801-sd JobId 595: Job
BackupAibvstat.2016-07-01_21.00.00_35 is waiting. Cannot find any
appendable volumes.
Please use the "label" command to create a new Volume for:
Storage: "BackupStore5801-aibvstat" (/data/backup/bareos/aibvstat)
Pool: Incremental
Media type: BackupStore5801 aibvstat

My pools have

Label Format = "Full-"
Label Format = "Differential-"
Label Format = "Incremental-"

for the Full, Differential and Incremental pool respectively.


My clients all have the same client definition:

Client {
Name = aibvstat-fd
Address = aibvstat.mydomain
Description = Zellik
Password = "my_password"
}

The job:

Job {
Name = "BackupAibvstat"
JobDefs = "DefaultJob"
Client = "aibvstat-fd"
FileSet = "AibvStat"
Storage = BackupStore5801-aibvstat
Write Bootstrap = "|/usr/bin/bsmtp -h localhost -f \"\(Bareos\) \" -s
\"Bootstrap for Job %j\" bareos...@cb.mydomain"
}

JobDefs {
Name = "DefaultJob"
Type = Backup
Level = Incremental
FileSet = "SelfTest"
Schedule = "WeeklyCycle"
Storage = BackupStore5801-catchall
Messages = Standard
Pool = Incremental
Priority = 10
Write Bootstrap = "/var/lib/bareos/%c.bsr"
Full Backup Pool = Full
Differential Backup Pool = Differential
Incremental Backup Pool = Incremental
}

FileSet:

FileSet {
Name = "AibvStat"
Enable VSS = no
Include {
Options {
Signature = MD5
Drive Type = fixed
IgnoreCase = yes
WildFile = "[A-Z]:/pagefile.sys"
WildDir = "[A-Z]:/RECYCLER"
WildDir = "[A-Z]:/$RECYCLE.BIN"
WildDir = "[A-Z]:/System Volume Information"
Exclude = yes
}
File = "C:/aibv_it"
File = "C:/goca"
File = "D:/drivers"
File = "D:/informix"
File = "D:/NewEra"
File = "D:/Program Files/Business Objects"
File = "D:/userprofiles"
File = "K:/localbackups"
}
}

And on the storage host:

Device {
Name = BackupStore5801-aibvstat
Media Type = "BackupStore5801 aibvstat"
Archive Device = /data/backup/bareos/aibvstat.mydomain
LabelMedia = yes;
Random Access = yes;
AutomaticMount = yes;
RemovableMedia = no;
AlwaysOpen = no;
}

[Bruno Friedmann]

Would you mind if you provide a list media of the incriminated pool.
and also the configuration of that pool.

You should normally see that no more media are available to be pruned and the
pool got its limit in term of Max Volumes.


--

Bruno Friedmann
Ioda-Net Sàrl www.ioda-net.ch
Bareos Partner, openSUSE Member, fsfe fellowship
GPG KEY : D5C9B751C4653227
irc: tigerfoot

openSUSE Tumbleweed (20160701) (x86_64)
Linux 4.6.2-1-default x86_64 GNU/Linux, nvidia: 367.27
Qt: 5.6.1, KDE Frameworks: 5.22.0, Plasma: 5.6.4, kmail2 5.2.2

[Arjen Van Drie]

Bruno,

thanks for replying, I will continue below your tekst.

We store our backups per device that is backed up. So if we have server1, server2, server3, our backups are stored like this:

/data/backups/bareos/server1/
  - Full-0001
  - Differential-0004
  - Incremental-0005

/data/backups/bareos/server2/
  - Full-002
  - Differential-0006
  - Incremental-0008

/data/backups/bareos/server3/
  - Full-0003
  - Differential-0007
  - Incremental-0009

That said, here are the Pool configs:

Pool {
  Name = Full
  Pool Type = Backup
  Recycle = yes
  AutoPrune = yes
  Volume Retention = 190 days
  Maximum Volume Bytes = 100G
  Maximum Volumes = 18
  Label Format = "Full-"
  Action On Purge = Truncate
}

Pool {
  Name = Differential
  Pool Type = Backup
  Recycle = yes
  AutoPrune = yes
  Volume Retention = 90 days
  Maximum Volume Bytes = 20G
  Maximum Volumes = 18
  Label Format = "Differential-"
  Action On Purge = Truncate
}

Pool {
  Name = Incremental
  Pool Type = Backup
  Recycle = yes
  AutoPrune = yes
  Volume Retention = 30 days
  Maximum Volume Bytes = 20G
  Maximum Volumes = 100
  Label Format = "Incremental-"
  Action On Purge = Truncate
}

and the contents of the backup dir of the host aibvstat "/data/backup/bareos/aibstat.mydomain":

total 473526920
-rw-r----- 1 bareos bareos  21474780264 Jun 18 21:02 Differential-0103
-rw-r----- 1 bareos bareos  21474807949 Jun 25 21:04 Differential-0121
-rw-r----- 1 bareos bareos   3337042997 Jun 27 08:09 Differential-0141
-rw-r----- 1 bareos bareos 107374129689 Jul  4 12:36 Full-0087
-rw-r----- 1 bareos bareos  21994217129 Jul  4 13:34 Full-0165
-rw-r----- 1 bareos bareos   5368688894 Jun  8 21:02 Incremental-0090
-rw-r----- 1 bareos bareos   5368688884 Jun  8 21:03 Incremental-0091
-rw-r----- 1 bareos bareos   5368665723 Jun  9 21:01 Incremental-0092
-rw-r----- 1 bareos bareos   5368688893 Jun  9 21:03 Incremental-0095
-rw-r----- 1 bareos bareos   5368688887 Jun  9 21:04 Incremental-0096
-rw-r----- 1 bareos bareos   5368699797 Jun 10 21:02 Incremental-0097
-rw-r----- 1 bareos bareos   5368688892 Jun 10 21:02 Incremental-0099
-rw-r----- 1 bareos bareos   5368688886 Jun 10 21:03 Incremental-0100
-rw-r----- 1 bareos bareos   5368687507 Jun 14 08:22 Incremental-0101
-rw-r----- 1 bareos bareos   5368688893 Jun 14 08:23 Incremental-0105
-rw-r----- 1 bareos bareos   5368688887 Jun 14 08:24 Incremental-0106
-rw-r----- 1 bareos bareos   5368675995 Jun 14 21:02 Incremental-0107
-rw-r----- 1 bareos bareos   5368688891 Jun 14 21:03 Incremental-0108
-rw-r----- 1 bareos bareos   5368688881 Jun 14 21:04 Incremental-0109
-rw-r----- 1 bareos bareos   5368690366 Jun 15 21:02 Incremental-0110
-rw-r----- 1 bareos bareos   5368688892 Jun 15 21:03 Incremental-0111
-rw-r----- 1 bareos bareos   5368688886 Jun 15 21:04 Incremental-0112
-rw-r----- 1 bareos bareos   5368695670 Jun 16 21:02 Incremental-0113
-rw-r----- 1 bareos bareos   5368688882 Jun 16 21:03 Incremental-0116
-rw-r----- 1 bareos bareos   5368688892 Jun 16 21:04 Incremental-0117
-rw-r----- 1 bareos bareos   5368654063 Jun 17 21:02 Incremental-0118
-rw-r----- 1 bareos bareos   5368688880 Jun 17 21:03 Incremental-0119
-rw-r----- 1 bareos bareos   5368701989 Jun 20 21:02 Incremental-0120
-rw-r----- 1 bareos bareos   5368688884 Jun 20 21:03 Incremental-0123
-rw-r----- 1 bareos bareos   5368688882 Jun 20 21:04 Incremental-0124
-rw-r----- 1 bareos bareos   5368659084 Jun 21 21:02 Incremental-0125
-rw-r----- 1 bareos bareos   5368688892 Jun 21 21:03 Incremental-0127
-rw-r----- 1 bareos bareos   5368688886 Jun 21 21:04 Incremental-0128
-rw-r----- 1 bareos bareos   5368708592 Jun 22 21:02 Incremental-0129
-rw-r----- 1 bareos bareos   5368688892 Jun 22 21:03 Incremental-0130
-rw-r----- 1 bareos bareos   5368688886 Jun 22 21:04 Incremental-0131
-rw-r----- 1 bareos bareos   5368696998 Jun 23 21:02 Incremental-0132
-rw-r----- 1 bareos bareos   5368688893 Jun 23 21:03 Incremental-0135
-rw-r----- 1 bareos bareos   5368688883 Jun 23 21:04 Incremental-0136
-rw-r----- 1 bareos bareos   5368689153 Jun 24 21:03 Incremental-0137
-rw-r----- 1 bareos bareos   5368688893 Jun 24 21:04 Incremental-0138
-rw-r----- 1 bareos bareos   5368688883 Jun 24 21:05 Incremental-0139
-rw-r----- 1 bareos bareos   5368708793 Jun 27 21:03 Incremental-0140
-rw-r----- 1 bareos bareos   5368688892 Jun 27 21:03 Incremental-0145
-rw-r----- 1 bareos bareos   5368688882 Jun 27 21:04 Incremental-0146
-rw-r----- 1 bareos bareos   5368669477 Jun 28 21:02 Incremental-0147
-rw-r----- 1 bareos bareos   5368688886 Jun 28 21:03 Incremental-0148
-rw-r----- 1 bareos bareos   5368688892 Jun 28 21:04 Incremental-0149
-rw-r----- 1 bareos bareos   5368688891 Jun 29 21:03 Incremental-0151
-rw-r----- 1 bareos bareos   5368688888 Jun 29 21:04 Incremental-0152
-rw-r----- 1 bareos bareos   5368669402 Jun 30 21:01 Incremental-0153
-rw-r----- 1 bareos bareos   5368688892 Jul  3 13:24 Incremental-0158
-rw-r----- 1 bareos bareos   5368688890 Jul  4 12:11 Incremental-0159
-rw-r----- 1 bareos bareos   5368667214 Jul  4 12:17 Incremental-0161
-rw-r----- 1 bareos bareos   5368688893 Jul  4 12:20 Incremental-0162
-rw-r----- 1 bareos bareos   5368688883 Jul  4 12:24 Incremental-0163
-rw-r----- 1 bareos bareos   5368706855 Jul  4 21:02 Incremental-0164
-rw-r----- 1 bareos bareos  21474819313 Jul  5 08:36 Incremental-0166

ls -l | grep Incremental | wc -l
53

Or should I count _all_ files with label "Incremental-" in all backup dirs over all backup storage devices we have ?

Thanks again,
Arjen.

[Bruno Friedmann]

What about the output of list media in bconsole ?

[Arjen Van Drie]

I will clean up this email somewhat

On 07/05/2016 09:41 AM, Bruno Friedmann wrote:

On mardi, 5 juillet 2016 08.47:26 h CEST Arjen Van Drie wrote:

Bruno,

thanks for replying, I will continue below your tekst.

On 07/04/2016 07:25 PM, Bruno Friedmann wrote:

On lundi, 4 juillet 2016 13.01:54 h CEST Arjen Van Drie wrote:

Hi all,

I have been trying to understand why in by far most cases, BareOS is
perfectly capable ot finding the next Volume Label, creating the file
and continuing the backup. But, in some cases, and with some (apparently
specific) clients, it refuses to do so. I wonder why, can someone point
me in the right direction ?

Thanks a lot,
Arjen Van Drie.

[sNap Message]

Pool {
   Name = Incremental
   Pool Type = Backup
   Recycle = yes
   AutoPrune = yes
   Volume Retention = 30 days
   Maximum Volume Bytes = 20G
   Maximum Volumes = 100
   Label Format = "Incremental-"
   Action On Purge = Truncate
}

What about the output of list media in bconsole ?

I did a direct select on the db (Incremental PoolId == 4):

mysql> SELECT COUNT(*) FROM Media WHERE PoolId = 4;
+----------+
| COUNT(*) |
+----------+
|      113 |
+----------+
1 row in set (0.00 sec)

So I guess that is the answer: Maximum Volumes = 100, and COUNT is already at 113.

Increasing Maximum Volumes looks like my solution, as wel as maybe increase Max Volume Bytes ?

Thanks again,
Arjen.