Concurrent jobs mysql (xtrabackup) to S3 (droplet) SD backend not working as expected

[Andrei Brezan]

Hi,

It seems I'm not able to run concurrent jobs, basically this happens when I try to run two jobs at the same time:

Running Jobs:
Console connected at 14-Nov-19 10:27
 JobId Level   Name                       Status
======================================================================
   393 Full    client1-test-mysql.domain.com.2019-11-14_12.45.40_44 is running
   394 Full    client2-test-mysql.domain.com.2019-11-14_12.45.46_45 is waiting execution
====

I have the following config on the director:

*show director
Director {
  Name = "bareos-dir-test"
  Messages = "Daemon"
  DirAddresses = {
      ipv4 = {
         addr = 0.0.0.0
         port = 9101
      }
  }
  QueryFile = "/usr/lib/bareos/scripts/query.sql"
  MaximumConcurrentJobs = 10
  Password = "redacted"
  OptimizeForSize = yes
  Auditing = yes
}

*show storage=S3_Object_test-bareosstorage-1.domain.com
Storage {
  Name = "S3_Object_test-bareosstorage-1.domain.com"
  Address = "test-bareosstorage-1.domain.com"
  Password = "redacted"
  Device = "AWS_S3_1-00","AWS_S3_1-01","AWS_S3_1-02"
  MediaType = "S3_Object1"
  MaximumConcurrentJobs = 3
  SddPort = 9103
}

*show pool=AWS-Yearly
Pool {
  Name = "AWS-Yearly"
  PoolType = Backup
  LabelFormat = "AWS-Yearly-"
  LabelType = "bareos"
  MaximumVolumes = 1000
  MaximumVolumeJobs = 1
  MaximumVolumeBytes = 50 g
  VolumeRetention = 5 years
  Storage = "S3_Object_test-bareosstorage-1.domain.com"
}

*show job=client1-test-mysql.domain.com
Job {
  Name = "client1-test-mysql.domain.com"
  Messages = "Standard"
  Client = "client1-test-mysql.domain.com"
  JobDefs = "BackupMysql"
}

*show job=client2-test-mysql.domain.com
Job {
  Name = "client2-test-mysql.domain.com"
  Messages = "Standard"
  Client = "client2-test-mysql.domain.com"
  JobDefs = "BackupMysql"
}

*show jobdefs=BackupMysql
JobDefs {
  Name = "BackupMysql"
  Description = "Mysql Backup"
  Type = Backup
  Level = Full
  Pool = "AWS-Yearly"
  FileSet = "MysqlBackup"
  SpoolData = yes
  AllowDuplicateJobs = no
  CancelLowerLevelDuplicates = yes
  CancelQueuedDuplicates = yes
  CancelRunningDuplicates = yes
}

On the storage daemon I have the following:

Storage {
  Name = "bareos-sd"
  Messages = "Standard"
  Maximum Concurrent Jobs = 25
}
Device {
  Name = "AWS_S3_1-00"
  Always Open = no
  Archive Device = "AWS S3 Storage"
  Automatic Mount = yes
  Device Options = "profile=/etc/bareos/bareos-sd.d/device/droplet/aws,bucket=test-bucket,location=us-west-2,chunksize=100M"
  Device Type = droplet
  Label Media = yes
  Maximum Concurrent Jobs = 1
  Maximum Open Volumes = 1
  Maximum File Size = 500M
  Maximum Spool Size = 15000M
  Media Type = "S3_Object1"
  Random Access = yes
  Removable Media = no
}
Device {
  Name = "AWS_S3_1-01"
  Always Open = no
  Archive Device = "AWS S3 Storage"
  Automatic Mount = yes
  Device Options = "profile=/etc/bareos/bareos-sd.d/device/droplet/aws,bucket=test-bucket,location=us-west-2,chunksize=100M"
  Device Type = droplet
  Label Media = yes
  Maximum Concurrent Jobs = 1
  Maximum Open Volumes = 1
  Maximum File Size = 500M
  Maximum Spool Size = 15000M
  Media Type = "S3_Object1"
  Random Access = yes
  Removable Media = no
}
Device {
  Name = "AWS_S3_1-02"
  Always Open = no
  Archive Device = "AWS S3 Storage"
  Automatic Mount = yes
  Device Options = "profile=/etc/bareos/bareos-sd.d/device/droplet/aws,bucket=test-bucket,location=us-west-2,chunksize=100M"
  Device Type = droplet
  Label Media = yes
  Maximum Concurrent Jobs = 1
  Maximum Open Volumes = 1
  Maximum File Size = 500M
  Maximum Spool Size = 15000M
  Media Type = "S3_Object1"
  Random Access = yes
  Removable Media = no
}