Consolidate in AlwaysInremental not work

667 views
Skip to first unread message

JDStar

unread,
Oct 10, 2017, 4:31:22 AM10/10/17
to bareos-users
I make bareos-17.2.3 configuration AlwaysInremental from doc's:
Job {
Name = linux99-job
Client = linux99-fd
FileSet = "Linux99"
Always Incremental = yes # enabled?
Always Incremental Job Retention = 7 days
Always Incremental Keep Number = 7
Always Incremental Max Full Age = 10 days
Pool = AI-Incremental
Full Backup Pool = AI-Consolidated

Type = Backup
Level = Incremental
Schedule = AI-Cycle
Messages = Standard
Priority = 10
Write Bootstrap = "/mnt/storage/%c.bsr"
}
Job {
Name = "Consolidate"
Type = "Consolidate"
Accurate = yes
JobDefs = "DefaultJob"
Max Full Consolidations = 1
}

This not working: consolidate job start and run virtualjob but this virtual job running few hours and still nothing (I'm try much times).


Logs from director: (fatal error show after canceled job - now after few minuts but yesterday cancel this virtual job after ~10 hours)

2017-10-10 10:14:01 bareos-dir JobId 136: End auto prune.
2017-10-10 10:14:01 bareos-dir JobId 136: No Files found to prune.
2017-10-10 10:14:01 bareos-dir JobId 136: Begin pruning Files.
2017-10-10 10:14:01 bareos-dir JobId 136: BAREOS 17.2.3 (14Aug17): 10-paź-2017 10:14:01
JobId: 136
Job: Consolidate.2017-10-10_10.13.57_06
Scheduled time: 10-paź-2017 10:13:55
Start time: 10-paź-2017 10:13:59
End time: 10-paź-2017 10:14:01
Termination: Consolidate OK

2017-10-10 10:14:00 bareos-dir JobId 136: before ConsolidateFull: jobids: 21,25,26,27,28,34,43,52,63
2017-10-10 10:14:00 bareos-dir JobId 136: Consolidating JobId 137 started.
2017-10-10 10:14:00 bareos-dir JobId 136: Job queued. JobId=137
2017-10-10 10:14:00 bareos-dir JobId 136: Using Catalog "MyCatalog"
2017-10-10 10:14:00 bareos-dir JobId 136: Looking at always incremental job linux99-job
2017-10-10 10:14:00 bareos-dir JobId 136: linux99-job: considering jobs older than 03-paź-2017 10:13:59 for consolidation.
2017-10-10 10:14:00 bareos-dir JobId 136: linux99-job: Start new consolidation
2017-10-10 10:14:00 bareos-dir JobId 136: check full age: full is 26-wrz-2017 20:08:14, allowed is 30-wrz-2017 10:13:59
2017-10-10 10:14:00 bareos-dir JobId 136: Full is older than AlwaysIncrementalMaxFullAge -> also consolidating Full jobid 21
2017-10-10 10:14:00 bareos-dir JobId 136: after ConsolidateFull: jobids: 21,25,26,27,28,34,43,52,63
2017-10-10 10:13:59 bareos-dir JobId 136: Start Consolidate JobId 136, Job=Consolidate.2017-10-10_10.13.57_06


2017-10-10 10:28:30 bareos-dir JobId 137: Fatal error:
Storage daemon didn't accept Device "FileStorage" command.
2017-10-10 10:28:30 bareos-dir JobId 137: Bareos bareos-dir 17.2.3 (14Aug17):
Build OS: x86_64-pc-linux-gnu ubuntu Ubuntu 16.04 LTS
JobId: 137
Job: linux99-job.2017-10-10_10.14.00_07
Backup Level: Virtual Full
Client: "linux99-fd" 17.2.3 (14Aug17) x86_64-pc-linux-gnu,ubuntu,Ubuntu 16.04 LTS,xUbuntu_16.04,x86_64
FileSet: "Linux99" 2017-09-24 14:50:47
Pool: "AI-Consolidated" (From Job Pool's NextPool resource)
Catalog: "MyCatalog" (From Client resource)
Storage: "File2" (From Storage from Pool's NextPool resource)
Scheduled time: 10-paź-2017 10:14:00
Start time: 02-paź-2017 19:49:46
End time: 02-paź-2017 19:53:19
Elapsed time: 3 mins 33 secs
Priority: 10
SD Files Written: 0
SD Bytes Written: 0 (0 B)
Rate: 0.0 KB/s
Volume name(s):
Volume Session Id: 1
Volume Session Time: 1507623220
Last Volume Bytes: 0 (0 B)
SD Errors: 0
SD termination status:
Accurate: yes
Termination: Backup Canceled

2017-10-10 10:14:31 bareos-dir JobId 137: Bootstrap records written to /var/lib/bareos/bareos-dir.restore.1.bsr
2017-10-10 10:14:31 bareos-dir JobId 137: Using Device "FileStorage" to read.
2017-10-10 10:14:01 bareos-dir JobId 137: Start Virtual Backup JobId 137, Job=linux99-job.2017-10-10_10.14.00_07
2017-10-10 10:14:01 bareos-dir JobId 137: Consolidating JobIds 21,25,26,27,28,34,43,52,63

JDStar

unread,
Oct 11, 2017, 3:07:58 AM10/11/17
to bareos-users
Anyone have working configuration bareos-17.2.x or 16.2.x with AlwaysIncremental and consolidation job ?

Jon SCHEWE

unread,
Oct 11, 2017, 10:00:18 AM10/11/17
to bareos...@googlegroups.com
On 10/11/17 2:07 AM, JDStar wrote:
> Anyone have working configuration bareos-17.2.x or 16.2.x with AlwaysIncremental and consolidation job ?
>
Yes. I'm using bareos 16.2.4. Below is my configuration.

JobDefs {
  Name = "AlwaysIncremental"
  Type = Backup
  Level = Incremental
  Schedule = "WeeklyCycle"
  Storage = File
  Messages = Standard
  Priority = 10
  Write Bootstrap = "/mnt/bareos-file/bootstrap/%c.bsr"
  Pool = AI-Incremental
  Full Backup Pool = AI-Consolidated

  Accurate = yes
  Always Incremental = yes
  Always Incremental Job Retention = 7 days
  Always Incremental Keep Number = 14
}
JobDefs {
  Name = "DefaultJob"
  Type = Backup
  Level = Full
  Client = gemini-fd
  FileSet = "SelfTest"                     # selftest
fileset                            (#13)
  Schedule = "WeeklyCycle"
  Storage = File
  Messages = Standard
  Pool = Full
  Priority = 10
  Write Bootstrap = "/mnt/bareos-file/bootstrap/%c.bsr"
}

Job {
  Name = "backup-gemini-fd"
  JobDefs = "AlwaysIncremental"
  Client = "gemini-fd"
  FileSet = "gemini-all"
}
Job {
  Client = gemini-fd
  Name = "Consolidate"
  Type = "Consolidate"
  Accurate = "yes"
  JobDefs = "DefaultJob"
  FileSet = "LinuxAll"

  Max Full Consolidations = 1
}


--
Research Scientist
Raytheon BBN Technologies
5775 Wayzata Blvd, Ste 630
Saint Louis Park, MN, 55416
Office: 952-545-5720

Jörg Steffens

unread,
Oct 11, 2017, 12:37:13 PM10/11/17
to bareos...@googlegroups.com
You may missed following comment from the documentation:

For the Always Incremental Backup Scheme at least two storages are needed.

See
http://doc.bareos.org/master/html/bareos-manual-main-reference.html#UsingMultipleStorageDevices
how to setup multiple disk storages.

regards,
Jörg

--
Jörg Steffens joerg.s...@bareos.com
Bareos GmbH & Co. KG Phone: +49 221 630693-91
http://www.bareos.com Fax: +49 221 630693-10

Sitz der Gesellschaft: Köln | Amtsgericht Köln: HRA 29646
Komplementär: Bareos Verwaltungs-GmbH
Geschäftsführer:
S. Dühr, M. Außendorf, Jörg Steffens, P. Storz

JDStar

unread,
Oct 11, 2017, 12:40:57 PM10/11/17
to bareos-users
Yes, You right!
I make changes few hour ago and now working. Thanks.
Now i must make truncate volumes older than Always Incremental time settings.

Fbpot Fbpot

unread,
Apr 24, 2019, 3:59:55 AM4/24/19
to bareos-users
Hi, would you be so kind and show your config for multiple disk storage. I have problem with this and my virtual full does not work
Reply all
Reply to author
Forward
0 new messages