Чрезмерный инкрементальный бэкап

184 views
Skip to first unread message

St.Andrew

unread,
Nov 30, 2010, 3:07:56 AM11/30/10
to ru-bacula
Доброго времени суток.

У нас bacula( 5.0.3) на freebsd 8.1 используется для бэкапа файлов с
Windows Server 2003 (bacula-client 5.0.3). Файлы бэкапируются на
локальный рэйд-массив. С недавних пор стали замечать, что очень быстро
стало заканчиваться место в хранилище. Анализ показал, что виноваты
инкрементальные бэкапы: размер такого бэкапа в разы больше реального
размера копируемых файлов. Перед бэкапом estiamte показывает
следующее:
*est level=Incremental job=esp-shares
Using Catalog "MyCatalog"
Connecting to Client esp-fd at 172.16.1.2:9102
2000 OK estimate files=393 bytes=277,027,969


а сам бэкап:

26-Nov 21:00 bagira-dir JobId 1113: Start Backup JobId 1113, Job=esp-
shares.2010-11-26_21.00.00_19
26-Nov 21:00 bagira-dir JobId 1113: Using Device "esp-fs"
26-Nov 21:00 bagira-sd JobId 1113: Volume "esp-day-20101124-2321"
previously written, moving to end of data.
26-Nov 21:00 bagira-sd JobId 1113: Ready to append to end of Volume
"esp-day-20101124-2321" size=23844347453
26-Nov 21:00 esp-fd JobId 1113: Generate VSS snapshots. Driver="VSS
Win 2003", Drive(s)="E"
26-Nov 23:03 bagira-sd JobId 1113: User defined maximum volume
capacity 107,374,182,400 exceeded on device "esp-fs" (/bacula/backups/
esp).
26-Nov 23:03 bagira-sd JobId 1113: End of medium on Volume "esp-
day-20101124-2321" Bytes=107,374,162,492 Blocks=1,664,407 at 26-
Nov-2010 23:03.
26-Nov 23:03 bagira-dir JobId 1113: Created new Volume "esp-
day-20101126-2303" in catalog.
26-Nov 23:03 bagira-sd JobId 1113: Labeled new Volume "esp-
day-20101126-2303" on device "esp-fs" (/bacula/backups/esp).
26-Nov 23:03 bagira-sd JobId 1113: Wrote label to prelabeled Volume
"esp-day-20101126-2303" on device "esp-fs" (/bacula/backups/esp)
26-Nov 23:03 bagira-sd JobId 1113: New volume "esp-day-20101126-2303"
mounted on device "esp-fs" (/bacula/backups/esp) at 26-Nov-2010 23:03.
26-Nov 23:56 bagira-sd JobId 1113: Job write elapsed time = 02:56:12,
Transfer rate = 11.40 M Bytes/second
26-Nov 23:56 esp-fd JobId 1113: VSS Writer (BackupComplete): "System
Writer", State: 0x1 (VSS_WS_STABLE)
26-Nov 23:56 esp-fd JobId 1113: VSS Writer (BackupComplete): "FSRM
Writer", State: 0x1 (VSS_WS_STABLE)
26-Nov 23:56 esp-fd JobId 1113: VSS Writer (BackupComplete): "FRS
Writer", State: 0x1 (VSS_WS_STABLE)
26-Nov 23:56 esp-fd JobId 1113: VSS Writer (BackupComplete): "Registry
Writer", State: 0x1 (VSS_WS_STABLE)
26-Nov 23:56 esp-fd JobId 1113: VSS Writer (BackupComplete):
"MSDEWriter", State: 0x1 (VSS_WS_STABLE)
26-Nov 23:56 esp-fd JobId 1113: VSS Writer (BackupComplete): "COM+
REGDB Writer", State: 0x1 (VSS_WS_STABLE)
26-Nov 23:56 esp-fd JobId 1113: VSS Writer (BackupComplete): "Event
Log Writer", State: 0x1 (VSS_WS_STABLE)
26-Nov 23:56 esp-fd JobId 1113: VSS Writer (BackupComplete): "BITS
Writer", State: 0x1 (VSS_WS_STABLE)
26-Nov 23:56 esp-fd JobId 1113: VSS Writer (BackupComplete): "WMI
Writer", State: 0x1 (VSS_WS_STABLE)
26-Nov 23:56 esp-fd JobId 1113: VSS Writer (BackupComplete): "NTDS",
State: 0x1 (VSS_WS_STABLE)
26-Nov 23:56 esp-fd JobId 1113: VSS Writer (BackupComplete): "Dhcp Jet
Writer", State: 0x1 (VSS_WS_STABLE)
26-Nov 23:56 esp-fd JobId 1113: VSS Writer (BackupComplete): "IIS
Metabase Writer", State: 0x1 (VSS_WS_STABLE)
26-Nov 23:56 bagira-dir JobId 1113: Bacula bagira-dir 5.0.3 (04Aug10):
26-Nov-2010 23:56:20
Build OS: amd64-portbld-freebsd8.1 freebsd 8.1-STABLE
JobId: 1113
Job: esp-shares.2010-11-26_21.00.00_19
Backup Level: Incremental, since=2010-11-24 21:00:04
Client: "esp-fd" 5.0.3 (04Aug10) Linux,Cross-
compile,Win32
FileSet: "esp-shares" 2010-07-05 13:51:44
Pool: "esp-pool-day" (From Job IncPool override)
Catalog: "MyCatalog" (From Client resource)
Storage: "bagira-esp" (From Pool resource)
Scheduled time: 26-Nov-2010 21:00:00
Start time: 26-Nov-2010 21:00:05
End time: 26-Nov-2010 23:56:20
Elapsed time: 2 hours 56 mins 15 secs
Priority: 10
FD Files Written: 393
SD Files Written: 393
FD Bytes Written: 120,603,306,120 (120.6 GB)
SD Bytes Written: 120,603,399,520 (120.6 GB)
Rate: 11404.6 KB/s
Software Compression: None
VSS: yes
Encryption: no
Accurate: no
Volume name(s): esp-day-20101124-2321|esp-day-20101126-2303
Volume Session Id: 29
Volume Session Time: 1290200026
Last Volume Bytes: 37,163,026,705 (37.16 GB)
Non-fatal FD errors: 0
SD Errors: 0
FD termination status: OK
SD termination status: OK
Termination: Backup OK

26-Nov 23:56 bagira-dir JobId 1113: Begin pruning Jobs older than 3
months .
26-Nov 23:56 bagira-dir JobId 1113: No Jobs found to prune.
26-Nov 23:56 bagira-dir JobId 1113: Begin pruning Jobs.
26-Nov 23:56 bagira-dir JobId 1113: No Files found to prune.
26-Nov 23:56 bagira-dir JobId 1113: End auto prune.


Видно, что вместо ожидаемых 277Мб копируется почему-то 120Гб.

в конфиге bacula-dir.conf :

Job {
Name = esp-shares
Type = Backup
Level = Full
Write Bootstrap = "/var/db/bacula/esp.bsr"
Client = esp-fd
FileSet = esp-shares
Messages = Standard
Pool = esp-pool-month
Incremental Backup Pool = esp-pool-day
Schedule = esp-monthly
Rerun Failed Levels = Yes
}

FileSet {
Name = esp-shares
Enable VSS = Yes
Include {
Options {
signature = MD5
wildfile = "*.avi"
wildfile = "*.mp3"
wildfile = "*.mp4"
wildfile = "*.wmv"
wildfile = "*.iso"
wildfile = "*.nrg"
wildfile = "*.ogg"
wildfile = "*.wav"
wilddir = "e:/Shares/Programs"
wilddir = "e:/Shares/programers"
wilddir = "e:/Shares/recover"
wilddir = "e:/Shares/Project"
wilddir = "e:/Shares/SOFT"
wilddir = "e:/Shares/Profiles"
exclude = yes
}
File = "e:/Shares/"
File = "e:/ntbackup"
}
}


Подскажите, где искать проблему или как исправить?

Yuri Timofeev

unread,
Nov 30, 2010, 4:10:35 AM11/30/10
to ru-bacula
Однако кол-во файлов одинаковое - 393.
Может быть estimate ошибся в размере.

St.Andrew

unread,
Nov 30, 2010, 11:42:11 PM11/30/10
to ru-bacula
Не исключено, что estimate ошибается, но чтобы настолько? Реальный
размер файлов, которые подвергаются копированию, никак не достигает
100Гб - обычно где-то от 100Мб до 10-20Гб, но не больше!
Reply all
Reply to author
Forward
0 new messages