LTO-7 tape lost capacity during recycling

144 views
Skip to first unread message

Frank Cherry

unread,
Apr 24, 2021, 3:29:18 AM4/24/21
to bareos-users
Bareos declares fully erased LTO-7 after 628 GB as full. Details here:

Anyone a idea please?

Thanks Frank

Christian Svensson

unread,
Apr 24, 2021, 5:13:07 AM4/24/21
to Frank Cherry, bareos-users
Hi,

New on this forum, and new on tape in general - but I think I might be
able to help here.

On Sat, Apr 24, 2021 at 9:29 AM 'Frank Cherry' via bareos-users
<bareos...@googlegroups.com> wrote:
>
> Bareos declares fully erased LTO-7 after 628 GB as full. Details here:
> https://bugs.bareos.org/view.php?id=1341

I know that Bacula at least assumes the volume/tape is full if it
receives an uncorrectable error from the drive.
That seems to be the case here:
22-Apr 17:01 bareos-sd JobId 246: Error: stored/block.cc:803 Write
error at 29:11710 on device "LTO7-Tape-Drive" (/dev/nst0).
ERR=Input/output error.
22-Apr 17:01 bareos-sd JobId 246: Error: stored/block.cc:822 Write
error on fd=6 at file:blk 29:11710 on device "LTO7-Tape-Drive"
(/dev/nst0). ERR=Input/output error.

I received a bunch of those when I was messing around with the tape
library configuration as backup jobs were happening. I manually
deleted the jobs affected, erased the affected tapes, and re-ran the
jobs and things worked fine.

In your case you say you run into issues at 1.6 TB and 1.1 TB
respectively so it seems to be a non-transient issue.. Have you tried
using the btape and use for example the fill command to try to write a
full tape?
I have used btape to measure drive and tape performance, but I haven't
used the fill command myself so I cannot assist on what a good
configuration is - but it should at least tell you if your OS and
hardware setup is able to fill the tape under ideal conditions.

Regards,

Frank Cherry

unread,
Apr 24, 2021, 6:47:24 AM4/24/21
to bareos-users
Thanks Christian,

I use the spooling feature for the backups to tape.
The spooling directory ( /backup_spool/ ) is a hardware RAID-0 (stripe) mount of two SATA harddisks.
Have done a test:

**** write test  ****
dd if=/dev/zero of=/backup_spool/testfile bs=1M count=204800 conv=fdatasync,notrunc
204800+0 Datensätze ein
204800+0 Datensätze aus
214748364800 bytes (215 GB, 200 GiB) copied, 596,839 s, 360 MB/s

**** read test  ****
dd if=/backup_spool/testfile of=/dev/null bs=1M count=204800
204800+0 Datensätze ein
204800+0 Datensätze aus
214748364800 bytes (215 GB, 200 GiB) copied, 625,029 s, 344 MB/s

My conclusion: I can read up to 344 MB/s from the spooling directory.

Tape test 1 with 512k Blocks using btape:
*speed file_size=3 skip_raw

btape: stored/btape.cc:1048-0 Test with zero data and bareos block structure.
btape: stored/btape.cc:938-0 Begin writing 3 files of 3.221 GB with blocks of 524288 bytes.
++++++++++++
btape: stored/btape.cc:600-0 Wrote 1 EOF to "LTO7-Tape-Drive" (/dev/nst0)
btape: stored/btape.cc:416-0 Volume bytes=3.221 GB. Write rate = 292.8 MB/s
++++++++++++
btape: stored/btape.cc:600-0 Wrote 1 EOF to "LTO7-Tape-Drive" (/dev/nst0)
btape: stored/btape.cc:416-0 Volume bytes=3.221 GB. Write rate = 322.1 MB/s
++++++++++++
btape: stored/btape.cc:600-0 Wrote 1 EOF to "LTO7-Tape-Drive" (/dev/nst0)
btape: stored/btape.cc:416-0 Volume bytes=3.221 GB. Write rate = 322.1 MB/s
btape: stored/btape.cc:392-0 Total Volume bytes=9.663 GB. Total Write rate = 311.7 MB/s

btape: stored/btape.cc:1060-0 Test with random data, should give the minimum throughput.
btape: stored/btape.cc:938-0 Begin writing 3 files of 3.221 GB with blocks of 524288 bytes.
+++++++++++++
btape: stored/btape.cc:600-0 Wrote 1 EOF to "LTO7-Tape-Drive" (/dev/nst0)
btape: stored/btape.cc:416-0 Volume bytes=3.221 GB. Write rate = 94.74 MB/s
++++++++++++
btape: stored/btape.cc:600-0 Wrote 1 EOF to "LTO7-Tape-Drive" (/dev/nst0)
btape: stored/btape.cc:416-0 Volume bytes=3.221 GB. Write rate = 94.74 MB/s
++++++++++++
btape: stored/btape.cc:600-0 Wrote 1 EOF to "LTO7-Tape-Drive" (/dev/nst0)
btape: stored/btape.cc:416-0 Volume bytes=3.221 GB. Write rate = 94.74 MB/s
btape: stored/btape.cc:392-0 Total Volume bytes=9.663 GB. Total Write rate = 94.74 MB/s

Are the random data to low ?
the Quantum LTO-7 HH drive is connectet to a Microsemi 1100-4i SAS HBA.

Mainboard: ASUSTeK ROG STRIX B450-F
CPU: AMD Ryzen 3 3200G

Have now start a fill test:

[root@bareos ~]# mt -f /dev/st0 rewind
[root@bareos ~]# mt -f /dev/st0 status
SCSI 2 tape drive:
File number=0, block number=0, partition=0.
Tape block size 0 bytes. Density code 0x5c (no translation).
Soft error count since last status=0
General status bits on (41010000):
 BOT ONLINE IM_REP_EN

btape /dev/nst0
*fill

This command simulates Bareos writing to a tape.
It requires either one or two blank tapes, which it
will label and write.

If you have an autochanger configured, it will use
the tapes that are in slots 1 and 2, otherwise, you will
be prompted to insert the tapes when necessary.

It will print a status approximately
every 322 MB, and write an EOF every 20.00 G.  If you have
selected the simple test option, after writing the first tape
it will rewind it and re-read the last block written.

If you have selected the multiple tape test, when the first tape
fills, it will ask for a second, and after writing a few more
blocks, it will stop.  Then it will begin re-reading the
two tapes.

This may take a long time -- hours! ...

Do you want to run the simplified test (s) with one tape
or the complete multiple tape (m) test: (s/m) s
Simple test (single tape) selected.
btape: stored/btape.cc:3000-0 Autochanger returned: 0
Mount blank Volume on device "LTO7-Tape-Drive" (/dev/nst0) and press return when ready:
btape: stored/btape.cc:3006-0
Wrote Volume label for volume "TestVolume1".
Wrote Start of Session label.
12:46:12 Begin writing Bareos records to tape ...
Wrote block=5000, file,blk=1,5000 VolBytes=2,621,440,000 rate=238.3 MB/s
Wrote block=10000, file,blk=1,10000 VolBytes=5,242,880,000 rate=275.9 MB/s
.....

will report the result in some hours ....

Thanks for helping me.

Frank Cherry

unread,
Apr 24, 2021, 9:24:56 AM4/24/21
to bareos-users
So this ist the result:

Wrote Start of Session label.
12:46:12 Begin writing Bareos records to tape ...
Wrote block=5000, file,blk=1,5000 VolBytes=2,621,440,000 rate=238.3 MB/s
Wrote block=10000, file,blk=1,10000 VolBytes=5,242,880,000 rate=275.9 MB/s
Wrote block=15000, file,blk=1,15000 VolBytes=7,864,320,000 rate=280.8 MB/s
Wrote block=20000, file,blk=1,20000 VolBytes=10,485,760,000 rate=283.3 MB/s
Wrote block=25000, file,blk=1,25000 VolBytes=13,107,200,000 rate=291.2 MB/s
Wrote block=30000, file,blk=1,30000 VolBytes=15,728,640,000 rate=291.2 MB/s
Wrote block=35000, file,blk=1,35000 VolBytes=18,350,080,000 rate=295.9 MB/s
Wrote block=40000, file,blk=2,1854 VolBytes=20,971,520,000 rate=275.9 MB/s
Wrote block=45000, file,blk=2,6854 VolBytes=23,592,960,000 rate=280.8 MB/s
Wrote block=50000, file,blk=2,11854 VolBytes=26,214,400,000 rate=281.8 MB/s
Wrote block=55000, file,blk=2,16854 VolBytes=28,835,840,000 rate=282.7 MB/s
Wrote block=60000, file,blk=2,21854 VolBytes=31,457,280,000 rate=285.9 MB/s
Wrote block=65000, file,blk=2,26854 VolBytes=34,078,720,000 rate=286.3 MB/s
Wrote block=70000, file,blk=2,31854 VolBytes=36,700,160,000 rate=288.9 MB/s
Wrote block=75000, file,blk=2,36854 VolBytes=39,321,600,000 rate=289.1 MB/s
Wrote block=80000, file,blk=3,3708 VolBytes=41,943,040,000 rate=281.4 MB/s
Wrote block=85000, file,blk=3,8708 VolBytes=44,564,480,000 rate=282.0 MB/s
Wrote block=90000, file,blk=3,13708 VolBytes=47,185,920,000 rate=282.5 MB/s
Wrote block=95000, file,blk=3,18708 VolBytes=49,807,360,000 rate=284.6 MB/s
Wrote block=100000, file,blk=3,23708 VolBytes=52,428,800,000 rate=284.9 MB/s
Wrote block=105000, file,blk=3,28708 VolBytes=55,050,240,000 rate=286.7 MB/s
Wrote block=110000, file,blk=3,33708 VolBytes=57,671,680,000 rate=282.7 MB/s
Wrote block=115000, file,blk=4,562 VolBytes=60,293,120,000 rate=281.7 MB/s
Wrote block=120000, file,blk=4,5562 VolBytes=62,914,560,000 rate=278.3 MB/s
Wrote block=125000, file,blk=4,10562 VolBytes=65,536,000,000 rate=280.0 MB/s
Wrote block=130000, file,blk=4,15562 VolBytes=68,157,440,000 rate=280.4 MB/s
Wrote block=135000, file,blk=4,20562 VolBytes=70,778,880,000 rate=280.8 MB/s
Wrote block=140000, file,blk=4,25562 VolBytes=73,400,320,000 rate=282.3 MB/s
Wrote block=145000, file,blk=4,30562 VolBytes=76,021,760,000 rate=282.6 MB/s
Wrote block=150000, file,blk=4,35562 VolBytes=78,643,200,000 rate=283.9 MB/s
Wrote block=155000, file,blk=5,2416 VolBytes=81,264,640,000 rate=279.2 MB/s
Wrote block=160000, file,blk=5,7416 VolBytes=83,886,080,000 rate=280.5 MB/s
Wrote block=165000, file,blk=5,12416 VolBytes=86,507,520,000 rate=280.8 MB/s
Wrote block=170000, file,blk=5,17416 VolBytes=89,128,960,000 rate=281.1 MB/s
Wrote block=175000, file,blk=5,22416 VolBytes=91,750,400,000 rate=282.3 MB/s
Wrote block=180000, file,blk=5,27416 VolBytes=94,371,840,000 rate=282.5 MB/s
Wrote block=185000, file,blk=5,32416 VolBytes=96,993,280,000 rate=283.6 MB/s
Wrote block=190000, file,blk=5,37416 VolBytes=99,614,720,000 rate=283.8 MB/s
Wrote block=195000, file,blk=6,4270 VolBytes=102,236,160,000 rate=280.0 MB/s
Wrote block=200000, file,blk=6,9270 VolBytes=104,857,600,000 rate=281.1 MB/s
Wrote block=205000, file,blk=6,14270 VolBytes=107,479,040,000 rate=281.3 MB/s
Wrote block=210000, file,blk=6,19270 VolBytes=110,100,480,000 rate=282.3 MB/s
Wrote block=215000, file,blk=6,24270 VolBytes=112,721,920,000 rate=280.4 MB/s
Wrote block=220000, file,blk=6,29270 VolBytes=115,343,360,000 rate=281.3 MB/s
Wrote block=225000, file,blk=6,34270 VolBytes=117,964,800,000 rate=281.5 MB/s
Wrote block=230000, file,blk=7,1124 VolBytes=120,586,240,000 rate=281.0 MB/s
Wrote block=235000, file,blk=7,6124 VolBytes=123,207,680,000 rate=279.3 MB/s
Wrote block=240000, file,blk=7,11124 VolBytes=125,829,120,000 rate=279.6 MB/s
Wrote block=245000, file,blk=7,16124 VolBytes=128,450,560,000 rate=280.4 MB/s
Wrote block=250000, file,blk=7,21124 VolBytes=131,072,000,000 rate=280.6 MB/s
Wrote block=255000, file,blk=7,26124 VolBytes=133,693,440,000 rate=281.4 MB/s
Wrote block=260000, file,blk=7,31124 VolBytes=136,314,880,000 rate=281.6 MB/s
Wrote block=265000, file,blk=7,36124 VolBytes=138,936,320,000 rate=281.8 MB/s
Wrote block=270000, file,blk=8,2978 VolBytes=141,557,760,000 rate=279.7 MB/s
Wrote block=275000, file,blk=8,7978 VolBytes=144,179,200,000 rate=279.9 MB/s
Wrote block=280000, file,blk=8,12978 VolBytes=146,800,640,000 rate=280.6 MB/s
Wrote block=285000, file,blk=8,17978 VolBytes=149,422,080,000 rate=280.8 MB/s
Wrote block=290000, file,blk=8,22978 VolBytes=152,043,520,000 rate=281.5 MB/s
Wrote block=295000, file,blk=8,27978 VolBytes=154,664,960,000 rate=281.7 MB/s
Wrote block=300000, file,blk=8,32978 VolBytes=157,286,400,000 rate=281.8 MB/s
Wrote block=305000, file,blk=8,37978 VolBytes=159,907,840,000 rate=282.5 MB/s
Wrote block=310000, file,blk=9,4832 VolBytes=162,529,280,000 rate=280.2 MB/s
Wrote block=315000, file,blk=9,9832 VolBytes=165,150,720,000 rate=280.8 MB/s
Wrote block=320000, file,blk=9,14832 VolBytes=167,772,160,000 rate=279.6 MB/s
Wrote block=325000, file,blk=9,19832 VolBytes=170,393,600,000 rate=280.2 MB/s
Wrote block=330000, file,blk=9,24832 VolBytes=173,015,040,000 rate=280.4 MB/s
Wrote block=335000, file,blk=9,29832 VolBytes=175,636,480,000 rate=281.0 MB/s
Wrote block=340000, file,blk=9,34832 VolBytes=178,257,920,000 rate=281.1 MB/s
Wrote block=345000, file,blk=10,1686 VolBytes=180,879,360,000 rate=279.1 MB/s
Wrote block=350000, file,blk=10,6686 VolBytes=183,500,800,000 rate=272.2 MB/s
Wrote block=355000, file,blk=10,11686 VolBytes=186,122,240,000 rate=265.8 MB/s
Wrote block=360000, file,blk=10,16686 VolBytes=188,743,680,000 rate=259.9 MB/s
Wrote block=365000, file,blk=10,21686 VolBytes=191,365,120,000 rate=254.4 MB/s
Wrote block=370000, file,blk=10,26686 VolBytes=193,986,560,000 rate=249.3 MB/s
Wrote block=375000, file,blk=10,31686 VolBytes=196,608,000,000 rate=244.8 MB/s
Wrote block=380000, file,blk=10,36686 VolBytes=199,229,440,000 rate=240.3 MB/s
Wrote block=385000, file,blk=11,3540 VolBytes=201,850,880,000 rate=235.2 MB/s
Wrote block=390000, file,blk=11,8540 VolBytes=204,472,320,000 rate=231.3 MB/s
Wrote block=395000, file,blk=11,13540 VolBytes=207,093,760,000 rate=227.8 MB/s
Wrote block=400000, file,blk=11,18540 VolBytes=209,715,200,000 rate=224.2 MB/s
Wrote block=405000, file,blk=11,23540 VolBytes=212,336,640,000 rate=220.9 MB/s
Wrote block=410000, file,blk=11,28540 VolBytes=214,958,080,000 rate=217.7 MB/s
Wrote block=415000, file,blk=11,33540 VolBytes=217,579,520,000 rate=214.7 MB/s
Wrote block=420000, file,blk=12,394 VolBytes=220,200,960,000 rate=211.1 MB/s
Wrote block=425000, file,blk=12,5394 VolBytes=222,822,400,000 rate=208.4 MB/s
Wrote block=430000, file,blk=12,10394 VolBytes=225,443,840,000 rate=205.8 MB/s
Wrote block=435000, file,blk=12,15394 VolBytes=228,065,280,000 rate=203.4 MB/s
Wrote block=440000, file,blk=12,20394 VolBytes=230,686,720,000 rate=201.1 MB/s
Wrote block=445000, file,blk=12,25394 VolBytes=233,308,160,000 rate=198.8 MB/s
Wrote block=450000, file,blk=12,30394 VolBytes=235,929,600,000 rate=196.7 MB/s
Wrote block=455000, file,blk=12,35394 VolBytes=238,551,040,000 rate=194.8 MB/s
Wrote block=460000, file,blk=13,2248 VolBytes=241,172,480,000 rate=192.4 MB/s
Wrote block=465000, file,blk=13,7248 VolBytes=243,793,920,000 rate=190.6 MB/s
Wrote block=470000, file,blk=13,12248 VolBytes=246,415,360,000 rate=188.9 MB/s
Wrote block=475000, file,blk=13,17248 VolBytes=249,036,800,000 rate=187.2 MB/s
Wrote block=480000, file,blk=13,22248 VolBytes=251,658,240,000 rate=185.5 MB/s
Wrote block=485000, file,blk=13,27248 VolBytes=254,279,680,000 rate=183.9 MB/s
Wrote block=490000, file,blk=13,32248 VolBytes=256,901,120,000 rate=182.4 MB/s
Wrote block=495000, file,blk=13,37248 VolBytes=259,522,560,000 rate=180.9 MB/s
Wrote block=500000, file,blk=14,4102 VolBytes=262,144,000,000 rate=179.3 MB/s
Wrote block=505000, file,blk=14,9102 VolBytes=264,765,440,000 rate=177.9 MB/s
Wrote block=510000, file,blk=14,14102 VolBytes=267,386,880,000 rate=176.6 MB/s
Wrote block=515000, file,blk=14,19102 VolBytes=270,008,320,000 rate=175.3 MB/s
Wrote block=520000, file,blk=14,24102 VolBytes=272,629,760,000 rate=174.0 MB/s
Wrote block=525000, file,blk=14,29102 VolBytes=275,251,200,000 rate=172.8 MB/s
Wrote block=530000, file,blk=14,34102 VolBytes=277,872,640,000 rate=171.5 MB/s
Wrote block=535000, file,blk=15,956 VolBytes=280,494,080,000 rate=170.2 MB/s
Wrote block=540000, file,blk=15,5956 VolBytes=283,115,520,000 rate=169.1 MB/s
Wrote block=545000, file,blk=15,10956 VolBytes=285,736,960,000 rate=168.0 MB/s
Wrote block=550000, file,blk=15,15956 VolBytes=288,358,400,000 rate=167.1 MB/s
Wrote block=555000, file,blk=15,20956 VolBytes=290,979,840,000 rate=166.1 MB/s
Wrote block=560000, file,blk=15,25956 VolBytes=293,601,280,000 rate=165.2 MB/s
Wrote block=565000, file,blk=15,30956 VolBytes=296,222,720,000 rate=164.2 MB/s
Wrote block=570000, file,blk=15,35956 VolBytes=298,844,160,000 rate=163.3 MB/s
Wrote block=575000, file,blk=16,2810 VolBytes=301,465,600,000 rate=162.3 MB/s
Wrote block=580000, file,blk=16,7810 VolBytes=304,087,040,000 rate=161.4 MB/s
Wrote block=585000, file,blk=16,12810 VolBytes=306,708,480,000 rate=160.6 MB/s
Wrote block=590000, file,blk=16,17810 VolBytes=309,329,920,000 rate=159.8 MB/s
Wrote block=595000, file,blk=16,22810 VolBytes=311,951,360,000 rate=159.0 MB/s
Wrote block=600000, file,blk=16,27810 VolBytes=314,572,800,000 rate=158.3 MB/s
Wrote block=605000, file,blk=16,32810 VolBytes=317,194,240,000 rate=157.5 MB/s
Wrote block=610000, file,blk=16,37810 VolBytes=319,815,680,000 rate=156.8 MB/s
13:20:18 Flush block, write EOF
Wrote block=615000, file,blk=17,4664 VolBytes=322,437,120,000 rate=155.9 MB/s
Wrote block=620000, file,blk=17,9664 VolBytes=325,058,560,000 rate=155.3 MB/s
Wrote block=625000, file,blk=17,14664 VolBytes=327,680,000,000 rate=154.6 MB/s
Wrote block=630000, file,blk=17,19664 VolBytes=330,301,440,000 rate=154.0 MB/s
Wrote block=635000, file,blk=17,24664 VolBytes=332,922,880,000 rate=153.2 MB/s
Wrote block=640000, file,blk=17,29664 VolBytes=335,544,320,000 rate=152.6 MB/s
Wrote block=645000, file,blk=17,34664 VolBytes=338,165,760,000 rate=152.0 MB/s
Wrote block=650000, file,blk=18,1518 VolBytes=340,787,200,000 rate=151.3 MB/s
Wrote block=655000, file,blk=18,6518 VolBytes=343,408,640,000 rate=150.7 MB/s
Wrote block=660000, file,blk=18,11518 VolBytes=346,030,080,000 rate=150.1 MB/s
Wrote block=665000, file,blk=18,16518 VolBytes=348,651,520,000 rate=149.6 MB/s
Wrote block=670000, file,blk=18,21518 VolBytes=351,272,960,000 rate=149.0 MB/s
Wrote block=675000, file,blk=18,26518 VolBytes=353,894,400,000 rate=148.5 MB/s
Wrote block=680000, file,blk=18,31518 VolBytes=356,515,840,000 rate=148.0 MB/s
Wrote block=685000, file,blk=18,36518 VolBytes=359,137,280,000 rate=147.5 MB/s
Wrote block=690000, file,blk=19,3372 VolBytes=361,758,720,000 rate=146.9 MB/s
Wrote block=695000, file,blk=19,8372 VolBytes=364,380,160,000 rate=146.4 MB/s
Wrote block=700000, file,blk=19,13372 VolBytes=367,001,600,000 rate=145.9 MB/s
Wrote block=705000, file,blk=19,18372 VolBytes=369,623,040,000 rate=145.5 MB/s
Wrote block=710000, file,blk=19,23372 VolBytes=372,244,480,000 rate=145.1 MB/s
Wrote block=715000, file,blk=19,28372 VolBytes=374,865,920,000 rate=144.6 MB/s
Wrote block=720000, file,blk=19,33372 VolBytes=377,487,360,000 rate=144.2 MB/s
Wrote block=725000, file,blk=20,226 VolBytes=380,108,800,000 rate=143.5 MB/s
Wrote block=730000, file,blk=20,5226 VolBytes=382,730,240,000 rate=143.2 MB/s
Wrote block=735000, file,blk=20,10226 VolBytes=385,351,680,000 rate=142.8 MB/s
Wrote block=740000, file,blk=20,15226 VolBytes=387,973,120,000 rate=142.3 MB/s
Wrote block=745000, file,blk=20,20226 VolBytes=390,594,560,000 rate=141.9 MB/s
Wrote block=750000, file,blk=20,25226 VolBytes=393,216,000,000 rate=141.5 MB/s
Wrote block=755000, file,blk=20,30226 VolBytes=395,837,440,000 rate=141.2 MB/s
Wrote block=760000, file,blk=20,35226 VolBytes=398,458,880,000 rate=140.8 MB/s
Wrote block=765000, file,blk=21,2080 VolBytes=401,080,320,000 rate=140.3 MB/s
Wrote block=770000, file,blk=21,7080 VolBytes=403,701,760,000 rate=140.0 MB/s
Wrote block=775000, file,blk=21,12080 VolBytes=406,323,200,000 rate=139.6 MB/s
Wrote block=780000, file,blk=21,17080 VolBytes=408,944,640,000 rate=139.3 MB/s
Wrote block=785000, file,blk=21,22080 VolBytes=411,566,080,000 rate=139.0 MB/s
Wrote block=790000, file,blk=21,27080 VolBytes=414,187,520,000 rate=138.7 MB/s
Wrote block=795000, file,blk=21,32080 VolBytes=416,808,960,000 rate=138.3 MB/s
Wrote block=800000, file,blk=21,37080 VolBytes=419,430,400,000 rate=138.0 MB/s
Wrote block=805000, file,blk=22,3934 VolBytes=422,051,840,000 rate=137.6 MB/s
Wrote block=810000, file,blk=22,8934 VolBytes=424,673,280,000 rate=137.3 MB/s
Wrote block=815000, file,blk=22,13934 VolBytes=427,294,720,000 rate=137.0 MB/s
Wrote block=820000, file,blk=22,18934 VolBytes=429,916,160,000 rate=136.7 MB/s
Wrote block=825000, file,blk=22,23934 VolBytes=432,537,600,000 rate=136.4 MB/s
Wrote block=830000, file,blk=22,28934 VolBytes=435,159,040,000 rate=136.1 MB/s
Wrote block=835000, file,blk=22,33934 VolBytes=437,780,480,000 rate=135.8 MB/s
Wrote block=840000, file,blk=23,788 VolBytes=440,401,920,000 rate=135.4 MB/s
Wrote block=845000, file,blk=23,5788 VolBytes=443,023,360,000 rate=135.1 MB/s
Wrote block=850000, file,blk=23,10788 VolBytes=445,644,800,000 rate=134.8 MB/s
Wrote block=855000, file,blk=23,15788 VolBytes=448,266,240,000 rate=134.6 MB/s
Wrote block=860000, file,blk=23,20788 VolBytes=450,887,680,000 rate=134.3 MB/s
Wrote block=865000, file,blk=23,25788 VolBytes=453,509,120,000 rate=134.1 MB/s
Wrote block=870000, file,blk=23,30788 VolBytes=456,130,560,000 rate=133.8 MB/s
Wrote block=875000, file,blk=23,35788 VolBytes=458,752,000,000 rate=133.6 MB/s
Wrote block=880000, file,blk=24,2642 VolBytes=461,373,440,000 rate=133.3 MB/s
Wrote block=885000, file,blk=24,7642 VolBytes=463,994,880,000 rate=133.0 MB/s
Wrote block=890000, file,blk=24,12642 VolBytes=466,616,320,000 rate=132.8 MB/s
Wrote block=895000, file,blk=24,17642 VolBytes=469,237,760,000 rate=132.5 MB/s
Wrote block=900000, file,blk=24,22642 VolBytes=471,859,200,000 rate=132.3 MB/s
Wrote block=905000, file,blk=24,27642 VolBytes=474,480,640,000 rate=132.1 MB/s
Wrote block=910000, file,blk=24,32642 VolBytes=477,102,080,000 rate=131.9 MB/s
Wrote block=915000, file,blk=24,37642 VolBytes=479,723,520,000 rate=131.6 MB/s
Wrote block=920000, file,blk=25,4496 VolBytes=482,344,960,000 rate=131.3 MB/s
Wrote block=925000, file,blk=25,9496 VolBytes=484,966,400,000 rate=131.1 MB/s
Wrote block=930000, file,blk=25,14496 VolBytes=487,587,840,000 rate=130.9 MB/s
Wrote block=935000, file,blk=25,19496 VolBytes=490,209,280,000 rate=130.7 MB/s
Wrote block=940000, file,blk=25,24496 VolBytes=492,830,720,000 rate=130.5 MB/s
Wrote block=945000, file,blk=25,29496 VolBytes=495,452,160,000 rate=130.3 MB/s
Wrote block=950000, file,blk=25,34496 VolBytes=498,073,600,000 rate=130.1 MB/s
Wrote block=955000, file,blk=26,1350 VolBytes=500,695,040,000 rate=129.8 MB/s
Wrote block=960000, file,blk=26,6350 VolBytes=503,316,480,000 rate=129.6 MB/s
Wrote block=965000, file,blk=26,11350 VolBytes=505,937,920,000 rate=129.4 MB/s
Wrote block=970000, file,blk=26,16350 VolBytes=508,559,360,000 rate=129.2 MB/s
Wrote block=975000, file,blk=26,21350 VolBytes=511,180,800,000 rate=129.0 MB/s
Wrote block=980000, file,blk=26,26350 VolBytes=513,802,240,000 rate=128.9 MB/s
Wrote block=985000, file,blk=26,31350 VolBytes=516,423,680,000 rate=128.7 MB/s
Wrote block=990000, file,blk=26,36350 VolBytes=519,045,120,000 rate=128.5 MB/s
Wrote block=995000, file,blk=27,3204 VolBytes=521,666,560,000 rate=128.2 MB/s
Wrote block=1000000, file,blk=27,8204 VolBytes=524,288,000,000 rate=128.1 MB/s
Wrote block=1005000, file,blk=27,13204 VolBytes=526,909,440,000 rate=127.9 MB/s
Wrote block=1010000, file,blk=27,18204 VolBytes=529,530,880,000 rate=127.7 MB/s
Wrote block=1015000, file,blk=27,23204 VolBytes=532,152,320,000 rate=127.6 MB/s
Wrote block=1020000, file,blk=27,28204 VolBytes=534,773,760,000 rate=127.4 MB/s
Wrote block=1025000, file,blk=27,33204 VolBytes=537,395,200,000 rate=127.3 MB/s
Wrote block=1030000, file,blk=28,58 VolBytes=540,016,640,000 rate=126.9 MB/s
Wrote block=1035000, file,blk=28,5058 VolBytes=542,638,080,000 rate=126.9 MB/s
Wrote block=1040000, file,blk=28,10058 VolBytes=545,259,520,000 rate=126.7 MB/s
Wrote block=1045000, file,blk=28,15058 VolBytes=547,880,960,000 rate=126.6 MB/s
Wrote block=1050000, file,blk=28,20058 VolBytes=550,502,400,000 rate=126.4 MB/s
Wrote block=1055000, file,blk=28,25058 VolBytes=553,123,840,000 rate=126.2 MB/s
Wrote block=1060000, file,blk=28,30058 VolBytes=555,745,280,000 rate=126.1 MB/s
Wrote block=1065000, file,blk=28,35058 VolBytes=558,366,720,000 rate=125.9 MB/s
Wrote block=1070000, file,blk=29,1912 VolBytes=560,988,160,000 rate=125.7 MB/s
Wrote block=1075000, file,blk=29,6912 VolBytes=563,609,600,000 rate=125.6 MB/s
Wrote block=1080000, file,blk=29,11912 VolBytes=566,231,040,000 rate=125.4 MB/s
Wrote block=1085000, file,blk=29,16912 VolBytes=568,852,480,000 rate=125.3 MB/s
Wrote block=1090000, file,blk=29,21912 VolBytes=571,473,920,000 rate=125.2 MB/s
Wrote block=1095000, file,blk=29,26912 VolBytes=574,095,360,000 rate=125.0 MB/s
Wrote block=1100000, file,blk=29,31912 VolBytes=576,716,800,000 rate=124.9 MB/s
Wrote block=1105000, file,blk=29,36912 VolBytes=579,338,240,000 rate=124.8 MB/s
Wrote block=1110000, file,blk=30,3766 VolBytes=581,959,680,000 rate=124.6 MB/s
Wrote block=1115000, file,blk=30,8766 VolBytes=584,581,120,000 rate=124.4 MB/s
Wrote block=1120000, file,blk=30,13766 VolBytes=587,202,560,000 rate=124.3 MB/s
Wrote block=1125000, file,blk=30,18766 VolBytes=589,824,000,000 rate=124.2 MB/s
Wrote block=1130000, file,blk=30,23766 VolBytes=592,445,440,000 rate=124.0 MB/s
Wrote block=1135000, file,blk=30,28766 VolBytes=595,066,880,000 rate=123.9 MB/s
Wrote block=1140000, file,blk=30,33766 VolBytes=597,688,320,000 rate=123.8 MB/s
Wrote block=1145000, file,blk=31,620 VolBytes=600,309,760,000 rate=123.6 MB/s
Wrote block=1150000, file,blk=31,5620 VolBytes=602,931,200,000 rate=123.5 MB/s
Wrote block=1155000, file,blk=31,10620 VolBytes=605,552,640,000 rate=123.4 MB/s
Wrote block=1160000, file,blk=31,15620 VolBytes=608,174,080,000 rate=123.2 MB/s
Wrote block=1165000, file,blk=31,20620 VolBytes=610,795,520,000 rate=123.1 MB/s
Wrote block=1170000, file,blk=31,25620 VolBytes=613,416,960,000 rate=123.0 MB/s
Wrote block=1175000, file,blk=31,30620 VolBytes=616,038,400,000 rate=122.9 MB/s
Wrote block=1180000, file,blk=31,35620 VolBytes=618,659,840,000 rate=122.8 MB/s
Wrote block=1185000, file,blk=32,2474 VolBytes=621,281,280,000 rate=122.6 MB/s
Wrote block=1190000, file,blk=32,7474 VolBytes=623,902,720,000 rate=122.5 MB/s
Wrote block=1195000, file,blk=32,12474 VolBytes=626,524,160,000 rate=122.4 MB/s
Wrote block=1200000, file,blk=32,17474 VolBytes=629,145,600,000 rate=122.3 MB/s
Wrote block=1205000, file,blk=32,22474 VolBytes=631,767,040,000 rate=122.2 MB/s
Wrote block=1210000, file,blk=32,27474 VolBytes=634,388,480,000 rate=122.1 MB/s
Wrote block=1215000, file,blk=32,32474 VolBytes=637,009,920,000 rate=122.0 MB/s
Wrote block=1220000, file,blk=32,37474 VolBytes=639,631,360,000 rate=121.9 MB/s
14:13:48 Flush block, write EOF
Wrote block=1225000, file,blk=33,4328 VolBytes=642,252,800,000 rate=121.7 MB/s
Wrote block=1230000, file,blk=33,9328 VolBytes=644,874,240,000 rate=121.6 MB/s
Wrote block=1235000, file,blk=33,14328 VolBytes=647,495,680,000 rate=121.5 MB/s
Wrote block=1240000, file,blk=33,19328 VolBytes=650,117,120,000 rate=121.4 MB/s
Wrote block=1245000, file,blk=33,24328 VolBytes=652,738,560,000 rate=121.3 MB/s
Wrote block=1250000, file,blk=33,29328 VolBytes=655,360,000,000 rate=121.2 MB/s
Wrote block=1255000, file,blk=33,34328 VolBytes=657,981,440,000 rate=121.1 MB/s
Wrote block=1260000, file,blk=34,1182 VolBytes=660,602,880,000 rate=120.9 MB/s
Wrote block=1265000, file,blk=34,6182 VolBytes=663,224,320,000 rate=120.8 MB/s
Wrote block=1270000, file,blk=34,11182 VolBytes=665,845,760,000 rate=120.7 MB/s
Wrote block=1275000, file,blk=34,16182 VolBytes=668,467,200,000 rate=120.7 MB/s
Wrote block=1280000, file,blk=34,21182 VolBytes=671,088,640,000 rate=120.6 MB/s
Wrote block=1285000, file,blk=34,26182 VolBytes=673,710,080,000 rate=120.5 MB/s
Wrote block=1290000, file,blk=34,31182 VolBytes=676,331,520,000 rate=120.4 MB/s
Wrote block=1295000, file,blk=34,36182 VolBytes=678,952,960,000 rate=120.3 MB/s
Wrote block=1300000, file,blk=35,3036 VolBytes=681,574,400,000 rate=120.2 MB/s
Wrote block=1305000, file,blk=35,8036 VolBytes=684,195,840,000 rate=120.1 MB/s
Wrote block=1310000, file,blk=35,13036 VolBytes=686,817,280,000 rate=120.0 MB/s
Wrote block=1315000, file,blk=35,18036 VolBytes=689,438,720,000 rate=119.9 MB/s
Wrote block=1320000, file,blk=35,23036 VolBytes=692,060,160,000 rate=119.8 MB/s
Wrote block=1325000, file,blk=35,28036 VolBytes=694,681,600,000 rate=119.7 MB/s
Wrote block=1330000, file,blk=35,33036 VolBytes=697,303,040,000 rate=119.7 MB/s
Wrote block=1335000, file,blk=35,38036 VolBytes=699,924,480,000 rate=119.6 MB/s
Wrote block=1340000, file,blk=36,4890 VolBytes=702,545,920,000 rate=119.4 MB/s
Wrote block=1345000, file,blk=36,9890 VolBytes=705,167,360,000 rate=119.3 MB/s
Wrote block=1350000, file,blk=36,14890 VolBytes=707,788,800,000 rate=119.3 MB/s
Wrote block=1355000, file,blk=36,19890 VolBytes=710,410,240,000 rate=119.2 MB/s
Wrote block=1360000, file,blk=36,24890 VolBytes=713,031,680,000 rate=119.1 MB/s
24-Apr 14:29 btape JobId 0: Error: stored/block.cc:803 Write error at 36:28754 o                                                   n device "LTO7-Tape-Drive" (/dev/nst0). ERR=Input/output error.
24-Apr 14:29 btape JobId 0: Error: stored/block.cc:822 Write error on fd=3 at fi                                                   le:blk 36:28754 on device "LTO7-Tape-Drive" (/dev/nst0). ERR=Input/output error.
24-Apr 14:29 btape JobId 0: Error: Error writing final EOF to tape. This Volume                                                    may not be readable.
backends/generic_tape_device.cc:403 ioctl MTWEOF error on "LTO7-Tape-Drive" (/de                                                   v/nst0). ERR=Input/output error.
btape: stored/btape.cc:2661-0 Last block at: 36:28753 this_dev_block_num=28754
btape: stored/btape.cc:2694-0 End of tape 36:28754. Volume Bytes=715,057,528,832                                                   . Write rate = 115.8 MB/s
btape: stored/btape.cc:2260-0 Wrote 1000 blocks on second tape. Done.
Done writing 0 records ...
btape: stored/btape.cc:2328-0 Wrote state file last_block_num1=28753 last_block_                                                   num2=0
btape: stored/btape.cc:2345-0

14:29:05 Done filling tape at 36:28754. Now beginning re-read of tape ...
btape: stored/btape.cc:2428-0 Enter do_unfill
24-Apr 14:29 btape JobId 0: Warning: stored/acquire.cc:294 Read open device "LTO                                                   7-Tape-Drive" (/dev/nst0) Volume "TestVolume1" failed: ERR=backends/generic_tape                                                   _device.cc:142 Unable to open device "LTO7-Tape-Drive" (/dev/nst0): ERR=Input/ou                                                   tput error

backends/generic_tape_device.cc:142 Unable to open device "LTO7-Tape-Drive" (/de                                                   v/nst0): ERR=Input/output error
Mount Volume "TestVolume1" on device "LTO7-Tape-Drive" (/dev/nst0) and press ret                                                   urn when ready:
24-Apr 15:19 btape JobId 0: Ready to read from volume "TestVolume1" on device "LTO7-Tape-Drive" (/dev/nst0).
Rewinding.
Reading the first 10000 records from 0:0.
10000 records read now at 1:626
Reposition from 1:626 to 36:28753
Reading block 28753.

The last block on the tape matches. Test succeeded.


Is the write error a problem of the tape?
Willl try an other one now ...

Frank Cherry

unread,
Apr 24, 2021, 12:13:37 PM4/24/21
to bareos-users
The test with an other tape ends:

have placed an other tape into drive, rewind and start the fill test:

[root@bareos ~]# mt -f /dev/st0 rewind
[root@bareos ~]# btape /dev/nst0
Tape block granularity is 1024 bytes.
btape: stored/butil.cc:293-0 Using device: "/dev/nst0" for writing.
btape: stored/btape.cc:481-0 open device "LTO7-Tape-Drive" (/dev/nst0): OK

*fill

This command simulates Bareos writing to a tape.
It requires either one or two blank tapes, which it
will label and write.

If you have an autochanger configured, it will use
the tapes that are in slots 1 and 2, otherwise, you will
be prompted to insert the tapes when necessary.

It will print a status approximately
every 322 MB, and write an EOF every 20.00 G.  If you have
selected the simple test option, after writing the first tape
it will rewind it and re-read the last block written.

If you have selected the multiple tape test, when the first tape
fills, it will ask for a second, and after writing a few more
blocks, it will stop.  Then it will begin re-reading the
two tapes.

This may take a long time -- hours! ...

Do you want to run the simplified test (s) with one tape
or the complete multiple tape (m) test: (s/m) s
Simple test (single tape) selected.
btape: stored/btape.cc:3000-0 Autochanger returned: 0
Mount blank Volume on device "LTO7-Tape-Drive" (/dev/nst0) and press return when ready:
btape: stored/btape.cc:3006-0
Wrote Volume label for volume "TestVolume1".
Wrote Start of Session label.
15:28:50 Begin writing Bareos records to tape ...
Wrote block=5000, file,blk=1,5000 VolBytes=2,621,440,000 rate=262.1 MB/s

Wrote block=10000, file,blk=1,10000 VolBytes=5,242,880,000 rate=275.9 MB/s
Wrote block=15000, file,blk=1,15000 VolBytes=7,864,320,000 rate=280.8 MB/s
Wrote block=20000, file,blk=1,20000 VolBytes=10,485,760,000 rate=291.2 MB/s

Wrote block=25000, file,blk=1,25000 VolBytes=13,107,200,000 rate=291.2 MB/s
Wrote block=30000, file,blk=1,30000 VolBytes=15,728,640,000 rate=296.7 MB/s

Wrote block=35000, file,blk=1,35000 VolBytes=18,350,080,000 rate=295.9 MB/s
Wrote block=40000, file,blk=2,1854 VolBytes=20,971,520,000 rate=275.9 MB/s
Wrote block=45000, file,blk=2,6854 VolBytes=23,592,960,000 rate=280.8 MB/s
Wrote block=50000, file,blk=2,11854 VolBytes=26,214,400,000 rate=281.8 MB/s
Wrote block=55000, file,blk=2,16854 VolBytes=28,835,840,000 rate=285.5 MB/s

Wrote block=60000, file,blk=2,21854 VolBytes=31,457,280,000 rate=285.9 MB/s
Wrote block=65000, file,blk=2,26854 VolBytes=34,078,720,000 rate=288.8 MB/s

Wrote block=70000, file,blk=2,31854 VolBytes=36,700,160,000 rate=288.9 MB/s
Wrote block=75000, file,blk=2,36854 VolBytes=39,321,600,000 rate=289.1 MB/s
Wrote block=80000, file,blk=3,3708 VolBytes=41,943,040,000 rate=281.4 MB/s
Wrote block=85000, file,blk=3,8708 VolBytes=44,564,480,000 rate=282.0 MB/s
Wrote block=90000, file,blk=3,13708 VolBytes=47,185,920,000 rate=284.2 MB/s

Wrote block=95000, file,blk=3,18708 VolBytes=49,807,360,000 rate=284.6 MB/s
Wrote block=100000, file,blk=3,23708 VolBytes=52,428,800,000 rate=284.9 MB/s
Wrote block=105000, file,blk=3,28708 VolBytes=55,050,240,000 rate=285.2 MB/s

Wrote block=110000, file,blk=3,33708 VolBytes=57,671,680,000 rate=282.7 MB/s
Wrote block=115000, file,blk=4,562 VolBytes=60,293,120,000 rate=281.7 MB/s
Wrote block=120000, file,blk=4,5562 VolBytes=62,914,560,000 rate=278.3 MB/s
Wrote block=125000, file,blk=4,10562 VolBytes=65,536,000,000 rate=278.8 MB/s
Wrote block=130000, file,blk=4,15562 VolBytes=68,157,440,000 rate=279.3 MB/s

Wrote block=135000, file,blk=4,20562 VolBytes=70,778,880,000 rate=280.8 MB/s
Wrote block=140000, file,blk=4,25562 VolBytes=73,400,320,000 rate=281.2 MB/s

Wrote block=145000, file,blk=4,30562 VolBytes=76,021,760,000 rate=282.6 MB/s
Wrote block=150000, file,blk=4,35562 VolBytes=78,643,200,000 rate=282.8 MB/s

Wrote block=155000, file,blk=5,2416 VolBytes=81,264,640,000 rate=279.2 MB/s
Wrote block=160000, file,blk=5,7416 VolBytes=83,886,080,000 rate=279.6 MB/s
Wrote block=165000, file,blk=5,12416 VolBytes=86,507,520,000 rate=279.9 MB/s

Wrote block=170000, file,blk=5,17416 VolBytes=89,128,960,000 rate=281.1 MB/s
Wrote block=175000, file,blk=5,22416 VolBytes=91,750,400,000 rate=281.4 MB/s

Wrote block=180000, file,blk=5,27416 VolBytes=94,371,840,000 rate=282.5 MB/s
Wrote block=185000, file,blk=5,32416 VolBytes=96,993,280,000 rate=282.7 MB/s
Wrote block=190000, file,blk=5,37416 VolBytes=99,614,720,000 rate=282.9 MB/s

Wrote block=195000, file,blk=6,4270 VolBytes=102,236,160,000 rate=280.0 MB/s
Wrote block=200000, file,blk=6,9270 VolBytes=104,857,600,000 rate=280.3 MB/s

Wrote block=205000, file,blk=6,14270 VolBytes=107,479,040,000 rate=281.3 MB/s
Wrote block=210000, file,blk=6,19270 VolBytes=110,100,480,000 rate=281.5 MB/s

Wrote block=215000, file,blk=6,24270 VolBytes=112,721,920,000 rate=280.4 MB/s
Wrote block=220000, file,blk=6,29270 VolBytes=115,343,360,000 rate=280.6 MB/s
Wrote block=225000, file,blk=6,34270 VolBytes=117,964,800,000 rate=280.8 MB/s
Wrote block=230000, file,blk=7,1124 VolBytes=120,586,240,000 rate=280.4 MB/s
Wrote block=235000, file,blk=7,6124 VolBytes=123,207,680,000 rate=278.7 MB/s

Wrote block=240000, file,blk=7,11124 VolBytes=125,829,120,000 rate=279.6 MB/s
Wrote block=245000, file,blk=7,16124 VolBytes=128,450,560,000 rate=279.8 MB/s
Wrote block=250000, file,blk=7,21124 VolBytes=131,072,000,000 rate=280.0 MB/s
Wrote block=255000, file,blk=7,26124 VolBytes=133,693,440,000 rate=280.8 MB/s
Wrote block=260000, file,blk=7,31124 VolBytes=136,314,880,000 rate=281.0 MB/s

Wrote block=265000, file,blk=7,36124 VolBytes=138,936,320,000 rate=281.8 MB/s
Wrote block=270000, file,blk=8,2978 VolBytes=141,557,760,000 rate=279.2 MB/s
Wrote block=275000, file,blk=8,7978 VolBytes=144,179,200,000 rate=279.4 MB/s
Wrote block=280000, file,blk=8,12978 VolBytes=146,800,640,000 rate=280.1 MB/s
Wrote block=285000, file,blk=8,17978 VolBytes=149,422,080,000 rate=280.3 MB/s
Wrote block=290000, file,blk=8,22978 VolBytes=152,043,520,000 rate=281.0 MB/s
Wrote block=295000, file,blk=8,27978 VolBytes=154,664,960,000 rate=281.2 MB/s

Wrote block=300000, file,blk=8,32978 VolBytes=157,286,400,000 rate=281.8 MB/s
Wrote block=305000, file,blk=8,37978 VolBytes=159,907,840,000 rate=282.0 MB/s
Wrote block=310000, file,blk=9,4832 VolBytes=162,529,280,000 rate=274.5 MB/s
Wrote block=315000, file,blk=9,9832 VolBytes=165,150,720,000 rate=267.2 MB/s
Wrote block=320000, file,blk=9,14832 VolBytes=167,772,160,000 rate=259.7 MB/s
Wrote block=325000, file,blk=9,19832 VolBytes=170,393,600,000 rate=253.5 MB/s
Wrote block=330000, file,blk=9,24832 VolBytes=173,015,040,000 rate=247.8 MB/s
Wrote block=335000, file,blk=9,29832 VolBytes=175,636,480,000 rate=242.5 MB/s
Wrote block=340000, file,blk=9,34832 VolBytes=178,257,920,000 rate=237.6 MB/s
Wrote block=345000, file,blk=10,1686 VolBytes=180,879,360,000 rate=232.4 MB/s
Wrote block=350000, file,blk=10,6686 VolBytes=183,500,800,000 rate=228.2 MB/s
Wrote block=355000, file,blk=10,11686 VolBytes=186,122,240,000 rate=224.2 MB/s
Wrote block=360000, file,blk=10,16686 VolBytes=188,743,680,000 rate=220.4 MB/s
Wrote block=365000, file,blk=10,21686 VolBytes=191,365,120,000 rate=216.9 MB/s
Wrote block=370000, file,blk=10,26686 VolBytes=193,986,560,000 rate=213.8 MB/s
Wrote block=375000, file,blk=10,31686 VolBytes=196,608,000,000 rate=210.7 MB/s
Wrote block=380000, file,blk=10,36686 VolBytes=199,229,440,000 rate=207.7 MB/s
Wrote block=385000, file,blk=11,3540 VolBytes=201,850,880,000 rate=204.3 MB/s
Wrote block=390000, file,blk=11,8540 VolBytes=204,472,320,000 rate=201.6 MB/s
Wrote block=395000, file,blk=11,13540 VolBytes=207,093,760,000 rate=199.3 MB/s
Wrote block=400000, file,blk=11,18540 VolBytes=209,715,200,000 rate=196.9 MB/s
Wrote block=405000, file,blk=11,23540 VolBytes=212,336,640,000 rate=194.6 MB/s
Wrote block=410000, file,blk=11,28540 VolBytes=214,958,080,000 rate=192.4 MB/s
Wrote block=415000, file,blk=11,33540 VolBytes=217,579,520,000 rate=190.3 MB/s
Wrote block=420000, file,blk=12,394 VolBytes=220,200,960,000 rate=187.4 MB/s
Wrote block=425000, file,blk=12,5394 VolBytes=222,822,400,000 rate=185.8 MB/s
Wrote block=430000, file,blk=12,10394 VolBytes=225,443,840,000 rate=184.0 MB/s
Wrote block=435000, file,blk=12,15394 VolBytes=228,065,280,000 rate=182.3 MB/s
Wrote block=440000, file,blk=12,20394 VolBytes=230,686,720,000 rate=180.6 MB/s
Wrote block=445000, file,blk=12,25394 VolBytes=233,308,160,000 rate=179.0 MB/s
Wrote block=450000, file,blk=12,30394 VolBytes=235,929,600,000 rate=177.5 MB/s
Wrote block=455000, file,blk=12,35394 VolBytes=238,551,040,000 rate=176.0 MB/s
Wrote block=460000, file,blk=13,2248 VolBytes=241,172,480,000 rate=174.3 MB/s
Wrote block=465000, file,blk=13,7248 VolBytes=243,793,920,000 rate=173.0 MB/s
Wrote block=470000, file,blk=13,12248 VolBytes=246,415,360,000 rate=171.7 MB/s
Wrote block=475000, file,blk=13,17248 VolBytes=249,036,800,000 rate=170.4 MB/s
Wrote block=480000, file,blk=13,22248 VolBytes=251,658,240,000 rate=169.2 MB/s
Wrote block=485000, file,blk=13,27248 VolBytes=254,279,680,000 rate=168.0 MB/s
Wrote block=490000, file,blk=13,32248 VolBytes=256,901,120,000 rate=166.9 MB/s
Wrote block=495000, file,blk=13,37248 VolBytes=259,522,560,000 rate=165.8 MB/s
Wrote block=500000, file,blk=14,4102 VolBytes=262,144,000,000 rate=164.5 MB/s
Wrote block=505000, file,blk=14,9102 VolBytes=264,765,440,000 rate=163.5 MB/s
Wrote block=510000, file,blk=14,14102 VolBytes=267,386,880,000 rate=162.5 MB/s
Wrote block=515000, file,blk=14,19102 VolBytes=270,008,320,000 rate=161.5 MB/s
Wrote block=520000, file,blk=14,24102 VolBytes=272,629,760,000 rate=160.6 MB/s
Wrote block=525000, file,blk=14,29102 VolBytes=275,251,200,000 rate=159.7 MB/s
Wrote block=530000, file,blk=14,34102 VolBytes=277,872,640,000 rate=158.6 MB/s
Wrote block=535000, file,blk=15,956 VolBytes=280,494,080,000 rate=157.6 MB/s
Wrote block=540000, file,blk=15,5956 VolBytes=283,115,520,000 rate=156.8 MB/s
Wrote block=545000, file,blk=15,10956 VolBytes=285,736,960,000 rate=156.0 MB/s
Wrote block=550000, file,blk=15,15956 VolBytes=288,358,400,000 rate=155.2 MB/s
Wrote block=555000, file,blk=15,20956 VolBytes=290,979,840,000 rate=154.5 MB/s
Wrote block=560000, file,blk=15,25956 VolBytes=293,601,280,000 rate=153.7 MB/s
Wrote block=565000, file,blk=15,30956 VolBytes=296,222,720,000 rate=153.0 MB/s
Wrote block=570000, file,blk=15,35956 VolBytes=298,844,160,000 rate=152.4 MB/s
Wrote block=575000, file,blk=16,2810 VolBytes=301,465,600,000 rate=151.5 MB/s
Wrote block=580000, file,blk=16,7810 VolBytes=304,087,040,000 rate=150.9 MB/s
Wrote block=585000, file,blk=16,12810 VolBytes=306,708,480,000 rate=150.2 MB/s
Wrote block=590000, file,blk=16,17810 VolBytes=309,329,920,000 rate=149.6 MB/s
Wrote block=595000, file,blk=16,22810 VolBytes=311,951,360,000 rate=149.1 MB/s
Wrote block=600000, file,blk=16,27810 VolBytes=314,572,800,000 rate=148.5 MB/s
Wrote block=605000, file,blk=16,32810 VolBytes=317,194,240,000 rate=147.9 MB/s
Wrote block=610000, file,blk=16,37810 VolBytes=319,815,680,000 rate=147.3 MB/s
16:05:08 Flush block, write EOF
Wrote block=615000, file,blk=17,4664 VolBytes=322,437,120,000 rate=146.6 MB/s
Wrote block=620000, file,blk=17,9664 VolBytes=325,058,560,000 rate=146.1 MB/s
Wrote block=625000, file,blk=17,14664 VolBytes=327,680,000,000 rate=145.6 MB/s
Wrote block=630000, file,blk=17,19664 VolBytes=330,301,440,000 rate=144.9 MB/s
Wrote block=635000, file,blk=17,24664 VolBytes=332,922,880,000 rate=144.4 MB/s
Wrote block=640000, file,blk=17,29664 VolBytes=335,544,320,000 rate=144.0 MB/s
Wrote block=645000, file,blk=17,34664 VolBytes=338,165,760,000 rate=143.5 MB/s
Wrote block=650000, file,blk=18,1518 VolBytes=340,787,200,000 rate=142.9 MB/s
Wrote block=655000, file,blk=18,6518 VolBytes=343,408,640,000 rate=142.4 MB/s
Wrote block=660000, file,blk=18,11518 VolBytes=346,030,080,000 rate=142.0 MB/s
Wrote block=665000, file,blk=18,16518 VolBytes=348,651,520,000 rate=141.6 MB/s
Wrote block=670000, file,blk=18,21518 VolBytes=351,272,960,000 rate=141.1 MB/s
Wrote block=675000, file,blk=18,26518 VolBytes=353,894,400,000 rate=140.7 MB/s
Wrote block=680000, file,blk=18,31518 VolBytes=356,515,840,000 rate=140.3 MB/s
Wrote block=685000, file,blk=18,36518 VolBytes=359,137,280,000 rate=139.9 MB/s
Wrote block=690000, file,blk=19,3372 VolBytes=361,758,720,000 rate=139.4 MB/s
Wrote block=695000, file,blk=19,8372 VolBytes=364,380,160,000 rate=139.0 MB/s
Wrote block=700000, file,blk=19,13372 VolBytes=367,001,600,000 rate=138.7 MB/s
Wrote block=705000, file,blk=19,18372 VolBytes=369,623,040,000 rate=138.3 MB/s
Wrote block=710000, file,blk=19,23372 VolBytes=372,244,480,000 rate=137.9 MB/s
Wrote block=715000, file,blk=19,28372 VolBytes=374,865,920,000 rate=137.6 MB/s
Wrote block=720000, file,blk=19,33372 VolBytes=377,487,360,000 rate=137.2 MB/s
Wrote block=725000, file,blk=20,226 VolBytes=380,108,800,000 rate=136.6 MB/s
Wrote block=730000, file,blk=20,5226 VolBytes=382,730,240,000 rate=136.4 MB/s
Wrote block=735000, file,blk=20,10226 VolBytes=385,351,680,000 rate=136.0 MB/s
Wrote block=740000, file,blk=20,15226 VolBytes=387,973,120,000 rate=135.7 MB/s
Wrote block=745000, file,blk=20,20226 VolBytes=390,594,560,000 rate=135.4 MB/s
Wrote block=750000, file,blk=20,25226 VolBytes=393,216,000,000 rate=135.1 MB/s
Wrote block=755000, file,blk=20,30226 VolBytes=395,837,440,000 rate=134.8 MB/s
Wrote block=760000, file,blk=20,35226 VolBytes=398,458,880,000 rate=134.5 MB/s
Wrote block=765000, file,blk=21,2080 VolBytes=401,080,320,000 rate=134.1 MB/s
Wrote block=770000, file,blk=21,7080 VolBytes=403,701,760,000 rate=133.8 MB/s
Wrote block=775000, file,blk=21,12080 VolBytes=406,323,200,000 rate=133.5 MB/s
Wrote block=780000, file,blk=21,17080 VolBytes=408,944,640,000 rate=133.2 MB/s
Wrote block=785000, file,blk=21,22080 VolBytes=411,566,080,000 rate=133.0 MB/s
Wrote block=790000, file,blk=21,27080 VolBytes=414,187,520,000 rate=132.7 MB/s
Wrote block=795000, file,blk=21,32080 VolBytes=416,808,960,000 rate=132.5 MB/s
Wrote block=800000, file,blk=21,37080 VolBytes=419,430,400,000 rate=132.2 MB/s
Wrote block=805000, file,blk=22,3934 VolBytes=422,051,840,000 rate=131.8 MB/s
Wrote block=810000, file,blk=22,8934 VolBytes=424,673,280,000 rate=131.6 MB/s
Wrote block=815000, file,blk=22,13934 VolBytes=427,294,720,000 rate=131.3 MB/s
Wrote block=820000, file,blk=22,18934 VolBytes=429,916,160,000 rate=131.1 MB/s
Wrote block=825000, file,blk=22,23934 VolBytes=432,537,600,000 rate=130.9 MB/s
Wrote block=830000, file,blk=22,28934 VolBytes=435,159,040,000 rate=130.7 MB/s
Wrote block=835000, file,blk=22,33934 VolBytes=437,780,480,000 rate=130.4 MB/s
Wrote block=840000, file,blk=23,788 VolBytes=440,401,920,000 rate=130.0 MB/s
Wrote block=845000, file,blk=23,5788 VolBytes=443,023,360,000 rate=129.8 MB/s
Wrote block=850000, file,blk=23,10788 VolBytes=445,644,800,000 rate=129.6 MB/s
Wrote block=855000, file,blk=23,15788 VolBytes=448,266,240,000 rate=129.4 MB/s
Wrote block=860000, file,blk=23,20788 VolBytes=450,887,680,000 rate=129.2 MB/s
Wrote block=865000, file,blk=23,25788 VolBytes=453,509,120,000 rate=129.0 MB/s
Wrote block=870000, file,blk=23,30788 VolBytes=456,130,560,000 rate=128.8 MB/s
Wrote block=875000, file,blk=23,35788 VolBytes=458,752,000,000 rate=128.6 MB/s
Wrote block=880000, file,blk=24,2642 VolBytes=461,373,440,000 rate=128.3 MB/s
Wrote block=885000, file,blk=24,7642 VolBytes=463,994,880,000 rate=128.1 MB/s
Wrote block=890000, file,blk=24,12642 VolBytes=466,616,320,000 rate=127.9 MB/s
Wrote block=895000, file,blk=24,17642 VolBytes=469,237,760,000 rate=127.7 MB/s
Wrote block=900000, file,blk=24,22642 VolBytes=471,859,200,000 rate=127.5 MB/s
Wrote block=905000, file,blk=24,27642 VolBytes=474,480,640,000 rate=127.3 MB/s
Wrote block=910000, file,blk=24,32642 VolBytes=477,102,080,000 rate=127.1 MB/s
Wrote block=915000, file,blk=24,37642 VolBytes=479,723,520,000 rate=127.0 MB/s
Wrote block=920000, file,blk=25,4496 VolBytes=482,344,960,000 rate=126.7 MB/s
Wrote block=925000, file,blk=25,9496 VolBytes=484,966,400,000 rate=126.5 MB/s
Wrote block=930000, file,blk=25,14496 VolBytes=487,587,840,000 rate=126.4 MB/s
Wrote block=935000, file,blk=25,19496 VolBytes=490,209,280,000 rate=126.2 MB/s
Wrote block=940000, file,blk=25,24496 VolBytes=492,830,720,000 rate=126.0 MB/s
Wrote block=945000, file,blk=25,29496 VolBytes=495,452,160,000 rate=125.8 MB/s
Wrote block=950000, file,blk=25,34496 VolBytes=498,073,600,000 rate=125.6 MB/s
Wrote block=955000, file,blk=26,1350 VolBytes=500,695,040,000 rate=125.4 MB/s
Wrote block=960000, file,blk=26,6350 VolBytes=503,316,480,000 rate=125.2 MB/s
Wrote block=965000, file,blk=26,11350 VolBytes=505,937,920,000 rate=125.1 MB/s
Wrote block=970000, file,blk=26,16350 VolBytes=508,559,360,000 rate=124.9 MB/s
Wrote block=975000, file,blk=26,21350 VolBytes=511,180,800,000 rate=124.8 MB/s
Wrote block=980000, file,blk=26,26350 VolBytes=513,802,240,000 rate=124.6 MB/s
Wrote block=985000, file,blk=26,31350 VolBytes=516,423,680,000 rate=124.5 MB/s
Wrote block=990000, file,blk=26,36350 VolBytes=519,045,120,000 rate=124.3 MB/s
Wrote block=995000, file,blk=27,3204 VolBytes=521,666,560,000 rate=124.1 MB/s
Wrote block=1000000, file,blk=27,8204 VolBytes=524,288,000,000 rate=124.0 MB/s
Wrote block=1005000, file,blk=27,13204 VolBytes=526,909,440,000 rate=123.8 MB/s
Wrote block=1010000, file,blk=27,18204 VolBytes=529,530,880,000 rate=123.7 MB/s
Wrote block=1015000, file,blk=27,23204 VolBytes=532,152,320,000 rate=123.6 MB/s
Wrote block=1020000, file,blk=27,28204 VolBytes=534,773,760,000 rate=123.4 MB/s
Wrote block=1025000, file,blk=27,33204 VolBytes=537,395,200,000 rate=123.3 MB/s
Wrote block=1030000, file,blk=28,58 VolBytes=540,016,640,000 rate=123.0 MB/s
Wrote block=1035000, file,blk=28,5058 VolBytes=542,638,080,000 rate=123.0 MB/s
Wrote block=1040000, file,blk=28,10058 VolBytes=545,259,520,000 rate=122.8 MB/s
Wrote block=1045000, file,blk=28,15058 VolBytes=547,880,960,000 rate=122.7 MB/s
Wrote block=1050000, file,blk=28,20058 VolBytes=550,502,400,000 rate=122.6 MB/s
Wrote block=1055000, file,blk=28,25058 VolBytes=553,123,840,000 rate=122.4 MB/s
Wrote block=1060000, file,blk=28,30058 VolBytes=555,745,280,000 rate=122.3 MB/s
Wrote block=1065000, file,blk=28,35058 VolBytes=558,366,720,000 rate=122.2 MB/s
Wrote block=1070000, file,blk=29,1912 VolBytes=560,988,160,000 rate=122.0 MB/s
Wrote block=1075000, file,blk=29,6912 VolBytes=563,609,600,000 rate=121.9 MB/s
Wrote block=1080000, file,blk=29,11912 VolBytes=566,231,040,000 rate=121.8 MB/s
Wrote block=1085000, file,blk=29,16912 VolBytes=568,852,480,000 rate=121.7 MB/s
Wrote block=1090000, file,blk=29,21912 VolBytes=571,473,920,000 rate=121.5 MB/s
Wrote block=1095000, file,blk=29,26912 VolBytes=574,095,360,000 rate=121.4 MB/s
Wrote block=1100000, file,blk=29,31912 VolBytes=576,716,800,000 rate=121.3 MB/s
Wrote block=1105000, file,blk=29,36912 VolBytes=579,338,240,000 rate=121.2 MB/s
Wrote block=1110000, file,blk=30,3766 VolBytes=581,959,680,000 rate=121.0 MB/s
Wrote block=1115000, file,blk=30,8766 VolBytes=584,581,120,000 rate=120.9 MB/s
Wrote block=1120000, file,blk=30,13766 VolBytes=587,202,560,000 rate=120.8 MB/s
Wrote block=1125000, file,blk=30,18766 VolBytes=589,824,000,000 rate=120.7 MB/s
Wrote block=1130000, file,blk=30,23766 VolBytes=592,445,440,000 rate=120.6 MB/s
Wrote block=1135000, file,blk=30,28766 VolBytes=595,066,880,000 rate=120.5 MB/s
Wrote block=1140000, file,blk=30,33766 VolBytes=597,688,320,000 rate=120.4 MB/s
Wrote block=1145000, file,blk=31,620 VolBytes=600,309,760,000 rate=120.2 MB/s
Wrote block=1150000, file,blk=31,5620 VolBytes=602,931,200,000 rate=120.2 MB/s
Wrote block=1155000, file,blk=31,10620 VolBytes=605,552,640,000 rate=120.0 MB/s
24-Apr 16:55 btape JobId 0: Error: stored/block.cc:803 Write error at 31:14657 on device "LTO7-Tape-Drive" (/dev/nst0). ERR=Input/output error.
24-Apr 16:55 btape JobId 0: Error: stored/block.cc:822 Write error on fd=3 at file:blk 31:14657 on device "LTO7-Tape-Drive" (/dev/nst0). ERR=Input/output error.
24-Apr 16:55 btape JobId 0: Error: Error writing final EOF to tape. This Volume may not be readable.
backends/generic_tape_device.cc:403 ioctl MTWEOF error on "LTO7-Tape-Drive" (/dev/nst0). ERR=Input/output error.
btape: stored/btape.cc:2661-0 Last block at: 31:14656 this_dev_block_num=14657
btape: stored/btape.cc:2694-0 End of tape 31:14657. Volume Bytes=607,669,190,656. Write rate = 116.2 MB/s

btape: stored/btape.cc:2260-0 Wrote 1000 blocks on second tape. Done.
Done writing 0 records ...
btape: stored/btape.cc:2328-0 Wrote state file last_block_num1=14656 last_block_num2=0
btape: stored/btape.cc:2345-0

16:55:56 Done filling tape at 31:14657. Now beginning re-read of tape ...

btape: stored/btape.cc:2428-0 Enter do_unfill

Rewinding.
Reading the first 10000 records from 0:0.
10000 records read now at 1:626
Reposition from 1:626 to 31:14656
Reading block 14656.


The last block on the tape matches. Test succeeded.

Conclusion:
Both tests are in common, that the data rate is hight at the beginning (ca. 290 MB/s) and slowes down during the test.
Below 120 MB/s a write error stops the test.

Can anyone explain please what could be the reason of decreasing the data rate and how can I solve this problem?

Thanks Frank

Frank Cherry

unread,
Apr 25, 2021, 11:10:14 AM4/25/21
to bareos-users
There are some kernel messages too:

[ 6882.814479] btape           D    0  6770   5665 0x00000320
[ 6882.814484] Call Trace:
[ 6882.814493]  __schedule+0x2e6/0x700
[ 6882.814497]  schedule+0x33/0xa0
[ 6882.814500]  schedule_timeout+0x205/0x330
[ 6882.814504]  ? __blk_mq_delay_run_hw_queue+0x14a/0x160
[ 6882.814508]  ? blk_mq_run_hw_queue+0x90/0x120
[ 6882.814510]  wait_for_completion+0xb7/0x140
[ 6882.814515]  ? wake_up_q+0x80/0x80
[ 6882.814522]  st_do_scsi.constprop.31+0x371/0x410 [st]
[ 6882.814527]  st_write+0x328/0xd80 [st]
[ 6882.814532]  ? common_file_perm+0x5e/0x140
[ 6882.814536]  __vfs_write+0x1b/0x40
[ 6882.814538]  vfs_write+0xab/0x1b0
[ 6882.814541]  ksys_write+0x61/0xe0
[ 6882.814544]  __x64_sys_write+0x1a/0x20
[ 6882.814547]  do_syscall_64+0x57/0x190
[ 6882.814551]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 6882.814554] RIP: 0033:0x7fb4698e0815
[ 6882.814561] Code: Bad RIP value.
[ 6882.814562] RSP: 002b:00007ffec86872d8 EFLAGS: 00000246 ORIG_RAX: 0000000000000001
[ 6882.814565] RAX: ffffffffffffffda RBX: 0000000001989f90 RCX: 00007fb4698e0815
[ 6882.814566] RDX: 0000000000080000 RSI: 000000000199b528 RDI: 0000000000000003
[ 6882.814568] RBP: 000000000199b528 R08: 00007ffec8687268 R09: 00007ffec8687260
[ 6882.814569] R10: 00000000608535d1 R11: 0000000000000246 R12: 0000000000080000
[ 6882.814570] R13: 0000000000000000 R14: 00007fb46abbaae0 R15: 0000000000080000
[ 6900.114207] st 9:0:0:0: [st0] Sense Key : Not Ready [current]
[ 6900.114212] st 9:0:0:0: [st0] Add. Sense: Warning - specified temperature exceeded
[ 6900.177340] st 9:0:0:0: [st0] Sense Key : Not Ready [current]
[ 6900.177343] st 9:0:0:0: [st0] Add. Sense: Warning - specified temperature exceeded

Frank Cherry

unread,
Apr 26, 2021, 2:11:14 AM4/26/21
to bareos-users
Problem solved:

st 9:0:0:0: [st0] Add. Sense: Warning - specified temperature exceeded

gaves me the hint: After checking the server and watching the fans with a endoscopic camera and closed cover inside the rack:

After starting the test, the speed of the fans goes up, but with increasing of the temperature, they lowered the speed instead of spooling up more.
Checking the the controller shows some damaged capacitors. After replacing the caps and simulating hot air with a hairdryer, the speed of the fans is now linear to the increasing temperature. The test is now running well and stable with a thruput of arounf 280 MB/s

Thanks and all the best, Frank

Christian Svensson

unread,
Apr 26, 2021, 3:09:03 AM4/26/21
to Frank Cherry, bareos-users
Impressive debugging and repair Frank!

So glad you managed to fix the problem. Happy I could help a little bit.

Best regards,

--
You received this message because you are subscribed to the Google Groups "bareos-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bareos-users...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/bareos-users/c6960e1c-6eda-4f9a-a382-baedbbf1e3ebn%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages