RAID5 suddenly died - RH6.2
The Archimage
I hate to post to these groups, but it was recommended by the local LUG
gurus that I do so.
Here's the scenario:
I have a Compaq Proliant 2500R, dual PPro 200's, a gig of EDO ECC RAM,
and an external Compaq F1 Raid array with nine 9.1 gig UW SCSI drives.
Several months ago (right when RH6.2 was released), I installed RH6.2 in
GUI mode, set up a 24 meg partition mounted on /boot, and the rest of
the array as /dev/md0, a RAID5 array, mounted on /.
The server was at a remote site, and I have to admit I didn't watch the
logs as closely as I should have. I ssh'd in on January 16th, and
noticed in /var/log/messages that a "disk failure" had occured on one of
the disks, and the array was continuing on 6 disks. I used
raidhotremove to remove the drive from the stripe set, and then
raidhotadd to add it back in and regenerate the stripe set. The server
crashed, showing a second drive "failed." I lost all the data on the
array.
Assuming I had a bad drive or drives, blew the machine away, formatted
the drives with an NT workstation install and format.com. The drives
formatted and scandisked fine, so I blew NT away and reinstalled RH6.2
with RAID5, checking for bad blocks, configured again as mentioned
above. The install didn't even finish before RAID errors were reported.
I figured maybe I had a bad CPU, so I replaced both just to be sure.
I called Compaq, and they told me to upgrade to the latest BIOS and
utilities, and then run the system erase utility. I did, then I ran the
latest compaq diagnostics. I ran two complete runs (took 66 hours), and
the machine, the CPUs, the memory, the SCSI controller, and the disks
all passed without a glitch. I figured I had it licked, so I
reinstalled RH6.2 again, with RAID5. It installed beautifully, ran for
a couple of hours fine, and then I started running kernel compiles in
six 10-cycle loops, one loop
on each console to stress test it.
Sure enough, a disk was marked bad and removed from the array.
I'm baffled. This setup ran fine for MONTHS. The machine tests fine
after ridiculously granular tests. But it can't keep striping going.
Any clues where to look next? I'm leaning towards bypassing the onboard
NCR SCSI card and putting an Adaptec 2940UW in a PCI slot and running
the array off of it.
One other thing. There are three fans that cool the dual CPUs - one
HUGE fan right beside the CPUs that vents out the back of the server,
and one CPU fan on each processor/heatsink. When this happened, there
was painting going on at the building where the server was, and the grit
from the painters had seized up the cpu fans. But, as I said, I figured
that the CPUs may have had a problem, so I replaced them, along with new
CPU fans. Unless they actually did overheat so badly that they burned
the CPU daughterboard somehow (I doubt that, they were not hot to the
touch - the huge case fan mounted over them was still blowing strong),
the CPUs should not be an issue. The new CPUs also passed the server
diagnostic run just fine.
Finally, I also tried this with RH7.0, with similar results. Diffferent
drives are marked bad and removed at random times. It's almost always
different drives, so I don't believe that there is anything worng with
the druves themselves. I can't imagine 7 drives going bad at the same
time.
Below are all of the log entries from this latest failure, and the
raidhotremove/raidhotadd commands:
Jan 26 06:05:10 archimage kernel: SCSI disk error : host 0 channel 0 id
3 lun 0 return code = 2
Jan 26 06:05:10 archimage kernel: scsidisk I/O error: dev 08:31, sector
1747688
Jan 26 06:05:10 archimage kernel: raid5: Disk failure on sdd1, disabling
device. Operation continuing on 6 devices
Jan 26 06:05:10 archimage kernel: md: recovery thread got woken up ...
Jan 26 06:05:10 archimage kernel: md0: no spare disk to reconstruct
array! -- continuing in degraded mode
Jan 26 06:05:10 archimage kernel: md: recovery thread finished ...
Jan 26 06:05:10 archimage kernel: md: updating md0 RAID superblock on
device
Jan 26 06:05:10 archimage kernel: sdg1 [events: 00000006](write) sdg1's
sb offset: 8807296
Jan 26 06:05:10 archimage kernel: sdf1 [events: 00000006](write) sdf1's
sb offset: 8807296
Jan 26 06:05:10 archimage kernel: sde1 [events: 00000006](write) sde1's
sb offset: 8807296
Jan 26 06:05:10 archimage kernel: (skipping faulty sdd1 )
Jan 26 06:05:10 archimage kernel: sdc1 [events: 00000006](write) sdc1's
sb offset: 8807296
Jan 26 06:05:10 archimage kernel: sdb1 [events: 00000006](write) sdb1's
sb offset: 8807296
Jan 26 06:05:10 archimage kernel: sda5 [events: 00000006](write) sda5's
sb offset: 8811520
Jan 26 06:05:10 archimage kernel: .
Jan 26 06:05:10 archimage kernel: raid5: restarting stripe 4849728
Jan 26 06:05:10 archimage kernel: raid5: restarting stripe 4849736
Jan 26 06:05:10 archimage kernel: raid5: restarting stripe 4849744
Jan 26 06:05:10 archimage kernel: raid5: restarting stripe 4849752
Jan 26 06:05:10 archimage kernel: raid5: restarting stripe 4849768
Jan 26 06:05:10 archimage kernel: raid5: restarting stripe 4849776
Jan 26 06:05:10 archimage kernel: raid5: restarting stripe 4849784
Jan 26 06:05:10 archimage kernel: raid5: restarting stripe 830136
Jan 26 06:05:10 archimage kernel: raid5: restarting stripe 4500184
Jan 26 06:05:10 archimage kernel: raid5: restarting stripe 2140888
Jan 26 06:05:10 archimage kernel: raid5: restarting stripe 2271976
Jan 26 06:05:10 archimage kernel: raid5: restarting stripe 1747688
Jan 26 06:05:10 archimage kernel: raid5: restarting stripe 1747696
Jan 26 06:05:10 archimage kernel: raid5: restarting stripe 1747704
Jan 26 06:05:10 archimage kernel: raid5: restarting stripe 3648
Jan 26 06:05:10 archimage kernel: raid5: restarting stripe 3656
Jan 26 06:05:10 archimage kernel: raid5: restarting stripe 3664
Jan 26 06:05:10 archimage kernel: raid5: restarting stripe 4723088
Jan 26 06:05:10 archimage kernel: raid5: restarting stripe 4723096
Jan 26 06:05:10 archimage kernel: raid5: restarting stripe 7387792
Jan 26 06:05:10 archimage kernel: raid5: restarting stripe 7493680
Jan 26 06:05:10 archimage kernel: raid5: restarting stripe 7493688
Jan 26 06:05:10 archimage kernel: raid5: restarting stripe 7406000
Jan 26 06:05:10 archimage kernel: raid5: restarting stripe 7406008
Jan 26 06:05:10 archimage kernel: raid5: restarting stripe 6728400
Jan 26 06:05:10 archimage kernel: raid5: restarting stripe 13068280
Jan 26 06:05:10 archimage kernel: raid5: restarting stripe 14985976
Jan 26 21:58:55 archimage kernel: trying to remove sdd1 from md0 ...
Jan 26 21:58:55 archimage kernel: RAID5 conf printout:
Jan 26 21:58:55 archimage kernel: --- rd:7 wd:6 fd:1
Jan 26 21:58:55 archimage kernel: disk 0, s:0, o:1, n:0 rd:0 us:1
dev:sdb1
Jan 26 21:58:55 archimage kernel: disk 1, s:0, o:1, n:1 rd:1 us:1
dev:sdc1
Jan 26 21:58:55 archimage kernel: disk 2, s:0, o:0, n:2 rd:2 us:1
dev:sdd1
Jan 26 21:58:55 archimage kernel: disk 3, s:0, o:1, n:3 rd:3 us:1
dev:sde1
Jan 26 21:58:55 archimage kernel: disk 4, s:0, o:1, n:4 rd:4 us:1
dev:sdf1
Jan 26 21:58:55 archimage kernel: disk 5, s:0, o:1, n:5 rd:5 us:1
dev:sdg1
Jan 26 21:58:55 archimage kernel: disk 6, s:0, o:1, n:6 rd:6 us:1
dev:sda5
Jan 26 21:58:55 archimage kernel: disk 7, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 26 21:58:55 archimage kernel: disk 8, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 26 21:58:55 archimage kernel: disk 9, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 26 21:58:55 archimage kernel: disk 10, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 26 21:58:55 archimage kernel: disk 11, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 26 21:58:55 archimage kernel: RAID5 conf printout:
Jan 26 21:58:55 archimage kernel: --- rd:7 wd:6 fd:1
Jan 26 21:58:55 archimage kernel: disk 0, s:0, o:1, n:0 rd:0 us:1
dev:sdb1
Jan 26 21:58:55 archimage kernel: disk 1, s:0, o:1, n:1 rd:1 us:1
dev:sdc1
Jan 26 21:58:55 archimage kernel: disk 2, s:0, o:0, n:2 rd:2 us:0
dev:[dev 00:00]
Jan 26 21:58:55 archimage kernel: disk 3, s:0, o:1, n:3 rd:3 us:1
dev:sde1
Jan 26 21:58:55 archimage kernel: disk 4, s:0, o:1, n:4 rd:4 us:1
dev:sdf1
Jan 26 21:58:55 archimage kernel: disk 5, s:0, o:1, n:5 rd:5 us:1
dev:sdg1
Jan 26 21:58:55 archimage kernel: disk 6, s:0, o:1, n:6 rd:6 us:1
dev:sda5
Jan 26 21:58:55 archimage kernel: disk 7, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 26 21:58:55 archimage kernel: disk 8, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 26 21:58:55 archimage kernel: disk 9, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 26 21:58:55 archimage kernel: disk 10, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 26 21:58:55 archimage kernel: disk 11, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 26 21:58:55 archimage kernel: unbind<sdd1,6>
Jan 26 21:58:55 archimage kernel: export_rdev(sdd1)
Jan 26 21:58:55 archimage kernel: md: updating md0 RAID superblock on
device
Jan 26 21:58:55 archimage kernel: sdg1 [events: 00000007](write) sdg1's
sb offset: 8807296
Jan 26 21:58:55 archimage kernel: md: updating md0 RAID superblock on
device
Jan 26 21:58:55 archimage kernel: sdg1 [events: 00000008](write) sdg1's
sb offset: 8807296
Jan 26 21:58:55 archimage kernel: sdf1 [events: 00000008](write) sdf1's
sb offset: 8807296
Jan 26 21:58:55 archimage kernel: sdf1 [events: 00000008](write) sdf1's
sb offset: 8807296
Jan 26 21:58:55 archimage kernel: sde1 [events: 00000008](write) sde1's
sb offset: 8807296
Jan 26 21:58:55 archimage kernel: sde1 [events: 00000008](write) sde1's
sb offset: 8807296
Jan 26 21:58:55 archimage kernel: sdc1 [events: 00000008](write) sdc1's
sb offset: 8807296
Jan 26 21:58:55 archimage kernel: sdc1 [events: 00000008](write) sdc1's
sb offset: 8807296
Jan 26 21:58:55 archimage kernel: sdb1 [events: 00000008](write) sdb1's
sb offset: 8807296
Jan 26 21:58:55 archimage kernel: sdb1 [events: 00000008](write) sdb1's
sb offset: 8807296
Jan 26 21:58:55 archimage kernel: sda5 [events: 00000008](write) sda5's
sb offset: 8811520
Jan 26 21:58:55 archimage kernel: sda5 [events: 00000008](write) sda5's
sb offset: 8811520
Jan 26 21:58:55 archimage kernel: .
Jan 26 21:58:55 archimage kernel: .
Jan 26 21:59:04 archimage kernel: trying to hot-add sdd1 to md0 ...
Jan 26 21:59:04 archimage kernel: bind<sdd1,7>
Jan 26 21:59:04 archimage kernel: RAID5 conf printout:
Jan 26 21:59:04 archimage kernel: --- rd:7 wd:6 fd:1
Jan 26 21:59:04 archimage kernel: disk 0, s:0, o:1, n:0 rd:0 us:1
dev:sdb1
Jan 26 21:59:04 archimage kernel: disk 1, s:0, o:1, n:1 rd:1 us:1
dev:sdc1
Jan 26 21:59:04 archimage kernel: disk 2, s:0, o:0, n:2 rd:2 us:0
dev:[dev 00:00]
Jan 26 21:59:04 archimage kernel: disk 3, s:0, o:1, n:3 rd:3 us:1
dev:sde1
Jan 26 21:59:04 archimage kernel: disk 4, s:0, o:1, n:4 rd:4 us:1
dev:sdf1
Jan 26 21:59:04 archimage kernel: disk 5, s:0, o:1, n:5 rd:5 us:1
dev:sdg1
Jan 26 21:59:04 archimage kernel: disk 6, s:0, o:1, n:6 rd:6 us:1
dev:sda5
Jan 26 21:59:04 archimage kernel: disk 7, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 26 21:59:05 archimage kernel: disk 8, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 26 21:59:05 archimage kernel: disk 9, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 26 21:59:05 archimage kernel: disk 10, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 26 21:59:05 archimage kernel: disk 11, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 26 21:59:05 archimage kernel: RAID5 conf printout:
Jan 26 21:59:05 archimage kernel: --- rd:7 wd:6 fd:1
Jan 26 21:59:05 archimage kernel: disk 0, s:0, o:1, n:0 rd:0 us:1
dev:sdb1
Jan 26 21:59:05 archimage kernel: disk 1, s:0, o:1, n:1 rd:1 us:1
dev:sdc1
Jan 26 21:59:05 archimage kernel: disk 2, s:0, o:0, n:2 rd:2 us:0
dev:[dev 00:00]
Jan 26 21:59:05 archimage kernel: disk 3, s:0, o:1, n:3 rd:3 us:1
dev:sde1
Jan 26 21:59:05 archimage kernel: disk 4, s:0, o:1, n:4 rd:4 us:1
dev:sdf1
Jan 26 21:59:05 archimage kernel: disk 5, s:0, o:1, n:5 rd:5 us:1
dev:sdg1
Jan 26 21:59:05 archimage kernel: disk 6, s:0, o:1, n:6 rd:6 us:1
dev:sda5
Jan 26 21:59:05 archimage kernel: disk 7, s:1, o:0, n:7 rd:7 us:1
dev:sdd1
Jan 26 21:59:05 archimage kernel: disk 8, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 26 21:59:05 archimage kernel: disk 9, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 26 21:59:05 archimage kernel: disk 10, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 26 21:59:05 archimage kernel: disk 11, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 26 21:59:05 archimage kernel: md: updating md0 RAID superblock on
device
Jan 26 21:59:05 archimage kernel: sdd1 [events: 00000009](write) sdd1's
sb offset: 8807296
Jan 26 21:59:05 archimage kernel: md: updating md0 RAID superblock on
device
Jan 26 21:59:05 archimage kernel: sdd1 [events: 0000000a](write) sdd1's
sb offset: 8807296
Jan 26 21:59:05 archimage kernel: sdg1 [events: 0000000a](write) sdg1's
sb offset: 8807296
Jan 26 21:59:05 archimage kernel: sdg1 [events: 0000000a](write) sdg1's
sb offset: 8807296
Jan 26 21:59:05 archimage kernel: sdf1 [events: 0000000a](write) sdf1's
sb offset: 8807296
Jan 26 21:59:05 archimage kernel: sdf1 [events: 0000000a](write) sdf1's
sb offset: 8807296
Jan 26 21:59:05 archimage kernel: sde1 [events: 0000000a](write) sde1's
sb offset: 8807296
Jan 26 21:59:05 archimage kernel: sde1 [events: 0000000a](write) sde1's
sb offset: 8807296
Jan 26 21:59:05 archimage kernel: sdc1 [events: 0000000a](write) sdc1's
sb offset: 8807296
Jan 26 21:59:05 archimage kernel: sdc1 [events: 0000000a](write) sdc1's
sb offset: 8807296
Jan 26 21:59:06 archimage kernel: sdb1 [events: 0000000a](write) sdb1's
sb offset: 8807296
Jan 26 21:59:06 archimage kernel: sdb1 [events: 0000000a](write) sdb1's
sb offset: 8807296
Jan 26 21:59:06 archimage kernel: sda5 [events: 0000000a](write) sda5's
sb offset: 8811520
Jan 26 21:59:06 archimage kernel: sda5 [events: 0000000a](write) sda5's
sb offset: 8811520
Jan 26 21:59:06 archimage kernel: .
Jan 26 21:59:06 archimage kernel: .
Jan 26 21:59:06 archimage kernel: md: recovery thread got woken up ...
Jan 26 21:59:06 archimage kernel: md0: resyncing spare disk sdd1 to
replace failed disk
Jan 26 21:59:06 archimage kernel: RAID5 conf printout:
Jan 26 21:59:06 archimage kernel: --- rd:7 wd:6 fd:1
Jan 26 21:59:06 archimage kernel: disk 0, s:0, o:1, n:0 rd:0 us:1
dev:sdb1
Jan 26 21:59:06 archimage kernel: disk 1, s:0, o:1, n:1 rd:1 us:1
dev:sdc1
Jan 26 21:59:06 archimage kernel: disk 2, s:0, o:0, n:2 rd:2 us:0
dev:[dev 00:00]
Jan 26 21:59:06 archimage kernel: disk 3, s:0, o:1, n:3 rd:3 us:1
dev:sde1
Jan 26 21:59:06 archimage kernel: disk 4, s:0, o:1, n:4 rd:4 us:1
dev:sdf1
Jan 26 21:59:06 archimage kernel: disk 5, s:0, o:1, n:5 rd:5 us:1
dev:sdg1
Jan 26 21:59:06 archimage kernel: disk 6, s:0, o:1, n:6 rd:6 us:1
dev:sda5
Jan 26 21:59:06 archimage kernel: disk 7, s:1, o:0, n:7 rd:7 us:1
dev:sdd1
Jan 26 21:59:06 archimage kernel: disk 8, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 26 21:59:06 archimage kernel: disk 9, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 26 21:59:06 archimage kernel: disk 10, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 26 21:59:06 archimage kernel: disk 11, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 26 21:59:06 archimage kernel: RAID5 conf printout:
Jan 26 21:59:06 archimage kernel: --- rd:7 wd:6 fd:1
Jan 26 21:59:06 archimage kernel: disk 0, s:0, o:1, n:0 rd:0 us:1
dev:sdb1
Jan 26 21:59:06 archimage kernel: disk 1, s:0, o:1, n:1 rd:1 us:1
dev:sdc1
Jan 26 21:59:06 archimage kernel: disk 2, s:0, o:0, n:2 rd:2 us:0
dev:[dev 00:00]
Jan 26 21:59:06 archimage kernel: disk 3, s:0, o:1, n:3 rd:3 us:1
dev:sde1
Jan 26 21:59:06 archimage kernel: disk 4, s:0, o:1, n:4 rd:4 us:1
dev:sdf1
Jan 26 21:59:06 archimage kernel: disk 5, s:0, o:1, n:5 rd:5 us:1
dev:sdg1
Jan 26 21:59:06 archimage kernel: disk 6, s:0, o:1, n:6 rd:6 us:1
dev:sda5
Jan 26 21:59:06 archimage kernel: disk 7, s:1, o:1, n:7 rd:7 us:1
dev:sdd1
Jan 26 21:59:06 archimage kernel: disk 8, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 26 21:59:06 archimage kernel: disk 9, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 26 21:59:06 archimage kernel: disk 10, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 26 21:59:06 archimage kernel: disk 11, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 26 21:59:06 archimage kernel: md: syncing RAID array md0
Jan 26 21:59:06 archimage kernel: md: minimum _guaranteed_
reconstruction speed: 100 KB/sec.
Jan 26 21:59:06 archimage kernel: md: using maximum available idle IO
bandwith for reconstruction.
Jan 26 21:59:06 archimage kernel: md: using 1536k window.
Jan 27 00:03:24 archimage kernel: md: md0: sync done.
Jan 27 00:03:24 archimage kernel: RAID5 conf printout:
Jan 27 00:03:24 archimage kernel: --- rd:7 wd:6 fd:1
Jan 27 00:03:24 archimage kernel: disk 0, s:0, o:1, n:0 rd:0 us:1
dev:sdb1
Jan 27 00:03:24 archimage kernel: disk 1, s:0, o:1, n:1 rd:1 us:1
dev:sdc1
Jan 27 00:03:24 archimage kernel: disk 2, s:0, o:0, n:2 rd:2 us:0
dev:[dev 00:00]
Jan 27 00:03:24 archimage kernel: disk 3, s:0, o:1, n:3 rd:3 us:1
dev:sde1
Jan 27 00:03:24 archimage kernel: disk 4, s:0, o:1, n:4 rd:4 us:1
dev:sdf1
Jan 27 00:03:24 archimage kernel: disk 5, s:0, o:1, n:5 rd:5 us:1
dev:sdg1
Jan 27 00:03:24 archimage kernel: disk 6, s:0, o:1, n:6 rd:6 us:1
dev:sda5
Jan 27 00:03:24 archimage kernel: disk 7, s:1, o:1, n:7 rd:7 us:1
dev:sdd1
Jan 27 00:03:24 archimage kernel: disk 8, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 27 00:03:24 archimage kernel: disk 9, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 27 00:03:24 archimage kernel: disk 10, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 27 00:03:24 archimage kernel: disk 11, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 27 00:03:24 archimage kernel: RAID5 conf printout:
Jan 27 00:03:24 archimage kernel: --- rd:7 wd:7 fd:0
Jan 27 00:03:24 archimage kernel: disk 0, s:0, o:1, n:0 rd:0 us:1
dev:sdb1
Jan 27 00:03:24 archimage kernel: disk 1, s:0, o:1, n:1 rd:1 us:1
dev:sdc1
Jan 27 00:03:24 archimage kernel: disk 2, s:0, o:1, n:2 rd:2 us:1
dev:sdd1
Jan 27 00:03:24 archimage kernel: disk 3, s:0, o:1, n:3 rd:3 us:1
dev:sde1
Jan 27 00:03:24 archimage kernel: disk 4, s:0, o:1, n:4 rd:4 us:1
dev:sdf1
Jan 27 00:03:24 archimage kernel: disk 5, s:0, o:1, n:5 rd:5 us:1
dev:sdg1
Jan 27 00:03:24 archimage kernel: disk 6, s:0, o:1, n:6 rd:6 us:1
dev:sda5
Jan 27 00:03:24 archimage kernel: disk 7, s:0, o:0, n:7 rd:7 us:0
dev:[dev 00:00]
Jan 27 00:03:24 archimage kernel: disk 8, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 27 00:03:24 archimage kernel: disk 9, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 27 00:03:24 archimage kernel: disk 10, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 27 00:03:24 archimage kernel: disk 11, s:0, o:0, n:0 rd:0 us:0
dev:[dev 00:00]
Jan 27 00:03:24 archimage kernel: md: updating md0 RAID superblock on
device
Jan 27 00:03:24 archimage kernel: sdd1 [events: 0000000b](write) sdd1's
sb offset: 8807296
Jan 27 00:03:24 archimage kernel: md: updating md0 RAID superblock on
device
Jan 27 00:03:24 archimage kernel: sdd1 [events: 0000000c](write) sdd1's
sb offset: 8807296
Jan 27 00:03:24 archimage kernel: sdg1 [events: 0000000c](write) sdg1's
sb offset: 8807296
Jan 27 00:03:24 archimage kernel: sdg1 [events: 0000000c](write) sdg1's
sb offset: 8807296
Jan 27 00:03:24 archimage kernel: sdf1 [events: 0000000c](write) sdf1's
sb offset: 8807296
Jan 27 00:03:24 archimage kernel: sdf1 [events: 0000000c](write) sdf1's
sb offset: 8807296
Jan 27 00:03:25 archimage kernel: sde1 [events: 0000000c](write) sde1's
sb offset: 8807296
Jan 27 00:03:25 archimage kernel: sde1 [events: 0000000c](write) sde1's
sb offset: 8807296
Jan 27 00:03:25 archimage kernel: sdc1 [events: 0000000c](write) sdc1's
sb offset: 8807296
Jan 27 00:03:25 archimage kernel: sdc1 [events: 0000000c](write) sdc1's
sb offset: 8807296
Jan 27 00:03:25 archimage kernel: sdb1 [events: 0000000c](write) sdb1's
sb offset: 8807296
Jan 27 00:03:25 archimage kernel: sdb1 [events: 0000000c](write) sdb1's
sb offset: 8807296
Jan 27 00:03:25 archimage kernel: sda5 [events: 0000000c](write) sda5's
sb offset: 8811520
Jan 27 00:03:25 archimage kernel: .
Jan 27 00:03:25 archimage kernel: sda5 [events: 0000000c](write) sda5's
sb offset: 8811520
Jan 27 00:03:25 archimage kernel: .
Jan 27 00:03:25 archimage kernel: md: recovery thread finished ...
Thaks in advance, all.
Thomas Cameron
-------------------------------------------------------------------
Red Hat Certified Engineer -- TurboLinux Certified Trainer
-- Novell Certified NetWare Engineer --
Microsoft Certified Systems Engineer -- Microsoft Certified Trainer
-------------------------------------------------------------------