Linux Soft RAID 及其 UUID 的问题

Chowroc

上次装的一个系统，使用了 SOFT RAID1：
sh# cat /proc/mdstat
md0 : active raid1 sdc1[0] sdb1[1] sda1[3]
      521984 blocks [4/3] [UU_U]

md2 : active raid1 sdc2[1]
      310994176 blocks [2/1] [_U]

md1 : active raid1 sdb2[1] sda2[0]
      310994176 blocks [2/2] [UU]

unused devices: <none>

开始运行良好。后来换机房，把服务器那过去开始出问题，下面是 /var/log/messages 截取的日志：
Nov 26 20:10:37 wd02 kernel: ata3: exception Emask 0x10 SAct 0x0 SErr 0x90200 action 0x6 frozen
Nov 26 20:10:37 wd02 kernel: ata3: (irq_stat 0x00400000, PHY RDY changed)
Nov 26 20:10:37 wd02 kernel: ata4: exception Emask 0x10 SAct 0x0 SErr 0x90200 action 0x6 frozen
Nov 26 20:10:37 wd02 kernel: ata4: (irq_stat 0x00400000, PHY RDY changed)
Nov 26 20:10:37 wd02 kernel: ata3: waiting for device to spin up (8 secs)
Nov 26 20:10:37 wd02 kernel: ata4: waiting for device to spin up (8 secs)
Nov 26 20:10:45 wd02 kernel: ata3: hard resetting port
Nov 26 20:10:45 wd02 kernel: ata4: hard resetting port
Nov 26 20:10:45 wd02 kernel: ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Nov 26 20:10:45 wd02 kernel: ata4: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Nov 26 20:10:45 wd02 kernel: ata3.00: configured for UDMA/133
Nov 26 20:10:45 wd02 kernel: ata3: EH complete
Nov 26 20:10:45 wd02 kernel: ata4.00: configured for UDMA/133
Nov 26 20:10:45 wd02 kernel: ata4: EH complete
Nov 26 20:10:45 wd02 kernel: SCSI device sdc: 625142448 512-byte hdwr sectors (320073 MB)
Nov 26 20:10:45 wd02 kernel: sdc: Write Protect is off
Nov 26 20:10:45 wd02 kernel: SCSI device sdc: drive cache: write back
Nov 26 20:10:45 wd02 kernel: SCSI device sdd: 625142448 512-byte hdwr sectors (320073 MB)
Nov 26 20:10:45 wd02 kernel: sdd: Write Protect is off
Nov 26 20:10:45 wd02 kernel: SCSI device sdd: drive cache: write back
......
Nov 27 14:33:26 wd02 kernel: ahci 0000:00:12.0: AHCI 0001.0100 32 slots 4 ports 3 Gbps 0xf impl SATA mode
Nov 27 14:33:26 wd02 kernel: ahci 0000:00:12.0: flags: 64bit ncq ilck pm led clo pmp pio slum part
Nov 27 14:33:26 wd02 kernel: ata1: SATA max UDMA/133 cmd 0xF8846100 ctl 0x0 bmdma 0x0 irq 201
Nov 27 14:33:26 wd02 kernel: ata2: SATA max UDMA/133 cmd 0xF8846180 ctl 0x0 bmdma 0x0 irq 201
Nov 27 14:33:26 wd02 kernel: ata3: SATA max UDMA/133 cmd 0xF8846200 ctl 0x0 bmdma 0x0 irq 201
Nov 27 14:33:26 wd02 kernel: ata4: SATA max UDMA/133 cmd 0xF8846280 ctl 0x0 bmdma 0x0 irq 201
Nov 27 14:33:26 wd02 kernel: scsi0 : ahci
Nov 27 14:33:26 wd02 kernel: ata1: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Nov 27 14:33:26 wd02 kernel: ata1.00: ATA-7, max UDMA/133, 625140335 sectors: LBA48 NCQ (depth 31/32)
Nov 27 14:33:26 wd02 kernel: ata1.00: ata1: dev 0 multi count 16
Nov 27 14:33:26 wd02 kernel: ata1.00: configured for UDMA/133
Nov 27 14:33:26 wd02 kernel: scsi1 : ahci
Nov 27 14:33:26 wd02 kernel: ata2: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Nov 27 14:33:26 wd02 kernel: ata2.00: ATA-7, max UDMA/133, 625142448 sectors: LBA48 NCQ (depth 31/32)
Nov 27 14:33:26 wd02 kernel: ata2.00: ata2: dev 0 multi count 16
Nov 27 14:33:26 wd02 kernel: ata2.00: configured for UDMA/133
Nov 27 14:33:26 wd02 kernel: scsi2 : ahci
Nov 27 14:33:26 wd02 kernel: ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Nov 27 14:33:26 wd02 kernel: ata3.00: ATA-7, max UDMA/133, 625142448 sectors: LBA48 NCQ (depth 31/32)
Nov 27 14:33:26 wd02 kernel: ata3.00: ata3: dev 0 multi count 16
Nov 27 14:33:26 wd02 kernel: ata3.00: configured for UDMA/133
Nov 27 14:33:26 wd02 kernel: scsi3 : ahci
Nov 27 14:33:26 wd02 kernel: ata4: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Nov 27 14:33:26 wd02 kernel: ata4.00: ATA-7, max UDMA/133, 625142448 sectors: LBA48 NCQ (depth 31/32)
Nov 27 14:33:26 wd02 kernel: ata4.00: ata4: dev 0 multi count 16
Nov 27 14:33:26 wd02 kernel: ata4.00: configured for UDMA/133
Nov 27 14:33:26 wd02 kernel:   Vendor: ATA       Model: ST3320620AS       Rev: 3.AA
Nov 27 14:33:26 wd02 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 05
Nov 27 14:33:26 wd02 kernel: SCSI device sda: 625140335 512-byte hdwr sectors (320072 MB)
Nov 27 14:33:26 wd02 kernel: sda: Write Protect is off
Nov 27 14:33:26 wd02 kernel: SCSI device sda: drive cache: write back
Nov 27 14:33:26 wd02 kernel: SCSI device sda: 625140335 512-byte hdwr sectors (320072 MB)
Nov 27 14:33:26 wd02 kernel: sda: Write Protect is off
Nov 27 14:33:26 wd02 kernel: SCSI device sda: drive cache: write back
Nov 27 14:33:26 wd02 kernel:  sda: sda1 sda2 sda3
Nov 27 14:33:26 wd02 kernel: sd 0:0:0:0: Attached scsi disk sda
Nov 27 14:33:26 wd02 kernel:   Vendor: ATA       Model: ST3320620AS       Rev: 3.AA
Nov 27 14:33:26 wd02 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 05
Nov 27 14:33:26 wd02 kernel: SCSI device sdb: 625142448 512-byte hdwr sectors (320073 MB)
Nov 27 14:33:26 wd02 kernel: sdb: Write Protect is off
Nov 27 14:33:26 wd02 kernel: SCSI device sdb: drive cache: write back
Nov 27 14:33:26 wd02 kernel: SCSI device sdb: 625142448 512-byte hdwr sectors (320073 MB)
Nov 27 14:33:26 wd02 kernel: sdb: Write Protect is off
Nov 27 14:33:26 wd02 kernel: SCSI device sdb: drive cache: write back
Nov 27 14:33:26 wd02 kernel:  sdb: sdb1 sdb2 sdb3
Nov 27 14:33:26 wd02 kernel: sd 1:0:0:0: Attached scsi disk sdb
Nov 27 14:33:26 wd02 kernel:   Vendor: ATA       Model: ST3320620AS       Rev: 3.AA
Nov 27 14:33:26 wd02 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 05
Nov 27 14:33:26 wd02 kernel: SCSI device sdc: 625142448 512-byte hdwr sectors (320073 MB)
Nov 27 14:33:26 wd02 kernel: sdc: Write Protect is off
Nov 27 14:33:26 wd02 kernel: SCSI device sdc: drive cache: write back
Nov 27 14:33:26 wd02 kernel: SCSI device sdc: 625142448 512-byte hdwr sectors (320073 MB)
Nov 27 14:33:26 wd02 kernel: sdc: Write Protect is off
Nov 27 14:33:26 wd02 kernel: SCSI device sdc: drive cache: write back
Nov 27 14:33:26 wd02 kernel:  sdc: sdc1 sdc2 sdc3
Nov 27 14:33:26 wd02 kernel: sd 2:0:0:0: Attached scsi disk sdc
Nov 27 14:33:26 wd02 kernel:   Vendor: ATA       Model: ST3320620AS       Rev: 3.AA
Nov 27 14:33:26 wd02 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 05
Nov 27 14:33:26 wd02 kernel: SCSI device sdd: 625142448 512-byte hdwr sectors (320073 MB)
Nov 27 14:33:26 wd02 kernel: sdd: Write Protect is off
Nov 27 14:33:26 wd02 kernel: SCSI device sdd: drive cache: write back
Nov 27 14:33:26 wd02 kernel: SCSI device sdd: 625142448 512-byte hdwr sectors (320073 MB)
Nov 27 14:33:26 wd02 kernel: sdd: Write Protect is off
Nov 27 14:33:26 wd02 kernel: SCSI device sdd: drive cache: write back
Nov 27 14:33:26 wd02 kernel:  sdd: sdd1 sdd2 sdd3
Nov 27 14:33:26 wd02 kernel: sd 3:0:0:0: Attached scsi disk sdd
Nov 27 14:33:26 wd02 kernel: Initializing USB Mass Storage driver...
Nov 27 14:33:26 wd02 kernel: usbcore: registered new driver usb-storage
Nov 27 14:33:26 wd02 kernel: USB Mass Storage support registered.
Nov 27 14:33:26 wd02 kernel: device-mapper: ioctl: 4.11.0-ioctl (2006-09-14) initialised: dm-devel@redhat.com
Nov 27 14:33:26 wd02 kernel: md: Autodetecting RAID arrays.
Nov 27 14:33:26 wd02 kernel: md: autorun ...
Nov 27 14:33:26 wd02 kernel: md: considering sdd2 ...
Nov 27 14:33:26 wd02 kernel: md:  adding sdd2 ...
<span style="font-weight:bold;">Nov 27 14:33:26 wd02 kernel: md: sdd1 has different UUID to sdd2</span>
Nov 27 14:33:26 wd02 kernel: md:  adding sdc2 ...
<span style="font-weight:bold;">Nov 27 14:33:26 wd02 kernel: md: sdc1 has different UUID to sdd2</span>
Nov 27 14:33:26 wd02 kernel: md: sdb2 has different UUID to sdd2
Nov 27 14:33:26 wd02 kernel: md: sdb1 has different UUID to sdd2
Nov 27 14:33:26 wd02 kernel: md: sda2 has different UUID to sdd2
Nov 27 14:33:26 wd02 kernel: md: sda1 has different UUID to sdd2
Nov 27 14:33:26 wd02 kernel: md: created md2
Nov 27 14:33:26 wd02 kernel: md: bind<sdc2>
Nov 27 14:33:26 wd02 kernel: md: bind<sdd2>
Nov 27 14:33:26 wd02 kernel: md: running: <sdd2><sdc2>
Nov 27 14:33:26 wd02 kernel: raid1: raid set md2 active with 2 out of 2 mirrors
Nov 27 14:33:26 wd02 kernel: md: considering sdd1 ...
Nov 27 14:33:26 wd02 kernel: md:  adding sdd1 ...
Nov 27 14:33:26 wd02 kernel: md:  adding sdc1 ...
Nov 27 14:33:26 wd02 kernel: md: sdb2 has different UUID to sdd1
Nov 27 14:33:26 wd02 kernel: md:  adding sdb1 ...
Nov 27 14:33:26 wd02 kernel: md: sda2 has different UUID to sdd1
Nov 27 14:33:26 wd02 kernel: md:  adding sda1 ...
Nov 27 14:33:26 wd02 kernel: md: created md0
Nov 27 14:33:26 wd02 kernel: md: bind<sda1>
Nov 27 14:33:26 wd02 kernel: md: bind<sdb1>
Nov 27 14:33:26 wd02 kernel: md: bind<sdc1>
Nov 27 14:33:26 wd02 kernel: md: bind<sdd1>
Nov 27 14:33:26 wd02 kernel: md: running: <sdd1><sdc1><sdb1><sda1>
Nov 27 14:33:26 wd02 kernel: raid1: raid set md0 active with 4 out of 4 mirrors
Nov 27 14:33:26 wd02 kernel: md: considering sdb2 ...
Nov 27 14:33:26 wd02 kernel: md:  adding sdb2 ...
Nov 27 14:33:26 wd02 kernel: md:  adding sda2 ...
Nov 27 14:33:26 wd02 kernel: md: created md1
Nov 27 14:33:26 wd02 kernel: md: bind<sda2>
Nov 27 14:33:26 wd02 kernel: md: bind<sdb2>
Nov 27 14:33:26 wd02 kernel: md: running: <sdb2><sda2>
Nov 27 14:33:26 wd02 kernel: raid1: raid set md1 active with 2 out of 2 mirrors
Nov 27 14:33:26 wd02 kernel: md: ... autorun DONE.
Nov 27 14:33:26 wd02 kernel: md: Autodetecting RAID arrays.
Nov 27 14:33:26 wd02 kernel: md: autorun ...
Nov 27 14:33:26 wd02 kernel: md: ... autorun DONE.
Nov 27 14:33:26 wd02 kernel: kjournald starting.  Commit interval 5 seconds
Nov 27 14:33:26 wd02 kernel: EXT3-fs: mounted filesystem with ordered data mode.
......
Nov 27 14:33:26 wd02 kernel: md: Autodetecting RAID arrays.
Nov 27 14:33:26 wd02 kernel: md: autorun ...
Nov 27 14:33:26 wd02 kernel: md: ... autorun DONE.
Nov 27 14:33:26 wd02 kernel: EXT3 FS on dm-0, internal journal
Nov 27 14:33:26 wd02 kernel: Adding 1052248k swap on /dev/sdd3.  Priority:-1 extents:1 across:1052248k
Nov 27 14:33:26 wd02 kernel: Adding 1052248k swap on /dev/sdc3.  Priority:-2 extents:1 across:1052248k
Nov 27 14:33:26 wd02 kernel: Adding 1052248k swap on /dev/sdb3.  Priority:-3 extents:1 across:1052248k
Nov 27 14:33:26 wd02 kernel: Adding 1052248k swap on /dev/sda3.  Priority:-4 extents:1 across:1052248k
......

Nov 27 14:43:31 wd02 kernel: ata3: exception Emask 0x10 SAct 0x0 SErr 0x90200 action 0x6 frozen
Nov 27 14:43:31 wd02 kernel: ata3: (irq_stat 0x00400000, PHY RDY changed)
Nov 27 14:43:31 wd02 kernel: ata4: exception Emask 0x10 SAct 0x0 SErr 0x90200 action 0x6 frozen
Nov 27 14:43:31 wd02 kernel: ata4: (irq_stat 0x00400000, PHY RDY changed)
Nov 27 14:43:32 wd02 kernel: ata3: waiting for device to spin up (8 secs)
Nov 27 14:43:32 wd02 kernel: ata4: waiting for device to spin up (8 secs)
Nov 27 14:43:39 wd02 kernel: ata3: hard resetting port
Nov 27 14:43:39 wd02 kernel: ata4: hard resetting port
Nov 27 14:43:40 wd02 kernel: ata4: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Nov 27 14:43:40 wd02 kernel: ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Nov 27 14:43:40 wd02 kernel: ata4.00: configured for UDMA/133
Nov 27 14:43:40 wd02 kernel: ata4: EH complete
Nov 27 14:43:40 wd02 kernel: ata3.00: configured for UDMA/133
Nov 27 14:43:40 wd02 kernel: ata3: EH complete
Nov 27 14:43:40 wd02 kernel: SCSI device sdd: 625142448 512-byte hdwr sectors (320073 MB)
Nov 27 14:43:40 wd02 kernel: sdd: Write Protect is off
Nov 27 14:43:40 wd02 kernel: SCSI device sdd: drive cache: write back
Nov 27 14:43:40 wd02 kernel: SCSI device sdc: 625142448 512-byte hdwr sectors (320073 MB)
Nov 27 14:43:40 wd02 kernel: sdc: Write Protect is off
Nov 27 14:43:40 wd02 kernel: SCSI device sdc: drive cache: write back
......
Nov 27 14:50:20 wd02 kernel: Kernel command line: ro root=/dev/VolGroup00/LogVol00 1
......

Nov 27 16:31:25 wd02 kernel: device-mapper: ioctl: 4.11.0-ioctl (2006-09-14) initialised: dm-devel@redhat.com
Nov 27 16:31:25 wd02 kernel: md: Autodetecting RAID arrays.
Nov 27 16:31:25 wd02 kernel: md: autorun ...
Nov 27 16:31:25 wd02 kernel: md: considering sdd2 ...
Nov 27 16:31:25 wd02 kernel: md:  adding sdd2 ...
Nov 27 16:31:25 wd02 kernel: md: sdd1 has different UUID to sdd2
Nov 27 16:31:25 wd02 kernel: md:  adding sdc2 ...
Nov 27 16:31:25 wd02 kernel: md: sdc1 has different UUID to sdd2
Nov 27 16:31:25 wd02 kernel: md: sdb2 has different UUID to sdd2
Nov 27 16:31:25 wd02 kernel: md: sdb1 has different UUID to sdd2
Nov 27 16:31:25 wd02 kernel: md: sda2 has different UUID to sdd2
Nov 27 16:31:25 wd02 kernel: md: sda1 has different UUID to sdd2
Nov 27 16:31:25 wd02 kernel: md: created md2
Nov 27 16:31:25 wd02 kernel: md: bind<sdc2>
Nov 27 16:31:25 wd02 kernel: md: bind<sdd2>
Nov 27 16:31:25 wd02 kernel: md: running: <sdd2><sdc2>
Nov 27 16:31:25 wd02 kernel: raid1: raid set md2 active with 2 out of 2 mirrors
Nov 27 16:31:25 wd02 kernel: md: considering sdd1 ...
Nov 27 16:31:25 wd02 kernel: md:  adding sdd1 ...
Nov 27 16:31:25 wd02 kernel: md:  adding sdc1 ...
Nov 27 16:31:25 wd02 kernel: md: sdb2 has different UUID to sdd1
Nov 27 16:31:25 wd02 kernel: md:  adding sdb1 ...
Nov 27 16:31:25 wd02 kernel: md: sda2 has different UUID to sdd1
Nov 27 16:31:25 wd02 kernel: md:  adding sda1 ...
Nov 27 16:31:25 wd02 kernel: md: created md0
Nov 27 16:31:25 wd02 kernel: md: bind<sda1>
Nov 27 16:31:25 wd02 kernel: md: bind<sdb1>
Nov 27 16:31:25 wd02 kernel: md: bind<sdc1>
Nov 27 16:31:25 wd02 kernel: md: bind<sdd1>
Nov 27 16:31:25 wd02 kernel: md: running: <sdd1><sdc1><sdb1><sda1>
Nov 27 16:31:25 wd02 kernel: raid1: raid set md0 active with 4 out of 4 mirrors
Nov 27 16:31:25 wd02 kernel: md: considering sdb2 ...
Nov 27 16:31:25 wd02 kernel: md:  adding sdb2 ...
Nov 27 16:31:25 wd02 kernel: md:  adding sda2 ...
Nov 27 16:31:25 wd02 kernel: md: created md1
Nov 27 16:31:25 wd02 kernel: md: bind<sda2>
Nov 27 16:31:25 wd02 kernel: md: bind<sdb2>
Nov 27 16:31:25 wd02 kernel: md: running: <sdb2><sda2>
Nov 27 16:31:25 wd02 kernel: md: md1: raid array is not clean -- starting background reconstruction
Nov 27 16:31:25 wd02 kernel: raid1: raid set md1 active with 2 out of 2 mirrors
Nov 27 16:31:25 wd02 kernel: md: ... autorun DONE.
<span style="font-weight: bold;">Nov 27 16:31:25 wd02 kernel: md: syncing RAID array md1</span>
<span style="font-weight: bold;">Nov 27 16:31:25 wd02 kernel: md: minimum _guaranteed_ reconstruction speed: 1000 KB/sec/disc.</span>
<span style="font-weight: bold;">Nov 27 16:31:25 wd02 kernel: md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for reconstruction.</span>
<span style="font-weight: bold;">Nov 27 16:31:25 wd02 kernel: md: using 128k window, over a total of 310994176 blocks.</span>
Nov 27 16:31:25 wd02 kernel: md: Autodetecting RAID arrays.
Nov 27 16:31:25 wd02 kernel: md: autorun ...
Nov 27 16:31:25 wd02 kernel: md: ... autorun DONE.
Nov 27 16:31:25 wd02 kernel: kjournald starting.  Commit interval 5 seconds
Nov 27 16:31:25 wd02 kernel: EXT3-fs: mounted filesystem with ordered data mode.
......

Chowroc

Nov 27 16:31:25 wd02 kernel: md: Autodetecting RAID arrays.
Nov 27 16:31:25 wd02 kernel: md: autorun ...
Nov 27 16:31:25 wd02 kernel: md: ... autorun DONE.
Nov 27 16:31:25 wd02 kernel: EXT3 FS on dm-0, internal journal
Nov 27 16:31:25 wd02 kernel: Adding 1052248k swap on /dev/sdd3.  Priority:-1 extents:1 across:1052248k
Nov 27 16:31:25 wd02 kernel: Adding 1052248k swap on /dev/sdc3.  Priority:-2 extents:1 across:1052248k
Nov 27 16:31:25 wd02 kernel: Adding 1052248k swap on /dev/sdb3.  Priority:-3 extents:1 across:1052248k
Nov 27 16:31:25 wd02 kernel: Adding 1052248k swap on /dev/sda3.  Priority:-4 extents:1 across:1052248k
Nov 27 16:31:25 wd02 kernel: ata4.00: exception Emask 0x10 SAct 0x0 SErr 0x90200 action 0x6 frozen
Nov 27 16:31:25 wd02 kernel: ata4.00: (irq_stat 0x00400000, PHY RDY changed)
Nov 27 16:31:25 wd02 kernel: ata4.00: tag 0 cmd 0xea Emask 0x10 stat 0x40 err 0x0 (ATA bus error)
Nov 27 16:31:25 wd02 kernel: ata3.00: exception Emask 0x10 SAct 0x0 SErr 0x90200 action 0x6 frozen
Nov 27 16:31:25 wd02 kernel: ata3.00: (irq_stat 0x00400000, PHY RDY changed)
Nov 27 16:31:25 wd02 kernel: ata3.00: tag 0 cmd 0xea Emask 0x10 stat 0x40 err 0x0 (ATA bus error)
Nov 27 16:31:25 wd02 kernel: ata4: waiting for device to spin up (8 secs)
Nov 27 16:31:25 wd02 kernel: ata3: waiting for device to spin up (8 secs)
Nov 27 16:31:25 wd02 kernel: ata4: hard resetting port
Nov 27 16:31:25 wd02 kernel: ata3: hard resetting port
Nov 27 16:31:25 wd02 kernel: ata4: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Nov 27 16:31:25 wd02 kernel: ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Nov 27 16:31:25 wd02 kernel: ata4.00: configured for UDMA/133
Nov 27 16:31:25 wd02 kernel: ata4: EH complete
Nov 27 16:31:25 wd02 kernel: ata3.00: configured for UDMA/133
Nov 27 16:31:25 wd02 kernel: ata3: EH complete
Nov 27 16:31:25 wd02 kernel: SCSI device sdd: 625142448 512-byte hdwr sectors (320073 MB)
Nov 27 16:31:25 wd02 kernel: sdd: Write Protect is off
Nov 27 16:31:25 wd02 kernel: SCSI device sdd: drive cache: write back
Nov 27 16:31:25 wd02 kernel: SCSI device sdc: 625142448 512-byte hdwr sectors (320073 MB)
Nov 27 16:31:25 wd02 kernel: sdc: Write Protect is off
Nov 27 16:31:25 wd02 kernel: SCSI device sdc: drive cache: write back
Nov 27 16:31:25 wd02 kernel: md: md1: sync done.
Nov 27 16:31:25 wd02 kernel: RAID1 conf printout:
Nov 27 16:31:25 wd02 kernel:  --- wd:2 rd:2
Nov 27 16:31:25 wd02 kernel:  disk 0, wo:0, o:1, dev:sda2
Nov 27 16:31:25 wd02 kernel:  disk 1, wo:0, o:1, dev:sdb2
......
Nov 27 16:36:06 wd02 kernel: md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27
Nov 27 16:36:06 wd02 kernel: md: bitmap version 4.39
......


Nov 27 17:50:47 wd02 kernel: ata3: exception Emask 0x10 SAct 0x0 SErr 0x90200 action 0x6 frozen
Nov 27 17:50:47 wd02 kernel: ata3: (irq_stat 0x00400000, PHY RDY changed)
Nov 27 17:50:47 wd02 kernel: ata4: exception Emask 0x10 SAct 0x0 SErr 0x90200 action 0x6 frozen
Nov 27 17:50:47 wd02 kernel: ata4: (irq_stat 0x00400000, PHY RDY changed)
Nov 27 17:50:47 wd02 kernel: ata3: waiting for device to spin up (8 secs)
Nov 27 17:50:47 wd02 kernel: ata4: waiting for device to spin up (8 secs)
Nov 27 17:50:55 wd02 kernel: ata3: hard resetting port
Nov 27 17:50:55 wd02 kernel: ata4: hard resetting port
Nov 27 17:50:56 wd02 kernel: ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Nov 27 17:50:56 wd02 kernel: ata4: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Nov 27 17:50:56 wd02 kernel: ata3.00: configured for UDMA/133
Nov 27 17:50:56 wd02 kernel: ata3: EH complete
Nov 27 17:50:56 wd02 kernel: ata4.00: configured for UDMA/133
Nov 27 17:50:56 wd02 kernel: ata4: EH complete
Nov 27 17:50:56 wd02 kernel: SCSI device sdc: 625142448 512-byte hdwr sectors (320073 MB)
Nov 27 17:50:56 wd02 kernel: sdc: Write Protect is off
Nov 27 17:50:56 wd02 kernel: SCSI device sdc: drive cache: write back
Nov 27 17:50:56 wd02 kernel: SCSI device sdd: 625142448 512-byte hdwr sectors (320073 MB)
Nov 27 17:50:56 wd02 kernel: sdd: Write Protect is off
Nov 27 17:50:56 wd02 kernel: SCSI device sdd: drive cache: write back
Nov 27 21:02:13 wd02 kernel: ata3: exception Emask 0x10 SAct 0x0 SErr 0x90200 action 0x6 frozen
Nov 27 21:02:13 wd02 kernel: ata3: (irq_stat 0x00400000, PHY RDY changed)
Nov 27 21:02:13 wd02 kernel: ata4: exception Emask 0x10 SAct 0x0 SErr 0x90200 action 0x6 frozen
Nov 27 21:02:13 wd02 kernel: ata4: (irq_stat 0x00400000, PHY RDY changed)
Nov 27 21:02:13 wd02 kernel: ata3: waiting for device to spin up (8 secs)
Nov 27 21:02:13 wd02 kernel: ata4: waiting for device to spin up (8 secs)
Nov 27 21:02:21 wd02 kernel: ata3: hard resetting port
Nov 27 21:02:21 wd02 kernel: ata4: hard resetting port
Nov 27 21:02:21 wd02 kernel: ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Nov 27 21:02:21 wd02 kernel: ata4: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Nov 27 21:02:21 wd02 kernel: ata3.00: configured for UDMA/133
Nov 27 21:02:21 wd02 kernel: ata3: EH complete
Nov 27 21:02:21 wd02 kernel: ata4.00: configured for UDMA/133
Nov 27 21:02:21 wd02 kernel: ata4: EH complete
Nov 27 21:02:21 wd02 kernel: SCSI device sdc: 625142448 512-byte hdwr sectors (320073 MB)
Nov 27 21:02:21 wd02 kernel: sdc: Write Protect is off
Nov 27 21:02:21 wd02 kernel: SCSI device sdc: drive cache: write back
Nov 27 21:02:21 wd02 kernel: SCSI device sdd: 625142448 512-byte hdwr sectors (320073 MB)
Nov 27 21:02:21 wd02 kernel: sdd: Write Protect is off
Nov 27 21:02:21 wd02 kernel: SCSI device sdd: drive cache: write back
Nov 27 21:27:16 wd02 kernel: ata4.00: exception Emask 0x10 SAct 0x0 SErr 0x90200 action 0x6 frozen
Nov 27 21:27:16 wd02 kernel: ata4.00: (irq_stat 0x00400000, PHY RDY changed)
Nov 27 21:27:16 wd02 kernel: ata4.00: tag 0 cmd 0xea Emask 0x10 stat 0x40 err 0x0 (ATA bus error)
Nov 27 21:27:16 wd02 kernel: ata4: waiting for device to spin up (8 secs)
Nov 27 21:27:16 wd02 kernel: ata3: exception Emask 0x10 SAct 0x0 SErr 0x90200 action 0x6 frozen
Nov 27 21:27:16 wd02 kernel: ata3: (irq_stat 0x00400000, PHY RDY changed)
Nov 27 21:27:17 wd02 kernel: ata3: waiting for device to spin up (8 secs)
Nov 27 21:27:24 wd02 kernel: ata4: hard resetting port
Nov 27 21:27:24 wd02 kernel: ata3: hard resetting port
Nov 27 21:27:25 wd02 kernel: ata4: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Nov 27 21:27:25 wd02 kernel: ata4.00: configured for UDMA/133
Nov 27 21:27:25 wd02 kernel: ata4: EH complete
Nov 27 21:27:25 wd02 kernel: SCSI device sdd: 625142448 512-byte hdwr sectors (320073 MB)
Nov 27 21:27:25 wd02 kernel: sdd: Write Protect is off
Nov 27 21:27:25 wd02 kernel: SCSI device sdd: drive cache: write back
Nov 27 21:27:25 wd02 kernel: ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Nov 27 21:27:25 wd02 kernel: ata3.00: configured for UDMA/133
Nov 27 21:27:25 wd02 kernel: ata3: EH complete
Nov 27 21:27:25 wd02 kernel: SCSI device sdc: 625142448 512-byte hdwr sectors (320073 MB)
Nov 27 21:27:34 wd02 kernel: sdc: Write Protect is off
Nov 27 21:27:34 wd02 kernel: SCSI device sdc: drive cache: write back
Nov 27 21:27:34 wd02 kernel: ata3.00: exception Emask 0x10 SAct 0x0 SErr 0x90200 action 0x6 frozen
Nov 27 21:27:34 wd02 kernel: ata3.00: (irq_stat 0x00400000, PHY RDY changed)
Nov 27 21:27:34 wd02 kernel: ata3.00: tag 0 cmd 0xea Emask 0x10 stat 0x40 err 0x0 (ATA bus error)
Nov 27 21:27:34 wd02 kernel: ata3: waiting for device to spin up (8 secs)
Nov 27 21:27:34 wd02 kernel: ata3: hard resetting port
Nov 27 21:27:34 wd02 kernel: ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Nov 27 21:27:34 wd02 kernel: ata3.00: configured for UDMA/133
Nov 27 21:27:34 wd02 kernel: ata3: EH complete
Nov 27 21:27:34 wd02 kernel: SCSI device sdc: 625142448 512-byte hdwr sectors (320073 MB)
Nov 27 21:27:34 wd02 kernel: sdc: Write Protect is off
Nov 27 21:27:34 wd02 kernel: SCSI device sdc: drive cache: write back
Nov 27 21:34:03 wd02 kernel: ata4.00: exception Emask 0x10 SAct 0x0 SErr 0x90200 action 0x6 frozen
Nov 27 21:34:03 wd02 kernel: ata4.00: (irq_stat 0x00400000, PHY RDY changed)
Nov 27 21:34:03 wd02 kernel: ata4.00: tag 0 cmd 0xea Emask 0x10 stat 0x40 err 0x0 (ATA bus error)
Nov 27 21:34:04 wd02 kernel: ata4: waiting for device to spin up (8 secs)
Nov 27 21:34:11 wd02 kernel: ata4: hard resetting port
Nov 27 21:34:12 wd02 kernel: ata4: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Nov 27 21:34:12 wd02 kernel: ata4.00: configured for UDMA/133
Nov 27 21:34:12 wd02 kernel: ata4: EH complete
Nov 27 21:34:12 wd02 kernel: SCSI device sdd: 625142448 512-byte hdwr sectors (320073 MB)
Nov 27 21:34:12 wd02 kernel: sdd: Write Protect is off
Nov 27 21:34:12 wd02 kernel: SCSI device sdd: drive cache: write back
Nov 27 23:14:12 wd02 kernel: ata4.00: exception Emask 0x10 SAct 0x0 SErr 0x90200 action 0x6 frozen
Nov 27 23:14:12 wd02 kernel: ata4.00: (irq_stat 0x00400000, PHY RDY changed)
Nov 27 23:14:12 wd02 kernel: ata4.00: tag 0 cmd 0xea Emask 0x10 stat 0x40 err 0x0 (ATA bus error)
Nov 27 23:14:13 wd02 kernel: ata4: waiting for device to spin up (8 secs)
Nov 27 23:14:20 wd02 kernel: ata4: hard resetting port
Nov 27 23:14:21 wd02 kernel: ata4: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Nov 27 23:14:21 wd02 kernel: ata4.00: configured for UDMA/133
Nov 27 23:14:21 wd02 kernel: ata4: EH complete
Nov 27 23:14:21 wd02 kernel: SCSI device sdd: 625142448 512-byte hdwr sectors (320073 MB)
Nov 27 23:14:21 wd02 kernel: sdd: Write Protect is off
Nov 27 23:14:21 wd02 kernel: SCSI device sdd: drive cache: write back
Nov 27 23:24:22 wd02 kernel: ata4.00: exception Emask 0x10 SAct 0x0 SErr 0x90200 action 0x6 frozen
Nov 27 23:24:22 wd02 kernel: ata4.00: (irq_stat 0x00400000, PHY RDY changed)
Nov 27 23:24:22 wd02 kernel: ata4.00: tag 0 cmd 0xea Emask 0x10 stat 0x40 err 0x0 (ATA bus error)
Nov 27 23:24:22 wd02 kernel: ata4: waiting for device to spin up (8 secs)
Nov 27 23:24:22 wd02 kernel: ata3: exception Emask 0x10 SAct 0x0 SErr 0x90200 action 0x6 frozen
Nov 27 23:24:22 wd02 kernel: ata3: (irq_stat 0x00400000, PHY RDY changed)
Nov 27 23:24:23 wd02 kernel: ata3: waiting for device to spin up (8 secs)
Nov 27 23:24:30 wd02 kernel: ata4: hard resetting port
Nov 27 23:24:30 wd02 kernel: ata3: hard resetting port
Nov 27 23:24:32 wd02 kernel: ata4: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Nov 27 23:24:32 wd02 kernel: ATA: abnormal status 0x7F on port 0x0
Nov 27 23:24:32 wd02 kernel: ATA: abnormal status 0x7F on port 0x0
Nov 27 23:24:32 wd02 kernel: ata4.00: failed to IDENTIFY (I/O error, err_mask=0x100)
Nov 27 23:24:52 wd02 kernel: ata4.00: revalidation failed (errno=-5)
Nov 27 23:24:52 wd02 kernel: ata4: failed to recover some devices, retrying in 5 secs
Nov 27 23:24:52 wd02 kernel: ata3: SATA link down (SStatus 0 SControl 300)
Nov 27 23:24:52 wd02 kernel: ata3: failed to recover some devices, retrying in 5 secs
Nov 27 23:24:52 wd02 kernel: ata3: hard resetting port
Nov 27 23:24:52 wd02 kernel: ata4: hard resetting port
Nov 27 23:24:52 wd02 kernel: ata4: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Nov 27 23:24:52 wd02 kernel: ATA: abnormal status 0x7F on port 0x0
Nov 27 23:24:52 wd02 kernel: ATA: abnormal status 0x7F on port 0x0
Nov 27 23:24:52 wd02 kernel: ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Nov 27 23:24:52 wd02 kernel: ATA: abnormal status 0x7F on port 0x0
Nov 27 23:24:52 wd02 kernel: ata4.00: failed to IDENTIFY (I/O error, err_mask=0x100)
Nov 27 23:24:52 wd02 kernel: ata4.00: revalidation failed (errno=-5)
Nov 27 23:24:52 wd02 kernel: ata4: failed to recover some devices, retrying in 5 secs
Nov 27 23:24:52 wd02 kernel: ATA: abnormal status 0x7F on port 0x0
Nov 27 23:24:52 wd02 kernel: ata3.00: failed to IDENTIFY (I/O error, err_mask=0x40)
Nov 27 23:24:52 wd02 kernel: ata3.00: revalidation failed (errno=-5)
Nov 27 23:24:52 wd02 kernel: ata3: failed to recover some devices, retrying in 5 secs
Nov 27 23:24:52 wd02 kernel: ata4: hard resetting port
Nov 27 23:24:52 wd02 kernel: ata3: hard resetting port
Nov 27 23:24:52 wd02 kernel: ata4: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Nov 27 23:24:52 wd02 kernel: ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Nov 27 23:24:52 wd02 kernel: ATA: abnormal status 0x7F on port 0x0
Nov 27 23:24:52 wd02 kernel: ata4.00: failed to IDENTIFY (I/O error, err_mask=0x40)
Nov 27 23:24:52 wd02 kernel: ata4.00: revalidation failed (errno=-5)
Nov 27 23:24:52 wd02 kernel: ata4.00: disabled
Nov 27 23:24:52 wd02 kernel: ATA: abnormal status 0x7F on port 0x0
Nov 27 23:24:52 wd02 kernel: ata3.00: failed to IDENTIFY (I/O error, err_mask=0x100)
Nov 27 23:24:52 wd02 kernel: ata3.00: revalidation failed (errno=-5)
Nov 27 23:24:52 wd02 kernel: ata3.00: disabled
Nov 27 23:24:52 wd02 kernel: ata4: soft resetting port
Nov 27 23:24:52 wd02 kernel: ata3: soft resetting port
Nov 27 23:24:52 wd02 kernel: ata4: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Nov 27 23:24:52 wd02 kernel: ata4: EH pending after completion, repeating EH (cnt=4)
Nov 27 23:24:52 wd02 kernel: ata4: exception Emask 0x10 SAct 0x0 SErr 0x90200 action 0x5
Nov 27 23:24:52 wd02 kernel: ata4: (irq_stat 0x00400000, PHY RDY changed)
Nov 27 23:24:52 wd02 kernel: ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Nov 27 23:24:52 wd02 kernel: ata3: EH pending after completion, repeating EH (cnt=4)
Nov 27 23:24:52 wd02 kernel: ata3: exception Emask 0x10 SAct 0x0 SErr 0x4090200 action 0x5
Nov 27 23:24:52 wd02 kernel: ata3: (irq_stat 0x00400000, PHY RDY changed)
Nov 27 23:24:52 wd02 kernel: ata3: hard resetting port
Nov 27 23:24:52 wd02 kernel: ata4: hard resetting port
Nov 27 23:24:52 wd02 kernel: ata4: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Nov 27 23:24:52 wd02 kernel: sd 3:0:0:0: rejecting I/O to offline device
Nov 27 23:24:52 wd02 kernel: raid1: sdd2: rescheduling sector 619061936
Nov 27 23:24:52 wd02 kernel: ata4: EH complete
Nov 27 23:24:52 wd02 kernel: sd 3:0:0:0: rejecting I/O to offline device
Nov 27 23:24:52 wd02 kernel: sd 2:0:0:0: rejecting I/O to offline device
Nov 27 23:24:52 wd02 kernel: raid1: Disk failure on sdd2, disabling device.
Nov 27 23:24:52 wd02 kernel:    Operation continuing on 1 devices
Nov 27 23:24:52 wd02 kernel: raid1: sdc2: redirecting sector 619061936 to another mirror
Nov 27 23:24:52 wd02 kernel: sd 2:0:0:0: rejecting I/O to offline device
Nov 27 23:24:52 wd02 kernel: Buffer I/O error on device dm-0, logical block 151060377
Nov 27 23:24:52 wd02 kernel: lost page write due to I/O error on dm-0
Nov 27 23:24:52 wd02 kernel: sd 2:0:0:0: rejecting I/O to offline device
Nov 27 23:24:52 wd02 kernel: RAID1 conf printout:
Nov 27 23:24:52 wd02 kernel:  --- wd:1 rd:2
Nov 27 23:24:52 wd02 kernel:  disk 0, wo:1, o:0, dev:sdd2
Nov 27 23:24:52 wd02 kernel:  disk 1, wo:0, o:1, dev:sdc2
Nov 27 23:24:52 wd02 kernel: sd 2:0:0:0: rejecting I/O to offline device
Nov 27 23:24:52 wd02 kernel: ata4.00: detaching (SCSI 3:0:0:0)
Nov 27 23:24:52 wd02 kernel: RAID1 conf printout:
Nov 27 23:24:52 wd02 kernel:  --- wd:1 rd:2
Nov 27 23:24:52 wd02 kernel:  disk 1, wo:0, o:1, dev:sdc2
Nov 27 23:24:52 wd02 kernel: sd 2:0:0:0: rejecting I/O to offline device
Nov 27 23:24:52 wd02 kernel: Buffer I/O error on device dm-0, logical block 155255079
Nov 27 23:24:52 wd02 kernel: lost page write due to I/O error on dm-0
Nov 27 23:24:52 wd02 kernel: sd 2:0:0:0: rejecting I/O to offline device
Nov 27 23:24:52 wd02 kernel: Buffer I/O error on device dm-0, logical block 150151196
Nov 27 23:24:52 wd02 kernel: lost page write due to I/O error on dm-0
Nov 27 23:24:52 wd02 kernel: sd 2:0:0:0: rejecting I/O to offline device
Nov 27 23:24:53 wd02 kernel: Buffer I/O error on device dm-0, logical block 80085000
Nov 27 23:24:53 wd02 kernel: lost page write due to I/O error on dm-0
Nov 27 23:24:53 wd02 kernel: sd 2:0:0:0: rejecting I/O to offline device
Nov 27 23:24:53 wd02 kernel: Buffer I/O error on device dm-0, logical block 80085003
Nov 27 23:24:53 wd02 kernel: lost page write due to I/O error on dm-0
Nov 27 23:24:53 wd02 kernel: sd 2:0:0:0: rejecting I/O to offline device
Nov 27 23:24:53 wd02 kernel: Buffer I/O error on device dm-0, logical block 80085038
Nov 27 23:24:53 wd02 kernel: lost page write due to I/O error on dm-0
Nov 27 23:24:53 wd02 kernel: sd 2:0:0:0: rejecting I/O to offline device
Nov 27 23:24:53 wd02 kernel: Buffer I/O error on device dm-0, logical block 80085050
Nov 27 23:24:53 wd02 kernel: lost page write due to I/O error on dm-0
Nov 27 23:24:53 wd02 kernel: sd 2:0:0:0: rejecting I/O to offline device
Nov 27 23:24:53 wd02 kernel: Buffer I/O error on device dm-0, logical block 80085051
Nov 27 23:24:53 wd02 kernel: lost page write due to I/O error on dm-0
Nov 27 23:24:53 wd02 kernel: sd 2:0:0:0: rejecting I/O to offline device
Nov 28 14:11:37 wd02 kernel: klogd 1.4.1, log source = /proc/kmsg started.

Chowroc

每次系统启动都自动同步 md2(sdc2/sdd2)，dmesg 如下：
ahci 0000:00:12.0: AHCI 0001.0100 32 slots 4 ports 3 Gbps 0xf impl SATA mode
ahci 0000:00:12.0: flags: 64bit ncq ilck pm led clo pmp pio slum part
ata1: SATA max UDMA/133 cmd 0xF8846100 ctl 0x0 bmdma 0x0 irq 201
ata2: SATA max UDMA/133 cmd 0xF8846180 ctl 0x0 bmdma 0x0 irq 201
ata3: SATA max UDMA/133 cmd 0xF8846200 ctl 0x0 bmdma 0x0 irq 201
ata4: SATA max UDMA/133 cmd 0xF8846280 ctl 0x0 bmdma 0x0 irq 201
scsi0 : ahci
ata1: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
ata1.00: ATA-7, max UDMA/133, 625140335 sectors: LBA48 NCQ (depth 31/32)
ata1.00: ata1: dev 0 multi count 16
ata1.00: configured for UDMA/133
scsi1 : ahci
ata2: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
ata2.00: ATA-7, max UDMA/133, 625142448 sectors: LBA48 NCQ (depth 31/32)
ata2.00: ata2: dev 0 multi count 16
ata2.00: configured for UDMA/133
scsi2 : ahci
ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
ata3.00: ATA-7, max UDMA/133, 625142448 sectors: LBA48 NCQ (depth 31/32)
ata3.00: ata3: dev 0 multi count 16
ata3.00: configured for UDMA/133
scsi3 : ahci
ata4: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
ata4.00: ATA-7, max UDMA/133, 625142448 sectors: LBA48 NCQ (depth 31/32)
ata4.00: ata4: dev 0 multi count 16
ata4.00: configured for UDMA/133
  Vendor: ATA       Model: ST3320620AS       Rev: 3.AA
  Type:   Direct-Access                      ANSI SCSI revision: 05
SCSI device sda: 625140335 512-byte hdwr sectors (320072 MB)
sda: Write Protect is off
sda: Mode Sense: 00 3a 00 00
SCSI device sda: drive cache: write back
SCSI device sda: 625140335 512-byte hdwr sectors (320072 MB)
sda: Write Protect is off
sda: Mode Sense: 00 3a 00 00
SCSI device sda: drive cache: write back
sda: sda1 sda2 sda3
sd 0:0:0:0: Attached scsi disk sda
  Vendor: ATA       Model: ST3320620AS       Rev: 3.AA
  Type:   Direct-Access                      ANSI SCSI revision: 05
SCSI device sdb: 625142448 512-byte hdwr sectors (320073 MB)
sdb: Write Protect is off
sdb: Mode Sense: 00 3a 00 00
SCSI device sdb: drive cache: write back
SCSI device sdb: 625142448 512-byte hdwr sectors (320073 MB)
sdb: Write Protect is off
sdb: Mode Sense: 00 3a 00 00
SCSI device sdb: drive cache: write back
sdb: sdb1 sdb2 sdb3
sd 1:0:0:0: Attached scsi disk sdb
  Vendor: ATA       Model: ST3320620AS       Rev: 3.AA
  Type:   Direct-Access                      ANSI SCSI revision: 05
SCSI device sdc: 625142448 512-byte hdwr sectors (320073 MB)
sdc: Write Protect is off
sdc: Mode Sense: 00 3a 00 00
SCSI device sdc: drive cache: write back
SCSI device sdc: 625142448 512-byte hdwr sectors (320073 MB)
sdc: Write Protect is off
sdc: Mode Sense: 00 3a 00 00
SCSI device sdc: drive cache: write back
sdc: sdc1 sdc2 sdc3
sd 2:0:0:0: Attached scsi disk sdc
  Vendor: ATA       Model: ST3320620AS       Rev: 3.AA
  Type:   Direct-Access                      ANSI SCSI revision: 05
SCSI device sdd: 625142448 512-byte hdwr sectors (320073 MB)
sdd: Write Protect is off
sdd: Mode Sense: 00 3a 00 00
SCSI device sdd: drive cache: write back
SCSI device sdd: 625142448 512-byte hdwr sectors (320073 MB)
sdd: Write Protect is off
sdd: Mode Sense: 00 3a 00 00
SCSI device sdd: drive cache: write back
sdd: sdd1 sdd2 sdd3
sd 3:0:0:0: Attached scsi disk sdd
Initializing USB Mass Storage driver...
usbcore: registered new driver usb-storage
USB Mass Storage support registered.
device-mapper: ioctl: 4.11.0-ioctl (2006-09-14) initialised: devel@redhat.com[/email]
md: Autodetecting RAID arrays.
md: autorun ...
md: considering sdd2 ...
md:  adding sdd2 ...
md: sdd1 has different UUID to sdd2
md:  adding sdc2 ...
md: sdc1 has different UUID to sdd2
md: sdb2 has different UUID to sdd2
md: sdb1 has different UUID to sdd2
md: sda2 has different UUID to sdd2
md: sda1 has different UUID to sdd2
md: created md2
md: bind<sdc2>
md: bind<sdd2>
md: running: <sdd2><sdc2>
raid1: raid set md2 active with 2 out of 2 mirrors
md: considering sdd1 ...
md:  adding sdd1 ...
md:  adding sdc1 ...
md: sdb2 has different UUID to sdd1
md:  adding sdb1 ...
md: sda2 has different UUID to sdd1
md:  adding sda1 ...
md: created md0
md: bind<sda1>
md: bind<sdb1>
md: bind<sdc1>
md: bind<sdd1>
md: running: <sdd1><sdc1><sdb1><sda1>
raid1: raid set md0 active with 4 out of 4 mirrors
md: considering sdb2 ...
md:  adding sdb2 ...
md:  adding sda2 ...
md: created md1
md: bind<sda2>
md: bind<sdb2>
md: running: <sdb2><sda2>
md: md1: raid array is not clean -- starting background reconstruction
raid1: raid set md1 active with 2 out of 2 mirrors
md: ... autorun DONE.
md: syncing RAID array md1
md: minimum _guaranteed_ reconstruction speed: 1000 KB/sec/disc.
md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for reconstruction.
md: using 128k window, over a total of 310994176 blocks.
md: Autodetecting RAID arrays.
md: autorun ...
md: ... autorun DONE.
kjournald starting.  Commit interval 5 seconds
EXT3-fs: mounted filesystem with ordered data mode.
......
md: Autodetecting RAID arrays.
md: autorun ...
md: ... autorun DONE.
EXT3 FS on dm-0, internal journal

然后第一天晚上就开始出现 SCSI 的错误，如 message 所示，第二天登录后发现无法写入，文件系统变成了只读。用 fdisk 发现 sdc 变成了 sde，同时 sdd 也不见了。

重启机器，结果在启动到这里的时候出错了：
Checking filesystems /dev/VolGroup00/LogVol00 contains a file system with errors, check forced.
/dev/VolGroup00/LogVol00:
Inodes that were part of a corrupted orphan linked list found
/dev/VolGroup00/LogVol00:
    UNEXPECTED INCONSISTENCY; RUN fsck MANUALLY.
    (i.e., without -a or -p options)                              [FAILED]
只能进入修复模式，将 sdd 从 RAID1 中去除：
sh# mdadm /dev/md2 -r /dev/sdd2，重启后还是有这个问题。只能再次进入修复模式，手工运行 fsck.ext3 /dev/VolGroup00/LogVol00，在修复的过程中，显示自动修复了一些 inode，大概输出是这样的：
PASS 1: ...
Inode xxxxxx is found in the orphaned linked list.   FIXED
...
经过很长时间的修复，再次重启系统后才行了。此时仅以 3 块磁盘在运行。

我比较奇怪的是为什么 UUID 会报告不一致，看上去都是 sdd 这块磁盘。另外，好像每次重启的时候，都会导致第四块磁盘(sdd)重新进行同步，不知道是不是和这个 UUID 不一致有关？