sun V490 报错,麻烦高手指教,谢谢

hrz520520

服务器是sun v490，挂磁盘阵Hitachi 的AMS 500。最近老是报磁盘阵硬盘读写错误，日志如下。小弟是新手，兄弟们帮忙看看，定位一下问题，看看是硬盘的原因，还是磁盘阵的问题。
-----------------
Jan 11 00:08:20 CQTEST scsi: [ID 107833 kern.warning] WARNING: /pci@8,600000/SUNW,qlc@1/fp@0,0/ssd@w50060e80102a0d21,f (ssd7):
Jan 11 00:08:20 CQTEST  Error for Command: write(10)              Error Level: Retryable
Jan 11 00:08:20 CQTEST scsi: [ID 107833 kern.notice]    Requested Block: 13376                    Error Block: 13376
Jan 11 00:08:20 CQTEST scsi: [ID 107833 kern.notice]    Vendor: HITACHI                            Serial Number: 75041170000F
Jan 11 00:08:20 CQTEST scsi: [ID 107833 kern.notice]    Sense Key: Unit Attention
Jan 11 00:08:20 CQTEST scsi: [ID 107833 kern.notice]    ASC: 0x29 (power on, reset, or bus reset occurred), ASCQ: 0x0, FRU: 0x0
Jan 11 00:08:20 CQTEST scsi: [ID 107833 kern.warning] WARNING: /pci@8,600000/SUNW,qlc@1/fp@0,0/ssd@w50060e80102a0d21,10 (ssd6):
Jan 11 00:08:20 CQTEST  Error for Command: write(10)              Error Level: Retryable
Jan 11 00:08:20 CQTEST scsi: [ID 107833 kern.notice]    Requested Block: 208204624                Error Block: 208204624
Jan 11 00:08:20 CQTEST scsi: [ID 107833 kern.notice]    Vendor: HITACHI                            Serial Number: 750411700010
Jan 11 00:08:20 CQTEST scsi: [ID 107833 kern.notice]    Sense Key: Unit Attention
Jan 11 00:08:20 CQTEST scsi: [ID 107833 kern.notice]    ASC: 0x29 (power on, reset, or bus reset occurred), ASCQ: 0x0, FRU: 0x0
Jan 11 00:08:21 CQTEST scsi: [ID 107833 kern.warning] WARNING: /pci@8,600000/SUNW,qlc@1/fp@0,0/ssd@w50060e80102a0d21,15 (ssd5):
Jan 11 00:08:21 CQTEST  Error for Command: write(10)              Error Level: Retryable
Jan 11 00:08:21 CQTEST scsi: [ID 107833 kern.notice]    Requested Block: 2320                      Error Block: 2320
Jan 11 00:08:21 CQTEST scsi: [ID 107833 kern.notice]    Vendor: HITACHI                            Serial Number: 750411700015
Jan 11 00:08:21 CQTEST scsi: [ID 107833 kern.notice]    Sense Key: Unit Attention
Jan 11 00:08:21 CQTEST scsi: [ID 107833 kern.notice]    ASC: 0x29 (power on, reset, or bus reset occurred), ASCQ: 0x0, FRU: 0x0
Jan 11 00:08:21 CQTEST scsi: [ID 107833 kern.warning] WARNING: /pci@8,600000/SUNW,qlc@1/fp@0,0/ssd@w50060e80102a0d21,1a (ssd2):
Jan 11 00:08:21 CQTEST  Error for Command: write(10)              Error Level: Retryable
Jan 11 00:08:21 CQTEST scsi: [ID 107833 kern.notice]    Requested Block: 2320                      Error Block: 2320
Jan 11 00:08:21 CQTEST scsi: [ID 107833 kern.notice]    Vendor: HITACHI                            Serial Number: 75041170001A
Jan 11 00:08:21 CQTEST scsi: [ID 107833 kern.notice]    Sense Key: Unit Attention
Jan 11 00:08:21 CQTEST scsi: [ID 107833 kern.notice]    ASC: 0x29 (power on, reset, or bus reset occurred), ASCQ: 0x0, FRU: 0x0
Jan 11 00:09:55 CQTEST fctl: [ID 517869 kern.warning] WARNING: 834=>fp(2)::GPN_ID for D_ID=650900 failed
Jan 11 00:09:55 CQTEST fctl: [ID 517869 kern.warning] WARNING: 835=>fp(2)::N_x Port with D_ID=650900, PWWN=50060e80102a0d21 disappeared from fabric
Jan 11 00:09:57 CQTEST fctl: [ID 517869 kern.warning] WARNING: 850=>fp(2)::N_x Port with D_ID=650900, PWWN=50060e80102a0d21 reappeared in fabric
Jan 11 00:09:57 CQTEST scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp2):
Jan 11 00:09:57 CQTEST  Lun=0 for target=650900 disappeared

用iostat -En会有hard error
------iostat -En --------
# iostat -En
c0t0d0          Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: TOSHIBA  Product: ODD-DVD SD-C2732 Revision: 1055 Serial No:
Size: 0.00GB <0 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 0 Predictive Failure Analysis: 0
c1t0d0          Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: HITACHI  Product: HUS1014FASUN146G Revision: 2A08 Serial No: 0730TYK41T
Size: 146.80GB <146800115712 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 0 Predictive Failure Analysis: 0
c1t1d0          Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: HITACHI  Product: HUS1014FASUN146G Revision: 2A08 Serial No: 0730TYK446
Size: 146.80GB <146800115712 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 0 Predictive Failure Analysis: 0
c3t50060E80102A0D21d26Soft Errors: 1 Hard Errors: 8 Transport Errors: 0
Vendor: HITACHI  Product: DF600F          Revision: 0000 Serial No:
Size: 53.65GB <53654323200 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 8 Recoverable: 0
Illegal Request: 1 Predictive Failure Analysis: 0
c3t50060E80102A0D21d23Soft Errors: 1 Hard Errors: 17 Transport Errors: 30290
Vendor: HITACHI  Product: DF600F          Revision: 0000 Serial No:
Size: 107.35GB <107347968000 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 8 Recoverable: 0
Illegal Request: 1 Predictive Failure Analysis: 0
c3t50060E80102A0D21d22Soft Errors: 1 Hard Errors: 21 Transport Errors: 72367
Vendor: HITACHI  Product: DF600F          Revision: 0000 Serial No:
Size: 107.35GB <107347968000 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 8 Recoverable: 0
Illegal Request: 1 Predictive Failure Analysis: 0
c3t50060E80102A0D21d21Soft Errors: 1 Hard Errors: 8 Transport Errors: 0
Vendor: HITACHI  Product: DF600F          Revision: 0000 Serial No:
Size: 107.35GB <107347968000 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 8 Recoverable: 0
Illegal Request: 1 Predictive Failure Analysis: 0
c3t50060E80102A0D21d16Soft Errors: 1 Hard Errors: 50 Transport Errors: 190011
Vendor: HITACHI  Product: DF600F          Revision: 0000 Serial No:
Size: 107.35GB <107347968000 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 8 Recoverable: 0
Illegal Request: 1 Predictive Failure Analysis: 0
c3t50060E80102A0D21d15Soft Errors: 1 Hard Errors: 33 Transport Errors: 114158
Vendor: HITACHI  Product: DF600F          Revision: 0000 Serial No:
Size: 107.35GB <107347968000 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 8 Recoverable: 0
Illegal Request: 1 Predictive Failure Analysis: 0
c3t50060E80102A0D21d14Soft Errors: 1 Hard Errors: 31 Transport Errors: 80900
Vendor: HITACHI  Product: DF600F          Revision: 0000 Serial No:
Size: 107.35GB <107347968000 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 8 Recoverable: 0
Illegal Request: 1 Predictive Failure Analysis: 0
c3t50060E80102A0D21d4Soft Errors: 1 Hard Errors: 10 Transport Errors: 2
Vendor: HITACHI  Product: DF600F          Revision: 0000 Serial No:
Size: 322.10GB <322102886400 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 8 Recoverable: 0
Illegal Request: 1 Predictive Failure Analysis: 0
------------format ----------

Searching for disks...done


AVAILABLE DISK SELECTIONS:
      0. c1t0d0 <SUN146G cyl 14087 alt 2 hd 24 sec 848>
          /pci@9,600000/SUNW,qlc@2/fp@0,0/ssd@w2100000087ac5a01,0
      1. c1t1d0 <HITACHI-HUS1014FASUN146G-2A08 cyl 14087 alt 2 hd 24 sec 848>
          /pci@9,600000/SUNW,qlc@2/fp@0,0/ssd@w2100000087ac5abb,0
      2. c3t50060E80102A0D21d4 <HITACHI-DF600F-0000 cyl 16382 alt 2 hd 50 sec 768>
          /pci@8,600000/SUNW,qlc@1/fp@0,0/ssd@w50060e80102a0d21,4
      3. c3t50060E80102A0D21d14 <HITACHI-DF600F-0000 cyl 5459 alt 2 hd 50 sec 768>
          /pci@8,600000/SUNW,qlc@1/fp@0,0/ssd@w50060e80102a0d21,e
      4. c3t50060E80102A0D21d15 <HITACHI-DF600F-0000 cyl 5459 alt 2 hd 50 sec 768>
          /pci@8,600000/SUNW,qlc@1/fp@0,0/ssd@w50060e80102a0d21,f
      5. c3t50060E80102A0D21d16 <HITACHI-DF600F-0000 cyl 5459 alt 2 hd 50 sec 768>
          /pci@8,600000/SUNW,qlc@1/fp@0,0/ssd@w50060e80102a0d21,10
      6. c3t50060E80102A0D21d21 <HITACHI-DF600F-0000 cyl 5459 alt 2 hd 50 sec 768>
          /pci@8,600000/SUNW,qlc@1/fp@0,0/ssd@w50060e80102a0d21,15
      7. c3t50060E80102A0D21d22 <HITACHI-DF600F-0000 cyl 5459 alt 2 hd 50 sec 768>
          /pci@8,600000/SUNW,qlc@1/fp@0,0/ssd@w50060e80102a0d21,16
      8. c3t50060E80102A0D21d23 <HITACHI-DF600F-0000 cyl 5459 alt 2 hd 50 sec 768>
          /pci@8,600000/SUNW,qlc@1/fp@0,0/ssd@w50060e80102a0d21,17
      9. c3t50060E80102A0D21d26 <HITACHI-DF600F-0000 cyl 2728 alt 2 hd 50 sec 768>
          /pci@8,600000/SUNW,qlc@1/fp@0,0/ssd@w50060e80102a0d21,1a
      10. c4t50060E80102A0D23d4 <HITACHI-DF600F-0000 cyl 16382 alt 2 hd 50 sec 768>
          /pci@8,600000/SUNW,qlc@2/fp@0,0/ssd@w50060e80102a0d23,4
      11. c4t50060E80102A0D23d14 <HITACHI-DF600F-0000 cyl 5459 alt 2 hd 50 sec 768>
          /pci@8,600000/SUNW,qlc@2/fp@0,0/ssd@w50060e80102a0d23,e
      12. c4t50060E80102A0D23d15 <HITACHI-DF600F-0000 cyl 5459 alt 2 hd 50 sec 768>
          /pci@8,600000/SUNW,qlc@2/fp@0,0/ssd@w50060e80102a0d23,f
      13. c4t50060E80102A0D23d16 <HITACHI-DF600F-0000 cyl 5459 alt 2 hd 50 sec 768>
          /pci@8,600000/SUNW,qlc@2/fp@0,0/ssd@w50060e80102a0d23,10
      14. c4t50060E80102A0D23d21 <HITACHI-DF600F-0000 cyl 5459 alt 2 hd 50 sec 768>
          /pci@8,600000/SUNW,qlc@2/fp@0,0/ssd@w50060e80102a0d23,15
      15. c4t50060E80102A0D23d22 <HITACHI-DF600F-0000 cyl 5459 alt 2 hd 50 sec 768>
          /pci@8,600000/SUNW,qlc@2/fp@0,0/ssd@w50060e80102a0d23,16
      16. c4t50060E80102A0D23d23 <HITACHI-DF600F-0000 cyl 5459 alt 2 hd 50 sec 768>
          /pci@8,600000/SUNW,qlc@2/fp@0,0/ssd@w50060e80102a0d23,17
      17. c4t50060E80102A0D23d26 <HITACHI-DF600F-0000 cyl 2728 alt 2 hd 50 sec 768>
          /pci@8,600000/SUNW,qlc@2/fp@0,0/ssd@w50060e80102a0d23,1a

[ 本帖最后由 hrz520520 于 2009-1-15 18:49 编辑 ]

haishui

我觉得有个盘有问题的，
1.Disconnected command timeout for Target 9
2.WARNING: /pci@1c,600000/scsi@1,1/sd@9,0 (sd24)

建议你检查sd24这个盘的状态。

ljhappy

两块硬盘有坏道了

cdcom

#iostat -En
#format
将这两个命令的结果贴上来！

hrz520520

# iostat -En
c0t0d0          Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: TOSHIBA  Product: ODD-DVD SD-C2732 Revision: 1055 Serial No:
Size: 0.00GB <0 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 0 Predictive Failure Analysis: 0
c1t0d0          Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: HITACHI  Product: HUS1014FASUN146G Revision: 2A08 Serial No: 0730TYK41T
Size: 146.80GB <146800115712 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 0 Predictive Failure Analysis: 0
c1t1d0          Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: HITACHI  Product: HUS1014FASUN146G Revision: 2A08 Serial No: 0730TYK446
Size: 146.80GB <146800115712 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 0 Predictive Failure Analysis: 0
c3t50060E80102A0D21d26Soft Errors: 1 Hard Errors: 8 Transport Errors: 0
Vendor: HITACHI  Product: DF600F           Revision: 0000 Serial No:
Size: 53.65GB <53654323200 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 8 Recoverable: 0
Illegal Request: 1 Predictive Failure Analysis: 0
c3t50060E80102A0D21d23Soft Errors: 1 Hard Errors: 17 Transport Errors: 30290
Vendor: HITACHI  Product: DF600F           Revision: 0000 Serial No:
Size: 107.35GB <107347968000 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 8 Recoverable: 0
Illegal Request: 1 Predictive Failure Analysis: 0
c3t50060E80102A0D21d22Soft Errors: 1 Hard Errors: 21 Transport Errors: 72367
Vendor: HITACHI  Product: DF600F           Revision: 0000 Serial No:
Size: 107.35GB <107347968000 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 8 Recoverable: 0
Illegal Request: 1 Predictive Failure Analysis: 0
c3t50060E80102A0D21d21Soft Errors: 1 Hard Errors: 8 Transport Errors: 0
Vendor: HITACHI  Product: DF600F           Revision: 0000 Serial No:
Size: 107.35GB <107347968000 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 8 Recoverable: 0
Illegal Request: 1 Predictive Failure Analysis: 0
c3t50060E80102A0D21d16Soft Errors: 1 Hard Errors: 50 Transport Errors: 190011
Vendor: HITACHI  Product: DF600F           Revision: 0000 Serial No:
Size: 107.35GB <107347968000 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 8 Recoverable: 0
Illegal Request: 1 Predictive Failure Analysis: 0
c3t50060E80102A0D21d15Soft Errors: 1 Hard Errors: 33 Transport Errors: 114158
Vendor: HITACHI  Product: DF600F           Revision: 0000 Serial No:
Size: 107.35GB <107347968000 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 8 Recoverable: 0
Illegal Request: 1 Predictive Failure Analysis: 0
c3t50060E80102A0D21d14Soft Errors: 1 Hard Errors: 31 Transport Errors: 80900
Vendor: HITACHI  Product: DF600F           Revision: 0000 Serial No:
Size: 107.35GB <107347968000 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 8 Recoverable: 0
Illegal Request: 1 Predictive Failure Analysis: 0
c3t50060E80102A0D21d4Soft Errors: 1 Hard Errors: 10 Transport Errors: 2
Vendor: HITACHI  Product: DF600F           Revision: 0000 Serial No:
Size: 322.10GB <322102886400 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 8 Recoverable: 0
Illegal Request: 1 Predictive Failure Analysis: 0

sunshiene

一天两个mpt报错的帖子。印象中要用patch来解决

hrz520520

我查看了阵列, 没有异常的灯啊,高手帮忙看下啊.谢谢了

非凡公子

阵列一般都会有管理工具的,在那里看看硬盘的状态

hrz520520

我用管理软件看了,状态都是Normal啊

沙中有金

是直连还是用了光纤交换机，用没用多路径软件，另外format中也有C4我估计是用的多路径吧，如果用的是多路径双active，那都是/pci@8,600000/SUNW,qlc@1/fp@0,0/ssd@这个上面报错，我觉得是这个通道上出现异常，请检查PCI Slot 0的光纤卡或者相连的光纤交换机还有相应的控制器端口，如果用的HDML管理多路径，也请一并检查。

[ 本帖最后由 沙中有金 于 2009-1-18 10:46 编辑 ]