Chinaunix

标题: 求大神帮忙看下是哪里出现了故障，是链路问题还是储存阵列 [打印本页]

作者: N0N?sas 时间: 2016-01-20 11:21
标题: 求大神帮忙看下是哪里出现了故障，是链路问题还是储存阵列
M5000报错，储存上有坏块，数据库向储存上写数据有延迟...
储存是sun 6140，CAM查看储存无任何报错。

root@eoms4-2 # dmesg

Wed Jan 20 10:48:14 CST 2016
Jan 19 11:06:11 eoms4-2 scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g600a0b8000560e2a000004154af0f896 (ssd21):
Jan 19 11:06:11 eoms4-2       Error for Command: write(10)             Error Level: Retryable
Jan 19 11:06:11 eoms4-2 scsi: [ID 107833 kern.notice] Requested Block: 114072960                Error Block: 114072960
Jan 19 11:06:11 eoms4-2 scsi: [ID 107833 kern.notice] Vendor: SUN                               Serial Number:
Jan 19 11:06:11 eoms4-2 scsi: [ID 107833 kern.notice] Sense Key: Unit Attention
Jan 19 11:06:11 eoms4-2 scsi: [ID 107833 kern.notice] ASC: 0x3f (inquiry data has changed), ASCQ: 0x3, FRU: 0x0
Jan 19 11:06:11 eoms4-2 scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g600a0b8000560e2a000004194af0f96c (ssd19):
Jan 19 11:06:11 eoms4-2       Error for Command: write(10)             Error Level: Retryable
Jan 19 11:06:11 eoms4-2 scsi: [ID 107833 kern.notice] Requested Block: 1473712                Error Block: 1473712
Jan 19 11:06:11 eoms4-2 scsi: [ID 107833 kern.notice] Vendor: SUN                               Serial Number:
Jan 19 11:06:11 eoms4-2 scsi: [ID 107833 kern.notice] Sense Key: Unit Attention
Jan 19 11:06:11 eoms4-2 scsi: [ID 107833 kern.notice] ASC: 0x3f (inquiry data has changed), ASCQ: 0x3, FRU: 0x0
Jan 19 11:06:11 eoms4-2 scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g600a0b8000560e2a000004104af0f78c (ssd23):
Jan 19 11:06:11 eoms4-2       Error for Command: read(10)             Error Level: Retryable
Jan 19 11:06:11 eoms4-2 scsi: [ID 107833 kern.notice] Requested Block: 811876480                Error Block: 811876480
Jan 19 11:06:11 eoms4-2 scsi: [ID 107833 kern.notice] Vendor: SUN                               Serial Number:
Jan 19 11:06:11 eoms4-2 scsi: [ID 107833 kern.notice] Sense Key: Unit Attention
Jan 19 11:06:11 eoms4-2 scsi: [ID 107833 kern.notice] ASC: 0x3f (inquiry data has changed), ASCQ: 0x3, FRU: 0x0
Jan 19 11:06:15 eoms4-2 scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g600a0b8000560e2a000004134af0f839 (ssd22):
Jan 19 11:06:15 eoms4-2       Error for Command: write(10)             Error Level: Retryable
Jan 19 11:06:15 eoms4-2 scsi: [ID 107833 kern.notice] Requested Block: 106171                   Error Block: 106171
Jan 19 11:06:15 eoms4-2 scsi: [ID 107833 kern.notice] Vendor: SUN                               Serial Number:
Jan 19 11:06:15 eoms4-2 scsi: [ID 107833 kern.notice] Sense Key: Unit Attention
Jan 19 11:06:15 eoms4-2 scsi: [ID 107833 kern.notice] ASC: 0x3f (inquiry data has changed), ASCQ: 0x3, FRU: 0x0
Jan 19 11:16:55 eoms4-2 fctl: [ID 517869 kern.warning] WARNING: fp(0)::GPN_ID for D_ID=10800 failed
Jan 19 11:16:55 eoms4-2 fctl: [ID 517869 kern.warning] WARNING: fp(0)::N_x Port with D_ID=10800, PWWN=200200a0b8560e2b disappeared from fabric
Jan 19 11:17:14 eoms4-2 scsi: [ID 243001 kern.info] /pci@1,700000/SUNW,qlc@0/fp@0,0 (fcp0):
Jan 19 11:17:14 eoms4-2       offlining lun=5 (trace=0), target=10800 (trace=2800004)
Jan 19 11:17:14 eoms4-2 scsi: [ID 243001 kern.info] /pci@1,700000/SUNW,qlc@0/fp@0,0 (fcp0):
Jan 19 11:17:14 eoms4-2       offlining lun=4 (trace=0), target=10800 (trace=2800004)
Jan 19 11:17:14 eoms4-2 scsi: [ID 243001 kern.info] /pci@1,700000/SUNW,qlc@0/fp@0,0 (fcp0):
Jan 19 11:17:14 eoms4-2       offlining lun=3 (trace=0), target=10800 (trace=2800004)
Jan 19 11:17:14 eoms4-2 scsi: [ID 243001 kern.info] /pci@1,700000/SUNW,qlc@0/fp@0,0 (fcp0):
Jan 19 11:17:14 eoms4-2       offlining lun=2 (trace=0), target=10800 (trace=2800004)
Jan 19 11:17:14 eoms4-2 scsi: [ID 243001 kern.info] /pci@1,700000/SUNW,qlc@0/fp@0,0 (fcp0):
Jan 19 11:17:14 eoms4-2       offlining lun=1 (trace=0), target=10800 (trace=2800004)
Jan 19 11:17:14 eoms4-2 scsi: [ID 243001 kern.info] /pci@1,700000/SUNW,qlc@0/fp@0,0 (fcp0):
Jan 19 11:17:14 eoms4-2       offlining lun=0 (trace=0), target=10800 (trace=2800004)
Jan 19 11:17:14 eoms4-2 genunix: [ID 834635 kern.info] /scsi_vhci/ssd@g600a0b8000560e2a0000041b4af0f9b6 (ssd1

multipath status: degraded, path /pci@1,700000/SUNW,qlc@0/fp@0,0 (fp0) to target address: w200200a0b8560e2b,5 is offline Load balancing: round-robin
Jan 19 11:17:14 eoms4-2 genunix: [ID 834635 kern.info] /scsi_vhci/ssd@g600a0b8000560e2a000004194af0f96c (ssd19) multipath status: degraded, path /pci@1,700000/SUNW,qlc@0/fp@0,0 (fp0) to target address: w200200a0b8560e2b,4 is offline Load balancing: round-robin
Jan 19 11:17:14 eoms4-2 genunix: [ID 834635 kern.info] /scsi_vhci/ssd@g600a0b8000560e2a000004174af0f923 (ssd20) multipath status: degraded, path /pci@1,700000/SUNW,qlc@0/fp@0,0 (fp0) to target address: w200200a0b8560e2b,3 is offline Load balancing: round-robin
Jan 19 11:17:14 eoms4-2 genunix: [ID 834635 kern.info] /scsi_vhci/ssd@g600a0b8000560e2a000004154af0f896 (ssd21) multipath status: degraded, path /pci@1,700000/SUNW,qlc@0/fp@0,0 (fp0) to target address: w200200a0b8560e2b,2 is offline Load balancing: round-robin
Jan 19 11:17:14 eoms4-2 genunix: [ID 834635 kern.info] /scsi_vhci/ssd@g600a0b8000560e2a000004134af0f839 (ssd22) multipath status: degraded, path /pci@1,700000/SUNW,qlc@0/fp@0,0 (fp0) to target address: w200200a0b8560e2b,1 is offline Load balancing: round-robin
Jan 19 11:17:14 eoms4-2 genunix: [ID 834635 kern.info] /scsi_vhci/ssd@g600a0b8000560e2a000004104af0f78c (ssd23) multipath status: degraded, path /pci@1,700000/SUNW,qlc@0/fp@0,0 (fp0) to target address: w200200a0b8560e2b,0 is offline Load balancing: round-robin
Jan 19 11:17:15 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:17:15 eoms4-2       Initiating failover for device ssd (GUID 600a0b8000560e2a000004154af0f896)
Jan 19 11:17:15 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:17:15 eoms4-2       Initiating failover for device ssd (GUID 600a0b8000560e2a000004194af0f96c)
Jan 19 11:17:15 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:17:15 eoms4-2       Initiating failover for device ssd (GUID 600a0b8000560e2a000004104af0f78c)
Jan 19 11:17:15 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:17:15 eoms4-2       Initiating failover for device ssd (GUID 600a0b8000560e2a000004174af0f923)
Jan 19 11:17:15 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:17:15 eoms4-2       Initiating failover for device ssd (GUID 600a0b8000560e2a0000041b4af0f9b6)
Jan 19 11:17:24 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:17:24 eoms4-2       Failover operation completed successfully for device ssd (GUID 600a0b8000560e2a000004154af0f896): failed over from primary to secondary
Jan 19 11:17:24 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:17:24 eoms4-2       Initiating failover for device ssd (GUID 600a0b8000560e2a000004134af0f839)
Jan 19 11:17:24 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:17:24 eoms4-2       Failover operation completed successfully for device ssd (GUID 600a0b8000560e2a000004134af0f839): failed over from primary to secondary
Jan 19 11:17:24 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:17:24 eoms4-2       Failover operation completed successfully for device ssd (GUID 600a0b8000560e2a000004194af0f96c): failed over from primary to secondary
Jan 19 11:17:24 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:17:24 eoms4-2       Failover operation completed successfully for device ssd (GUID 600a0b8000560e2a000004104af0f78c): failed over from primary to secondary
Jan 19 11:17:25 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:17:25 eoms4-2       Failover operation completed successfully for device ssd (GUID 600a0b8000560e2a0000041b4af0f9b6): failed over from primary to secondary
Jan 19 11:17:25 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:17:25 eoms4-2       Failover operation completed successfully for device ssd (GUID 600a0b8000560e2a000004174af0f923): failed over from primary to secondary
Jan 19 11:17:48 eoms4-2 fctl: [ID 517869 kern.warning] WARNING: fp(0)::N_x Port with D_ID=10800, PWWN=200200a0b8560e2b reappeared in fabric
Jan 19 11:17:48 eoms4-2 genunix: [ID 834635 kern.info] /scsi_vhci/ssd@g600a0b8000560e2a0000041b4af0f9b6 (ssd1

multipath status: optimal, path /pci@1,700000/SUNW,qlc@0/fp@0,0 (fp0) to target address: w200200a0b8560e2b,5 is standby Load balancing: round-robin
Jan 19 11:17:48 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:17:48 eoms4-2       Initiating failover for device ssd (GUID 600a0b8000560e2a0000041b4af0f9b6)
Jan 19 11:17:48 eoms4-2 genunix: [ID 834635 kern.info] /scsi_vhci/ssd@g600a0b8000560e2a000004194af0f96c (ssd19) multipath status: optimal, path /pci@1,700000/SUNW,qlc@0/fp@0,0 (fp0) to target address: w200200a0b8560e2b,4 is standby Load balancing: round-robin
Jan 19 11:17:48 eoms4-2 genunix: [ID 834635 kern.info] /scsi_vhci/ssd@g600a0b8000560e2a000004174af0f923 (ssd20) multipath status: optimal, path /pci@1,700000/SUNW,qlc@0/fp@0,0 (fp0) to target address: w200200a0b8560e2b,3 is standby Load balancing: round-robin
Jan 19 11:17:48 eoms4-2 genunix: [ID 834635 kern.info] /scsi_vhci/ssd@g600a0b8000560e2a000004154af0f896 (ssd21) multipath status: optimal, path /pci@1,700000/SUNW,qlc@0/fp@0,0 (fp0) to target address: w200200a0b8560e2b,2 is standby Load balancing: round-robin
Jan 19 11:17:49 eoms4-2 genunix: [ID 834635 kern.info] /scsi_vhci/ssd@g600a0b8000560e2a000004134af0f839 (ssd22) multipath status: optimal, path /pci@1,700000/SUNW,qlc@0/fp@0,0 (fp0) to target address: w200200a0b8560e2b,1 is standby Load balancing: round-robin
Jan 19 11:17:50 eoms4-2 genunix: [ID 834635 kern.info] /scsi_vhci/ssd@g600a0b8000560e2a000004104af0f78c (ssd23) multipath status: optimal, path /pci@1,700000/SUNW,qlc@0/fp@0,0 (fp0) to target address: w200200a0b8560e2b,0 is standby Load balancing: round-robin
Jan 19 11:18:10 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:18:10 eoms4-2       Failover operation completed successfully for device ssd (GUID 600a0b8000560e2a0000041b4af0f9b6): failed over from secondary to primary
Jan 19 11:18:10 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:18:10 eoms4-2       Auto failback operation succeeded for device ssd (GUID 600a0b8000560e2a0000041b4af0f9b6)
Jan 19 11:18:10 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:18:10 eoms4-2       Initiating failover for device ssd (GUID 600a0b8000560e2a000004194af0f96c)
Jan 19 11:18:12 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:18:12 eoms4-2       Failover operation completed successfully for device ssd (GUID 600a0b8000560e2a000004194af0f96c): failed over from secondary to primary
Jan 19 11:18:12 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:18:12 eoms4-2       Auto failback operation succeeded for device ssd (GUID 600a0b8000560e2a000004194af0f96c)
Jan 19 11:18:12 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:18:12 eoms4-2       Initiating failover for device ssd (GUID 600a0b8000560e2a000004174af0f923)
Jan 19 11:18:15 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:18:15 eoms4-2       Failover operation completed successfully for device ssd (GUID 600a0b8000560e2a000004174af0f923): failed over from secondary to primary
Jan 19 11:18:15 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:18:15 eoms4-2       Auto failback operation succeeded for device ssd (GUID 600a0b8000560e2a000004174af0f923)
Jan 19 11:18:15 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:18:15 eoms4-2       Initiating failover for device ssd (GUID 600a0b8000560e2a000004154af0f896)
Jan 19 11:18:18 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:18:18 eoms4-2       Failover operation completed successfully for device ssd (GUID 600a0b8000560e2a000004154af0f896): failed over from secondary to primary
Jan 19 11:18:18 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:18:18 eoms4-2       Auto failback operation succeeded for device ssd (GUID 600a0b8000560e2a000004154af0f896)
Jan 19 11:18:18 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:18:18 eoms4-2       Initiating failover for device ssd (GUID 600a0b8000560e2a000004134af0f839)
Jan 19 11:18:21 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:18:21 eoms4-2       Failover operation completed successfully for device ssd (GUID 600a0b8000560e2a000004134af0f839): failed over from secondary to primary
Jan 19 11:18:21 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:18:21 eoms4-2       Auto failback operation succeeded for device ssd (GUID 600a0b8000560e2a000004134af0f839)
Jan 19 11:18:21 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:18:21 eoms4-2       Initiating failover for device ssd (GUID 600a0b8000560e2a000004104af0f78c)
Jan 19 11:18:23 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:18:23 eoms4-2       Failover operation completed successfully for device ssd (GUID 600a0b8000560e2a000004104af0f78c): failed over from secondary to primary
Jan 19 11:18:23 eoms4-2 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Jan 19 11:18:23 eoms4-2       Auto failback operation succeeded for device ssd (GUID 600a0b8000560e2a000004104af0f78c)
Jan 19 21:51:05 eoms4-2 scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g600a0b8000560e2a000004104af0f78c (ssd23):
Jan 19 21:51:05 eoms4-2       Error for Command: write(10)             Error Level: Retryable
Jan 19 21:51:05 eoms4-2 scsi: [ID 107833 kern.notice] Requested Block: 819929087                Error Block: 819929087
Jan 19 21:51:05 eoms4-2 scsi: [ID 107833 kern.notice] Vendor: SUN                               Serial Number:
Jan 19 21:51:05 eoms4-2 scsi: [ID 107833 kern.notice] Sense Key: Unit Attention
Jan 19 21:51:05 eoms4-2 scsi: [ID 107833 kern.notice] ASC: 0x3f (inquiry data has changed), ASCQ: 0x3, FRU: 0x0
Jan 19 21:51:05 eoms4-2 scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g600a0b8000560e2a000004154af0f896 (ssd21):
Jan 19 21:51:05 eoms4-2       Error for Command: write(10)             Error Level: Retryable
Jan 19 21:51:05 eoms4-2 scsi: [ID 107833 kern.notice] Requested Block: 116338352                Error Block: 116338352
Jan 19 21:51:05 eoms4-2 scsi: [ID 107833 kern.notice] Vendor: SUN                               Serial Number:
Jan 19 21:51:05 eoms4-2 scsi: [ID 107833 kern.notice] Sense Key: Unit Attention
Jan 19 21:51:05 eoms4-2 scsi: [ID 107833 kern.notice] ASC: 0x3f (inquiry data has changed), ASCQ: 0x3, FRU: 0x0
Jan 19 21:51:05 eoms4-2 scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g600a0b8000560e2a000004194af0f96c (ssd19):
Jan 19 21:51:05 eoms4-2       Error for Command: write(10)             Error Level: Retryable
Jan 19 21:51:05 eoms4-2 scsi: [ID 107833 kern.notice] Requested Block: 83568                   Error Block: 83568
Jan 19 21:51:05 eoms4-2 scsi: [ID 107833 kern.notice] Vendor: SUN                               Serial Number:
Jan 19 21:51:05 eoms4-2 scsi: [ID 107833 kern.notice] Sense Key: Unit Attention
Jan 19 21:51:05 eoms4-2 scsi: [ID 107833 kern.notice] ASC: 0x3f (inquiry data has changed), ASCQ: 0x3, FRU: 0x0
Jan 19 21:55:14 eoms4-2 scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g600a0b8000560e2a000004134af0f839 (ssd22):
Jan 19 21:55:14 eoms4-2       Error for Command: write(10)             Error Level: Retryable
Jan 19 21:55:14 eoms4-2 scsi: [ID 107833 kern.notice] Requested Block: 121968                   Error Block: 121968
Jan 19 21:55:14 eoms4-2 scsi: [ID 107833 kern.notice] Vendor: SUN                               Serial Number:
Jan 19 21:55:14 eoms4-2 scsi: [ID 107833 kern.notice] Sense Key: Unit Attention
Jan 19 21:55:14 eoms4-2 scsi: [ID 107833 kern.notice] ASC: 0x3f (inquiry data has changed), ASCQ: 0x3, FRU: 0x0
Jan 19 23:03:24 eoms4-2 explorer: [ID 702911 daemon.notice] Explorer started
Jan 19 23:16:43 eoms4-2 Cluster.CCR: [ID 988885 daemon.error] libpnm error: can't connect to PNMd on eoms4-1.
Jan 19 23:25:13 eoms4-2 last message repeated 2 times
Jan 19 23:33:44 eoms4-2 Cluster.CCR: [ID 988885 daemon.error] libpnm error: can't connect to PNMd on eoms4-1.
Jan 19 23:44:04 eoms4-2 scsi: [ID 243001 kern.info] /pci@0,600000/pci@0/pci@9/SUNW,qlc@0/fp@0,0/st@w2100001b3202e552,1 (st6):
Jan 19 23:44:04 eoms4-2       st_tape_init: Error on READ BLOCK LIMITS, errno = 13 un_rsvd_status = 0x12
Jan 19 23:44:04 eoms4-2 scsi: [ID 243001 kern.info] /pci@0,600000/pci@0/pci@9/SUNW,qlc@0/fp@0,0/st@w2100001b3202e552,0 (st7):
Jan 19 23:44:04 eoms4-2       st_tape_init: Error on READ BLOCK LIMITS, errno = 13 un_rsvd_status = 0x12
Jan 19 23:44:04 eoms4-2 scsi: [ID 243001 kern.info] /pci@1,700000/SUNW,qlc@0/fp@0,0/st@w21000024ff3cbdf6,1 (st10):
Jan 19 23:44:04 eoms4-2       st_tape_init: Error on READ BLOCK LIMITS, errno = 13 un_rsvd_status = 0x12
Jan 19 23:44:04 eoms4-2 scsi: [ID 243001 kern.info] /pci@1,700000/SUNW,qlc@0/fp@0,0/st@w21000024ff3cbdf6,0 (st11):
Jan 19 23:44:04 eoms4-2       st_tape_init: Error on READ BLOCK LIMITS, errno = 13 un_rsvd_status = 0x12
Jan 19 23:44:04 eoms4-2 scsi: [ID 243001 kern.info] /pci@0,600000/pci@0/pci@9/SUNW,qlc@0/fp@0,0/st@w21000024ff3ccf32,1 (st12):
Jan 19 23:44:04 eoms4-2       st_tape_init: Error on READ BLOCK LIMITS, errno = 13 un_rsvd_status = 0x12
Jan 19 23:44:04 eoms4-2 scsi: [ID 243001 kern.info] /pci@0,600000/pci@0/pci@9/SUNW,qlc@0/fp@0,0/st@w21000024ff3ccf32,0 (st13):
Jan 19 23:44:04 eoms4-2       st_tape_init: Error on READ BLOCK LIMITS, errno = 13 un_rsvd_status = 0x12
Jan 19 23:48:41 eoms4-2 explorer: [ID 702911 daemon.notice] Explorer finished
Jan 20 00:16:32 eoms4-2 scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g600a0b8000560e2a000004154af0f896 (ssd21):
Jan 20 00:16:32 eoms4-2       Error for Command: read(10)             Error Level: Retryable
Jan 20 00:16:32 eoms4-2 scsi: [ID 107833 kern.notice] Requested Block: 1029327808             Error Block: 1029327808
Jan 20 00:16:32 eoms4-2 scsi: [ID 107833 kern.notice] Vendor: SUN                               Serial Number:
Jan 20 00:16:32 eoms4-2 scsi: [ID 107833 kern.notice] Sense Key: Unit Attention
Jan 20 00:16:32 eoms4-2 scsi: [ID 107833 kern.notice] ASC: 0x3f (inquiry data has changed), ASCQ: 0x3, FRU: 0x0
Jan 20 00:16:32 eoms4-2 scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g600a0b8000560e2a000004104af0f78c (ssd23):
Jan 20 00:16:32 eoms4-2       Error for Command: read(10)             Error Level: Retryable
Jan 20 00:16:32 eoms4-2 scsi: [ID 107833 kern.notice] Requested Block: 384659728                Error Block: 384659728
Jan 20 00:16:32 eoms4-2 scsi: [ID 107833 kern.notice] Vendor: SUN                               Serial Number:
Jan 20 00:16:32 eoms4-2 scsi: [ID 107833 kern.notice] Sense Key: Unit Attention
Jan 20 00:16:32 eoms4-2 scsi: [ID 107833 kern.notice] ASC: 0x3f (inquiry data has changed), ASCQ: 0x3, FRU: 0x0
Jan 20 00:16:50 eoms4-2 scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g600a0b8000560e2a000004134af0f839 (ssd22):
Jan 20 00:16:50 eoms4-2       Error for Command: write(10)             Error Level: Retryable
Jan 20 00:16:50 eoms4-2 scsi: [ID 107833 kern.notice] Requested Block: 125084                   Error Block: 125084
Jan 20 00:16:50 eoms4-2 scsi: [ID 107833 kern.notice] Vendor: SUN                               Serial Number:
Jan 20 00:16:50 eoms4-2 scsi: [ID 107833 kern.notice] Sense Key: Unit Attention
Jan 20 00:16:50 eoms4-2 scsi: [ID 107833 kern.notice] ASC: 0x3f (inquiry data has changed), ASCQ: 0x3, FRU: 0x0

root@eoms4-2 # iostat -En
c0t1d0          Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: SEAGATE  Product: ST914602SSUN146G Revision: 0603 Serial No: 090298GH63
Size: 146.81GB <146810536448 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 0 Predictive Failure Analysis: 0
c0t0d0          Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: SEAGATE  Product: ST914602SSUN146G Revision: 0603 Serial No: 090298J82F
Size: 146.81GB <146810536448 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 0 Predictive Failure Analysis: 0
c0t3d0          Soft Errors: 2 Hard Errors: 0 Transport Errors: 0
Vendor: TEAC    Product: DV-W28E-R       Revision: M.0B Serial No:
Size: 0.00GB <0 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 2 Predictive Failure Analysis: 0
c3t600A0B8000560E2A0000041B4AF0F9B6d0 Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: SUN    Product: CSM200_R       Revision: 0710 Serial No:
Size: 1.07GB <1073741824 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 0 Predictive Failure Analysis: 0
c3t600A0B8000560E2A000004194AF0F96Cd0 Soft Errors: 5 Hard Errors: 47 Transport Errors: 33
Vendor: SUN    Product: CSM200_R       Revision: 0710 Serial No:
Size: 67.11GB <67108864000 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 14 Recoverable: 5
Illegal Request: 0 Predictive Failure Analysis: 0
c3t600A0B8000560E2A000004174AF0F923d0 Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: SUN    Product: CSM200_R       Revision: 0710 Serial No:
Size: 66.06GB <66060288000 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 0 Predictive Failure Analysis: 0
c3t600A0B8000560E2A000004154AF0F896d0 Soft Errors: 7 Hard Errors: 72 Transport Errors: 37
Vendor: SUN    Product: CSM200_R       Revision: 0710 Serial No:
Size: 744.49GB <744488960000 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 35 Recoverable: 7
Illegal Request: 0 Predictive Failure Analysis: 0
c3t600A0B8000560E2A000004134AF0F839d0 Soft Errors: 1 Hard Errors: 20 Transport Errors: 0
Vendor: SUN    Product: CSM200_R       Revision: 0710 Serial No:
Size: 54.53GB <54525952000 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 20 Recoverable: 1
Illegal Request: 0 Predictive Failure Analysis: 0
c3t600A0B8000560E2A000004104AF0F78Cd0 Soft Errors: 47 Hard Errors: 64 Transport Errors: 29
Vendor: SUN    Product: CSM200_R       Revision: 0710 Serial No:
Size: 440.40GB <440401920000 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 35 Recoverable: 47
Illegal Request: 0 Predictive Failure Analysis: 0
c3t60060E8010406F5004F281B500000010d0 Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: HITACHI  Product: DF600F          Revision: 0000 Serial No:
Size: 214.75GB <214748364800 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 0 Predictive Failure Analysis: 0
c3t60060E8010406F5004F281B50000000Fd0 Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: HITACHI  Product: DF600F          Revision: 0000 Serial No:
Size: 214.75GB <214748364800 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 0 Predictive Failure Analysis: 0
c3t60060E8010406F5004F281B50000000Ed0 Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: HITACHI  Product: DF600F          Revision: 0000 Serial No:
Size: 536.87GB <536870912000 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 0 Predictive Failure Analysis: 0
c3t60060E8010406F5004F281B50000000Dd0 Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: HITACHI  Product: DF600F          Revision: 0000 Serial No:
Size: 2199.02GB <2199023255552 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 0 Predictive Failure Analysis: 0
c3t60060E8010406F5004F281B50000000Cd0 Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: HITACHI  Product: DF600F          Revision: 0000 Serial No:
Size: 1099.51GB <1099511627776 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 0 Predictive Failure Analysis: 0
rmt/0          Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: HP    Product: Ultrium 4-SCSI Revision: H45S Serial No:
rmt/1          Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: HP    Product: Ultrium 4-SCSI Revision: H45S Serial No:
rmt/3          Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: HP    Product: Ultrium 4-SCSI Revision: H45S Serial No:
rmt/4          Soft Errors: 0 Hard Errors: 58668 Transport Errors: 20
Vendor: ARCHIVE  Product: Python          Revision: V000 Serial No:
rmt/5          Soft Errors: 0 Hard Errors: 9 Transport Errors: 0
Vendor: ARCHIVE  Product: Python          Revision: V000 Serial No:
rmt/6          Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: ARCHIVE  Product: Python          Revision: V000 Serial No:
rmt/7          Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: ARCHIVE  Product: Python          Revision: V000 Serial No:
rmt/8          Soft Errors: 0 Hard Errors: 953113 Transport Errors: 0
Vendor: ARCHIVE  Product: Python          Revision: V000 Serial No:
rmt/9          Soft Errors: 0 Hard Errors: 674881 Transport Errors: 0
Vendor: ARCHIVE  Product: Python          Revision: V000 Serial No:
rmt/10          Soft Errors: 0 Hard Errors: 7 Transport Errors: 0
Vendor: ARCHIVE  Product: Python          Revision: V000 Serial No:
rmt/11          Soft Errors: 0 Hard Errors: 7 Transport Errors: 0
Vendor: ARCHIVE  Product: Python          Revision: V000 Serial No:

root@eoms4-2 # luxadm -e port
/devices/pci@1,700000/SUNW,qlc@0/fp@0,0:devctl                   CONNECTED
/devices/pci@0,600000/pci@0/pci@9/SUNW,qlc@0/fp@0,0:devctl       CONNECTED

root@eoms4-2 # luxadm -e dump_map /devices/pci@1,700000/SUNW,qlc@0/fp@0,0:devctl
Pos  Port_ID Hard_Addr Port WWN       Node WWN       Type
0 10200 0       500104f000b812b9 500104f000b812b8 0x1  (Tape device)
1 10600 0       500104f000b812bc 500104f000b812bb 0x1  (Tape device)
2 10800 0       200200a0b8560e2b 200200a0b8560e2a 0x0  (Disk device)
3 10a00 0       2100001b32812ec3 2000001b32812ec3 0x1f (Unknown Type)
4 1199f 9f       256000c0ffca7ed6 206000c0ff0a7ed6 0xd  (SES device)
5 12100 0       21000024ff3cbdf6 20000024ff3cbdf6 0x1  (Tape device)
6 10900 0       2100001b32816ac5 2000001b32816ac5 0x1f (Unknown Type,Host Bus Adapter)
root@eoms4-2 # luxadm -e dump_map /devices/pci@0,600000/pci@0/pci@9/SUNW,qlc@0/fp@0,0:devctl
Pos  Port_ID Hard_Addr Port WWN       Node WWN       Type
0 10200 0       10000000c9b7bdf3 20000000c9b7bdf3 0x1f (Unknown Type)
1 10300 0       500104f000b812a9 500104f000b812a8 0x8  (Medium changer device)
2 10600 0       500104f000b812b6 500104f000b812b5 0x1  (Tape device)
3 10800 0       200300a0b8560e2b 200200a0b8560e2a 0x0  (Disk device)
4 10900 0       2100001b328142c0 2000001b328142c0 0x1f (Unknown Type)
5 119a7 a7       216000c0ff8a7ed6 206000c0ff0a7ed6 0xd  (SES device)
6 12100 0       21000024ff3ccf32 20000024ff3ccf32 0x1  (Tape device)
7 648300  0       50060e8010406f5d 50060e8010406f5d 0x0  (Disk device)
8 64c300  0       50060e8010406f55 50060e8010406f55 0x0  (Disk device)
9 64e800  0       2100001b320bfa43 2000001b320bfa43 0x1  (Tape device)
10 64ea00  0       2100001b3202e552 2000001b3202e552 0x1  (Tape device)
11 10a00 0       2100001b32813cc3 2000001b32813cc3 0x1f (Unknown Type,Host Bus Adapter)

root@eoms4-2 # luxadm  probe
No Network Array enclosures found in /dev/es

Found Fibre Channel device(s):
  Node WWN:200200a0b8560e2a  Device Type

isk device
Logical Path:/dev/rdsk/c3t600A0B8000560E2A0000041B4AF0F9B6d0s2
Node WWN:200200a0b8560e2a Device Type

isk device
Logical Path:/dev/rdsk/c3t600A0B8000560E2A000004104AF0F78Cd0s2
Node WWN:200200a0b8560e2a Device Type

isk device
Logical Path:/dev/rdsk/c3t600A0B8000560E2A000004134AF0F839d0s2
Node WWN:200200a0b8560e2a Device Type

isk device
Logical Path:/dev/rdsk/c3t600A0B8000560E2A000004154AF0F896d0s2
Node WWN:200200a0b8560e2a Device Type

isk device
Logical Path:/dev/rdsk/c3t600A0B8000560E2A000004174AF0F923d0s2
Node WWN:200200a0b8560e2a Device Type

isk device
Logical Path:/dev/rdsk/c3t600A0B8000560E2A000004194AF0F96Cd0s2
Node WWN:50060e8010406f5d Device Type

isk device
Logical Path:/dev/rdsk/c3t60060E8010406F5004F281B50000000Cd0s2
Node WWN:50060e8010406f5d Device Type

isk device
Logical Path:/dev/rdsk/c3t60060E8010406F5004F281B50000000Dd0s2
Node WWN:50060e8010406f5d Device Type

isk device
Logical Path:/dev/rdsk/c3t60060E8010406F5004F281B50000000Ed0s2
Node WWN:50060e8010406f5d Device Type

isk device
Logical Path:/dev/rdsk/c3t60060E8010406F5004F281B50000000Fd0s2
  Node WWN:50060e8010406f5d  Device Type:Disk device
Logical Path:/dev/rdsk/c3t60060E8010406F5004F281B500000010d0s2
  Node WWN:500104f000b812b8  Device Type:Tape device
Logical Path:/dev/rmt/0n
  Node WWN:500104f000b812bb  Device Type:Tape device
Logical Path:/dev/rmt/1n
  Node WWN:500104f000b812b5  Device Type:Tape device
Logical Path:/dev/rmt/3n
  Node WWN:2000001b3202e552  Device Type:Tape device
Logical Path:/dev/rmt/4n
  Node WWN:2000001b3202e552  Device Type:Tape device
Logical Path:/dev/rmt/5n
  Node WWN:20000024ff3cbdf6  Device Type:Tape device
Logical Path:/dev/rmt/8n
  Node WWN:20000024ff3cbdf6  Device Type:Tape device
Logical Path:/dev/rmt/9n
  Node WWN:20000024ff3ccf32  Device Type:Tape device
Logical Path:/dev/rmt/10n
  Node WWN:20000024ff3ccf32  Device Type:Tape device
Logical Path:/dev/rmt/11n
root@eoms4-2 # luxadm disp /dev/rdsk/c3t600A0B8000560E2A0000041B4AF0F9B6d0s2
DEVICE PROPERTIES for disk: /dev/rdsk/c3t600A0B8000560E2A0000041B4AF0F9B6d0s2
  Vendor:             SUN
  Product ID:          CSM200_R
  Revision:          0710
  Serial Num:          SG84746423
  Unformatted capacity: 1024.000 MBytes
  Write Cache:       Enabled
  Read Cache:          Enabled
Minimum prefetch: 0x3
Maximum prefetch: 0x0
  Device Type:       Disk device
  Path(s):

  /dev/rdsk/c3t600A0B8000560E2A0000041B4AF0F9B6d0s2
  /devices/scsi_vhci/ssd@g600a0b8000560e2a0000041b4af0f9b6:c,raw
Controller          /devices/pci@1,700000/SUNW,qlc@0/fp@0,0
Device Address             200200a0b8560e2b,5
Host controller port WWN 2100001b32816ac5
Class                      primary
State                      ONLINE
Controller          /devices/pci@0,600000/pci@0/pci@9/SUNW,qlc@0/fp@0,0
Device Address             200300a0b8560e2b,5
Host controller port WWN 2100001b32813cc3
Class                      secondary
State                      STANDBY

root@eoms4-2 # luxadm disp /dev/rdsk/c3t600A0B8000560E2A000004104AF0F78Cd0s2
DEVICE PROPERTIES for disk: /dev/rdsk/c3t600A0B8000560E2A000004104AF0F78Cd0s2
  Vendor:             SUN
  Product ID:          CSM200_R
  Revision:          0710
  Serial Num:          SG84746423
  Unformatted capacity: 420000.000 MBytes
  Write Cache:       Enabled
  Read Cache:          Enabled
Minimum prefetch: 0x3
Maximum prefetch: 0x0
  Device Type:       Disk device
  Path(s):

  /dev/rdsk/c3t600A0B8000560E2A000004104AF0F78Cd0s2
  /devices/scsi_vhci/ssd@g600a0b8000560e2a000004104af0f78c:c,raw
Controller          /devices/pci@1,700000/SUNW,qlc@0/fp@0,0
Device Address             200200a0b8560e2b,0
Host controller port WWN 2100001b32816ac5
Class                      primary
State                      ONLINE
Controller          /devices/pci@0,600000/pci@0/pci@9/SUNW,qlc@0/fp@0,0
Device Address             200300a0b8560e2b,0
Host controller port WWN 2100001b32813cc3
Class                      secondary
State                      STANDBY

root@eoms4-2 # luxadm disp /dev/rdsk/c3t600A0B8000560E2A000004134AF0F839d0s2
DEVICE PROPERTIES for disk: /dev/rdsk/c3t600A0B8000560E2A000004134AF0F839d0s2
  Vendor:             SUN
  Product ID:          CSM200_R
  Revision:          0710
  Serial Num:          SG84746423
  Unformatted capacity: 52000.000 MBytes
  Write Cache:       Enabled
  Read Cache:          Enabled
Minimum prefetch: 0x3
Maximum prefetch: 0x0
  Device Type:       Disk device
  Path(s):

  /dev/rdsk/c3t600A0B8000560E2A000004134AF0F839d0s2
  /devices/scsi_vhci/ssd@g600a0b8000560e2a000004134af0f839:c,raw
Controller          /devices/pci@1,700000/SUNW,qlc@0/fp@0,0
Device Address             200200a0b8560e2b,1
Host controller port WWN 2100001b32816ac5
Class                      primary
State                      ONLINE
Controller          /devices/pci@0,600000/pci@0/pci@9/SUNW,qlc@0/fp@0,0
Device Address             200300a0b8560e2b,1
Host controller port WWN 2100001b32813cc3
Class                      secondary
State                      STANDBY

root@eoms4-2 # luxadm disp /dev/rdsk/c3t600A0B8000560E2A000004154AF0F896d0s2
DEVICE PROPERTIES for disk: /dev/rdsk/c3t600A0B8000560E2A000004154AF0F896d0s2
  Vendor:             SUN
  Product ID:          CSM200_R
  Revision:          0710
  Serial Num:          SG84746423
  Unformatted capacity: 710000.000 MBytes
  Write Cache:       Enabled
  Read Cache:          Enabled
Minimum prefetch: 0x3
Maximum prefetch: 0x0
  Device Type:       Disk device
  Path(s):

  /dev/rdsk/c3t600A0B8000560E2A000004154AF0F896d0s2
  /devices/scsi_vhci/ssd@g600a0b8000560e2a000004154af0f896:c,raw
Controller          /devices/pci@1,700000/SUNW,qlc@0/fp@0,0
Device Address             200200a0b8560e2b,2
Host controller port WWN 2100001b32816ac5
Class                      primary
State                      ONLINE
Controller          /devices/pci@0,600000/pci@0/pci@9/SUNW,qlc@0/fp@0,0
Device Address             200300a0b8560e2b,2
Host controller port WWN 2100001b32813cc3
Class                      secondary
State                      STANDBY

root@eoms4-2 # luxadm disp /dev/rdsk/c3t600A0B8000560E2A000004174AF0F923d0s2
DEVICE PROPERTIES for disk: /dev/rdsk/c3t600A0B8000560E2A000004174AF0F923d0s2
  Vendor:             SUN
  Product ID:          CSM200_R
  Revision:          0710
  Serial Num:          SG84746423
  Unformatted capacity: 63000.000 MBytes
  Write Cache:       Enabled
  Read Cache:          Enabled
Minimum prefetch: 0x3
Maximum prefetch: 0x0
  Device Type:       Disk device
  Path(s):

  /dev/rdsk/c3t600A0B8000560E2A000004174AF0F923d0s2
  /devices/scsi_vhci/ssd@g600a0b8000560e2a000004174af0f923:c,raw
Controller          /devices/pci@1,700000/SUNW,qlc@0/fp@0,0
Device Address             200200a0b8560e2b,3
Host controller port WWN 2100001b32816ac5
Class                      primary
State                      ONLINE
Controller          /devices/pci@0,600000/pci@0/pci@9/SUNW,qlc@0/fp@0,0
Device Address             200300a0b8560e2b,3
Host controller port WWN 2100001b32813cc3
Class                      secondary
State                      STANDBY

root@eoms4-2 # luxadm disp /dev/rdsk/c3t600A0B8000560E2A000004194AF0F96Cd0s2
DEVICE PROPERTIES for disk: /dev/rdsk/c3t600A0B8000560E2A000004194AF0F96Cd0s2
  Vendor:             SUN
  Product ID:          CSM200_R
  Revision:          0710
  Serial Num:          SG84746423
  Unformatted capacity: 64000.000 MBytes
  Write Cache:       Enabled
  Read Cache:          Enabled
Minimum prefetch: 0x3
Maximum prefetch: 0x0
  Device Type:       Disk device
  Path(s):

  /dev/rdsk/c3t600A0B8000560E2A000004194AF0F96Cd0s2
  /devices/scsi_vhci/ssd@g600a0b8000560e2a000004194af0f96c:c,raw
Controller          /devices/pci@1,700000/SUNW,qlc@0/fp@0,0
Device Address             200200a0b8560e2b,4
Host controller port WWN 2100001b32816ac5
Class                      primary
State                      ONLINE
Controller          /devices/pci@0,600000/pci@0/pci@9/SUNW,qlc@0/fp@0,0
Device Address             200300a0b8560e2b,4
Host controller port WWN 2100001b32813cc3
Class                      secondary
State                      STANDBY

作者: 119beyond 时间: 2016-01-21 09:58
单从日志看链路有断过，后来又恢复了；
最好是登陆存储去看看，有什么报错的

作者: nimysun 时间: 2016-01-22 17:23
回复 1# N0N?sas

看着像是链路有问题，你的主机是直接连接到存储上，中间有交换机么？最好这3个环节都看看，看一下发生断路是在哪个位置。

作者: ibmlenovo 时间: 2016-01-28 11:53
先检查下存储看看。

欢迎光临 Chinaunix (http://bbs.chinaunix.net/)