T4-1+zfs 7320,存储映射到主机的分区执行ls报IO错误

ching00086

-bash-3.2# luxadm -e port
/devices/pci@400/pci@1/pci@0/pci@0/SUNW,qlc@0/fp@0,0:devctl        CONNECTED
/devices/pci@400/pci@1/pci@0/pci@0/SUNW,qlc@0,1/fp@0,0:devctl      CONNECTED
/devices/pci@400/pci@2/pci@0/pci@c/SUNW,qlc@0/fp@0,0:devctl        NOT CONNECTED
/devices/pci@400/pci@2/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0:devctl      CONNECTED

第二行和第四行是 zfs映射的路径，第一行路径是磁带机。已经插拔光纤测试，光纤无异常。请帮忙看下如下系统日志。为什么映射到主机上的目录执行ls会报IO错误。
Dec  5 03:10:07 dbserver syslogd: line 24: WARNING: loghost could not be resolved
Dec  7 02:06:12 dbserver qlc: [ID 630585 kern.info] NOTICE: Qlogic qlc(1): Loop OFFLINE
Dec  7 02:06:12 dbserver qlc: [ID 630585 kern.info] NOTICE: Qlogic qlc(3): Loop OFFLINE
Dec  7 02:06:12 dbserver scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
Dec  7 02:06:12 dbserver         /scsi_vhci/ssd@g600144f0ca6b43310000519302dd0009 (ssd0): Command failed to complete (3) on path fp3/ssd@w21000024ff4d1e61,5
Dec  7 02:06:12 dbserver scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g600144f0ca6b43310000519302dd0009 (ssd0):
Dec  7 02:06:12 dbserver         SCSI transport failed: reason 'tran_err': retrying command
Dec  7 02:06:13 dbserver SC Alert: [ID 475822 daemon.notice] Sensor | minor: Power Unit : /SYS/VPS : Upper Non-critical going high : reading 1310 >= threshold 1050 Watts
Dec  7 02:06:14 dbserver SC Alert: [ID 872573 daemon.notice] Sensor | minor: Power Unit : /SYS/VPS : Upper Non-critical going low  : reading 320 <= threshold 1050 Watts
Dec  7 02:07:42 dbserver fctl: [ID 517869 kern.warning] WARNING: fp(2)::OFFLINE timeout
Dec  7 02:07:42 dbserver fctl: [ID 517869 kern.warning] WARNING: fp(3)::OFFLINE timeout
Dec  7 02:08:02 dbserver scsi: [ID 243001 kern.info] /pci@400/pci@1/pci@0/pci@0/SUNW,qlc@0,1/fp@0,0 (fcp2):
Dec  7 02:08:02 dbserver         offlining lun=5 (trace=0), target=ef (trace=2800004)
Dec  7 02:08:02 dbserver scsi: [ID 243001 kern.info] /pci@400/pci@1/pci@0/pci@0/SUNW,qlc@0,1/fp@0,0 (fcp2):
Dec  7 02:08:02 dbserver         offlining lun=3 (trace=0), target=ef (trace=2800004)
Dec  7 02:08:02 dbserver scsi: [ID 243001 kern.info] /pci@400/pci@1/pci@0/pci@0/SUNW,qlc@0,1/fp@0,0 (fcp2):
Dec  7 02:08:02 dbserver         offlining lun=1 (trace=0), target=ef (trace=2800004)
Dec  7 02:08:02 dbserver scsi: [ID 243001 kern.info] /pci@400/pci@1/pci@0/pci@0/SUNW,qlc@0,1/fp@0,0 (fcp2):
Dec  7 02:08:02 dbserver         offlining lun=0 (trace=0), target=ef (trace=2800004)
Dec  7 02:08:02 dbserver scsi: [ID 243001 kern.info] /pci@400/pci@2/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0 (fcp3):
Dec  7 02:08:02 dbserver         offlining lun=5 (trace=0), target=ef (trace=2800004)
Dec  7 02:08:02 dbserver scsi: [ID 243001 kern.info] /pci@400/pci@2/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0 (fcp3):
Dec  7 02:08:02 dbserver         offlining lun=3 (trace=0), target=ef (trace=2800004)
Dec  7 02:08:02 dbserver scsi: [ID 243001 kern.info] /pci@400/pci@2/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0 (fcp3):
Dec  7 02:08:02 dbserver         offlining lun=1 (trace=0), target=ef (trace=2800004)
Dec  7 02:08:02 dbserver scsi: [ID 243001 kern.info] /pci@400/pci@2/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0 (fcp3):
Dec  7 02:08:02 dbserver         offlining lun=0 (trace=0), target=ef (trace=2800004)
Dec  7 02:08:02 dbserver genunix: [ID 483743 kern.info] /scsi_vhci/ssd@g600144f0ca6b43310000519302dd0009 (ssd0) multipath status: degraded: path 5 fp2/ssd@w21000024ff4d1e6d,5 is offline
Dec  7 02:08:02 dbserver genunix: [ID 483743 kern.info] /scsi_vhci/ssd@g600144f0ca6b43310000519302870008 (ssd1) multipath status: degraded: path 6 fp2/ssd@w21000024ff4d1e6d,3 is offline
Dec  7 02:08:02 dbserver genunix: [ID 483743 kern.info] /scsi_vhci/ssd@g600144f0ca6b43310000519302760007 (ssd2) multipath status: degraded: path 7 fp2/ssd@w21000024ff4d1e6d,1 is offline
Dec  7 02:08:02 dbserver genunix: [ID 483743 kern.info] /scsi_vhci/ssd@g600144f0ca6b433100005193025f0006 (ssd3) multipath status: degraded: path 8 fp2/ssd@w21000024ff4d1e6d,0 is offline
Dec  7 02:08:02 dbserver scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g600144f0ca6b43310000519302dd0009 (ssd0):
Dec  7 02:08:02 dbserver         transport rejected fatal error
Dec  7 02:08:02 dbserver scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g600144f0ca6b433100005193025f0006 (ssd3):
Dec  7 02:08:02 dbserver         transport rejected fatal error
Dec  7 02:08:02 dbserver scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g600144f0ca6b43310000519302870008 (ssd1):
Dec  7 02:08:02 dbserver         transport rejected fatal error
Dec  7 02:08:02 dbserver ufs: [ID 702911 kern.warning] WARNING: Error writing master during ufs log roll
Dec  7 02:08:02 dbserver ufs: [ID 127457 kern.warning] WARNING: ufs log for /datafile/u02 changed state to Error
Dec  7 02:08:02 dbserver ufs: [ID 616219 kern.warning] WARNING: Please umount(1M) /datafile/u02 and run fsck(1M)
Dec  7 02:08:02 dbserver ufs: [ID 702911 kern.warning] WARNING: Error writing ufs log
Dec  7 02:08:02 dbserver ufs: [ID 127457 kern.warning] WARNING: ufs log for /share/ems changed state to Error
Dec  7 02:08:02 dbserver ufs: [ID 616219 kern.warning] WARNING: Please umount(1M) /share/ems and run fsck(1M)
Dec  7 02:08:10 dbserver ufs: [ID 702911 kern.warning] WARNING: Error reading master
Dec  7 02:08:10 dbserver ufs: [ID 127457 kern.warning] WARNING: ufs log for /share/ommb changed state to Error
Dec  7 02:08:10 dbserver ufs: [ID 616219 kern.warning] WARNING: Please umount(1M) /share/ommb and run fsck(1M)
Dec  7 02:12:16 dbserver qlc: [ID 630585 kern.info] NOTICE: Qlogic qlc(3): Loop ONLINE
Dec  7 02:12:16 dbserver scsi: [ID 243001 kern.info]         Target 0xef: Nonzero peripheral qualifier: Device type=0x1f Peripheral qual=0x1
Dec  7 02:12:16 dbserver scsi: [ID 243001 kern.info] /pci@400/pci@2/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0 (fcp3):
Dec  7 02:12:16 dbserver         offlining lun=0 (trace=5), target=ef (trace=2b14105)
Dec  7 02:12:34 dbserver qlc: [ID 630585 kern.info] NOTICE: Qlogic qlc(3): Loop OFFLINE
Dec  7 02:12:38 dbserver qlc: [ID 630585 kern.info] NOTICE: Qlogic qlc(3): Loop ONLINE
Dec  7 02:12:38 dbserver genunix: [ID 483743 kern.info] /scsi_vhci/ssd@g600144f0ca6b43310000519302dd0009 (ssd0)
  multipath status: degraded: path 1 fp3/ssd@w21000024ff4d1e61,5 is online
Dec  7 02:12:38 dbserver genunix: [ID 483743 kern.info] /scsi_vhci/ssd@g600144f0ca6b43310000519302870008 (ssd1)
   multipath status: degraded: path 2 fp3/ssd@w21000024ff4d1e61,3 is online
Dec  7 02:12:38 dbserver genunix: [ID 483743 kern.info] /scsi_vhci/ssd@g600144f0ca6b43310000519302760007 (ssd2)
   multipath status: degraded: path 3 fp3/ssd@w21000024ff4d1e61,1 is online
Dec  7 02:12:38 dbserver genunix: [ID 483743 kern.info] /scsi_vhci/ssd@g600144f0ca6b433100005193025f0006 (ssd3)
   multipath status: degraded: path 4 fp3/ssd@w21000024ff4d1e61,0 is online
Dec  7 02:15:33 dbserver qlc: [ID 630585 kern.info] NOTICE: Qlogic qlc(1): Loop ONLINE
Dec  7 02:15:35 dbserver genunix: [ID 483743 kern.info] /scsi_vhci/ssd@g600144f0ca6b43310000519302dd0009 (ssd0) multipath status: optimal: path 5 fp2/ssd@w21000024ff4d1e6d,5 is standby
Dec  7 02:15:35 dbserver genunix: [ID 483743 kern.info] /scsi_vhci/ssd@g600144f0ca6b43310000519302870008 (ssd1) multipath status: optimal: path 6 fp2/ssd@w21000024ff4d1e6d,3 is standby
Dec  7 02:15:35 dbserver genunix: [ID 483743 kern.info] /scsi_vhci/ssd@g600144f0ca6b43310000519302760007 (ssd2) multipath status: optimal: path 7 fp2/ssd@w21000024ff4d1e6d,1 is standby
Dec  7 02:15:36 dbserver genunix: [ID 483743 kern.info] /scsi_vhci/ssd@g600144f0ca6b433100005193025f0006 (ssd3) multipath status: optimal: path 8 fp2/ssd@w21000024ff4d1e6d,0 is standby

ahcnpl

在哪ls报错，format看盘正常吗？

119beyond

/devices/pci@400/pci@2/pci@0/pci@c/SUNW,qlc@0/fp@0,0:devctl        NOT CONNECTED

119beyond

Dec  7 02:08:02 dbserver genunix: [ID 483743 kern.info] /scsi_vhci/ssd@g600144f0ca6b43310000519302dd0009 (ssd0) multipath status: degraded: path 5 fp2/ssd@w21000024ff4d1e6d,5 is offline
Dec  7 02:08:02 dbserver genunix: [ID 483743 kern.info] /scsi_vhci/ssd@g600144f0ca6b43310000519302870008 (ssd1) multipath status: degraded: path 6 fp2/ssd@w21000024ff4d1e6d,3 is offline
Dec  7 02:08:02 dbserver genunix: [ID 483743 kern.info] /scsi_vhci/ssd@g600144f0ca6b43310000519302760007 (ssd2) multipath status: degraded: path 7 fp2/ssd@w21000024ff4d1e6d,1 is offline
Dec  7 02:08:02 dbserver genunix: [ID 483743 kern.info] /scsi_vhci/ssd@g600144f0ca6b433100005193025f0006 (ssd3) multipath status: degraded: path 8 fp2/ssd@w21000024ff4d1e6d,0 is offline