IBM Storage 裸设备问题求教

SunGod

项目要求使用rhcs做双机nfs,在ibm DS4300上创建了两个为100M的lun,id分别为11和12，raw配置文件已经生效，ha工作也正常。第二天无意中发现系统一直在报以下错误

1. Jun 19 11:22:09 TestStorage-A kernel: 493 [RAIDarray.mpp]Array_Module_0:0:0:11 Cmnd failed. Retry same path. vcmnd SN 412035 pdev H0
   
2. :C0:T0:L11 0x06/0x8b/0x02 0x08000002
   
3. Jun 19 11:22:10 TestStorage-A last message repeated 2 times
   
4. Jun 19 11:22:24 TestStorage-A kernel: 493 [RAIDarray.mpp]Array_Module_0:0:0:12 Cmnd failed. Retry same path. vcmnd SN 412131 pdev H0
   
5. :C0:T0:L12 0x06/0x8b/0x02 0x08000002
   
6. Jun 19 11:22:27 TestStorage-A last message repeated 6 times
   
7. Jun 19 11:22:30 TestStorage-A kernel: 493 [RAIDarray.mpp]Array_Module_0:0:0:12 Cmnd failed. Retry same path. vcmnd SN 412151 pdev H0
   
8. :C0:T0:L12 0x06/0x8b/0x02 0x08000002
   
9. Jun 19 11:22:31 TestStorage-A last message repeated 2 times
   
10. Jun 19 11:22:45 TestStorage-A kernel: 493 [RAIDarray.mpp]Array_Module_0:0:0:12 Cmnd failed. Retry same path. vcmnd SN 412263 pdev H0
    
11. :C0:T0:L12 0x06/0x8b/0x02 0x08000002
    
12. Jun 19 11:22:49 TestStorage-A last message repeated 6 times
    
13. Jun 19 11:22:59 TestStorage-A kernel: 493 [RAIDarray.mpp]Array_Module_0:0:0:11 Cmnd failed. Retry same path. vcmnd SN 412310 pdev H0
    
14. :C0:T0:L11 0x06/0x8b/0x02 0x08000002
    
15. Jun 19 11:23:00 TestStorage-A last message repeated 2 times
    
16. Jun 19 11:23:07 TestStorage-A kernel: 493 [RAIDarray.mpp]Array_Module_0:0:0:12 Cmnd failed. Retry same path. vcmnd SN 412390 pdev H0
    
17. :C0:T0:L12 0x06/0x8b/0x02 0x08000002
    
18. Jun 19 11:23:10 TestStorage-A last message repeated 5 times
    
19. Jun 19 11:23:28 TestStorage-A kernel: 493 [RAIDarray.mpp]Array_Module_0:0:0:12 Cmnd failed. Retry same path. vcmnd SN 412491 pdev H0
    
20. :C0:T0:L12 0x06/0x8b/0x02 0x08000002

复制代码

fdisk信息：

1. Disk /dev/sde: 1214.5 GB, 1214586552320 bytes
   
2. 255 heads, 63 sectors/track, 147665 cylinders
   
3. Units = cylinders of 16065 * 512 = 8225280 bytes
   
4. 
   
5.    Device Boot    Start       End    Blocks   Id  System
   
6. 
   
7. Disk /dev/sdf: 104 MB, 104857600 bytes
   
8. 4 heads, 50 sectors/track, 1024 cylinders
   
9. Units = cylinders of 200 * 512 = 102400 bytes
   
10. 
    
11. Disk /dev/sdf doesn't contain a valid partition table
    
12. 
    
13. Disk /dev/sdg: 104 MB, 104857600 bytes
    
14. 4 heads, 50 sectors/track, 1024 cylinders
    
15. Units = cylinders of 200 * 512 = 102400 byte
    
16. Disk /dev/sdg doesn't contain a valid partition table

复制代码

raw信息:
[root@TestStorage-A root]# /etc/init.d/rawdevices status
/dev/raw/raw1:  bound to major 8, minor 80
/dev/raw/raw2:  bound to major 8, minor 96

[root@TestStorage-A root]# cat /etc/sysconfig/rawdevices
/dev/raw/raw1 /dev/sdf
/dev/raw/raw2 /dev/sdg

随后我用scsi_info察看了这两个裸设备的信息，居然model为cd-rom
[root@TestStorage-A root]# scsi_info /dev/sdf
SCSI_ID="0,0,11"
MODEL="CD-ROM "
FW_REV="SCSI"
[root@TestStorage-A root]# scsi_info /dev/sdg
SCSI_ID="0,0,12"
MODEL="CD-ROM "
FW_REV="SCSI"

而其他的lun则显示正常
[root@TestStorage-A root]# scsi_info /dev/sde
SCSI_ID="0,0,4"
MODEL="IBM VirtualDisk"
FW_REV="0520"


唯一的却别就是fdisk提示的doesn't contain a valid partition table
用fdisk打开提示
Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)
这应该是正常的吧。因为裸设备不应该有分区表的存在

请问各位这个错误和识别为cd-rom有必然的联系吗？谢谢赐教！

yddll

连接的拓扑图有没？

还有就是什么firmware,bios,driver呀等等的东西，有没有一个统计

SunGod

所有固件和bios以及驱动都是ibm工程师建议的版本...........

至于光路拓扑图.....我都搞不清楚，是ibm的储存工程师来做的

星海夜航

作为一个客户你应该要求ibm做过什么都给你清清楚楚地写成文档

SunGod

.....ibm那个上门的储存工程师是个半罐水.....rdac就把我给忽悠了，我明明装好了，非说我没装好 ........还能指望其的文档么......总感觉ibm的上门服务质量越来越差了

yddll

不会吧,IBM还上门装DS4300

yddll

连接拓扑和RDAC很重要

SunGod

。。。。感觉这问题不是网络拓扑造成的

sharkbing

是mutipath 的问题。 RDAC安装了

SunGod

只有一张hba卡，hba卡驱动也更新为non-overfail了，rdac已经装好了