Solaris下的MPXIO配置

sgsfly

新手发文，希望也能给大家一点帮助 ：）

用的LSI的存储 和普安的存储 SUN V245平台+LPE11002 或者Qlogic QLE2460

环境SUN的V245 +LSI 3994
想测试下 LSI的存储在Solaris下的路径冗余，因为用LSI带的RDAC装完系统就Hang住了……
操作系统环境 SUN-V245 Solaris10 U5  HBA卡是Emulex的 LPE11002 双端口的，先用LSI的Santricity 做了一个Raid
然后在Solaris 下用Format 能看到俩个盘
接着如果使用第三方的存储就如下：
bash-3.00# cat /kernel/drv/scsi_vhci.conf
#
# Copyright 2004 Sun Microsystems, Inc.  All rights reserved.
# Use is subject to license terms.
#
#pragma ident   "@(#)scsi_vhci.conf     1.9     04/08/26 SMI"
#
name="scsi_vhci" class="root";
#
# Load balancing global configuration: setting load-balance="none" will cause
# all I/O to a given device (which supports multipath I/O) to occur via one
# path.  Setting load-balance="round-robin" will cause each path to the device
# to be used in turn.
#
load-balance="round-robin";
#
# Automatic failback configuration
# possible values are auto-failback="enable" or auto-failback="disable"
auto-failback="enable";
#
# For enabling MPxIO support for 3rd party symmetric device need an
# entry similar to following in this file. Just replace the "SUN     SENA"
# part with the Vendor ID/Product ID for the device, exactly as reported by
# Inquiry cmd.
#
# device-type-scsi-options-list =
# "SUN     SENA", "symmetric-option";
#
# symmetric-option = 0x1000000;
如果需要添加别的存储 在下面添加如下：


device-type-scsi-options-list =
“DGC     RAID”, “symmetric-option”;

symmetric-option = 0×1000000;

怎么识别Vendor ID/Product ID 了 o(∩_∩)o...
首先执行format，然后选择映射过来的磁盘，选择inquiry 就可以显示了 ：）如下例所示：
bash-3.00# format
Searching for disks...doneAVAILABLE DISK SELECTIONS:      
0. c0t0d0 <SEAGATE-ST973451SS-0001 cyl 38296 alt 2 hd 4 sec 935>          /pci@1e,600000/pci@0/pci@a/pci@0/pci@8/scsi@1/sd@0,0      
1. c0t1d0 <FUJITSU-MBB2147RC-0105 cyl 65533 alt 2 hd 4 sec 1095>          /pci@1e,600000/pci@0/pci@a/pci@0/pci@8/scsi@1/sd@1,0      
2. c0t2d0 <drive type unknown>          /pci@1e,600000/pci@0/pci@a/pci@0/pci@8/scsi@1/sd@2,0      
3. c0t3d0 <FUJITSU-MBB2147RC-0105 cyl 65533 alt 2 hd 4 sec 1095>          /pci@1e,600000/pci@0/pci@a/pci@0/pci@8/scsi@1/sd@3,0      
4. c1t2d0 <ENGENIO-INF-01-00-0619 cyl 25598 alt 2 hd 64 sec 64>          /pci@1e,600000/pci@0/pci@8/lpfc@0/fp@0,0/ssd@w200800a0b8420154,0      
5. c2t1d0 <ENGENIO-INF-01-00-0619 cyl 25598 alt 2 hd 64 sec 64>          /pci@1e,600000/pci@0/pci@8/lpfc@0,1/fp@0,0/ssd@w200800a0b8420153,0Specify disk (enter its number): 4selecting c1t2d0[disk formatted]FORMAT MENU:        
disk       - select a disk        
type       - select (define) a disk type        
partition  - select (define) a partition table        
current    - describe the current disk        
format     - format and analyze the disk      
repair     - repair a defective sector        
label      - write label to the disk        
analyze    - surface analysis      
defect     - defect list management      
backup     - search for backup labels        
verify     - read and display labels        
save       - save new disk/partition definitions        
inquiry    - show vendor, product and revision        
volname    - set 8-character volume name        
!<cmd>     - execute <cmd>, then return        
quit
format> inquiry
Vendor:   ENGENIO
Product:  INF-01-00      
Revision: 0619
format>
然后呢执行：
bash-3.00# stmsboot -e
WARNING: This operation will require a reboot.
Do you want to continue ? [y/n] (default: y) y
The changes will come into effect after rebooting the system.
Reboot the system now ? [y/n] (default: y) y
This required a reboot, so I rebooted the machine, and low and behold the devices appeared correctly:
重启以后 在用format 应该就会只看到一个盘了 ：）

#######################################################

如果用的是普安的光纤存储的话 或者其他光纤存储 需要修改另外一些文件
首先用format看到俩个盘
然后在bash-3.00# format
Searching for disks...done
AVAILABLE DISK SELECTIONS:      
0. c0t0d0 <SEAGATE-ST973451SS-0001 cyl 38296 alt 2 hd 4 sec 935>          /pci@1e,600000/pci@0/pci@a/pci@0/pci@8/scsi@1/sd@0,0      
1. c1t112d0 <inspur-AS800-361G cyl 37793 alt 2 hd 127 sec 64>          /pci@1e,600000/pci@0/pci@2/lpfc@0/fp@0,0/ssd@w220000d0230014de,0      
2. c2t113d0 <inspur-AS800-361G cyl 37793 alt 2 hd 127 sec 64>          /pci@1e,600000/pci@0/pci@2/lpfc@0,1/fp@0,0/ssd@w220000d0231014de,0
Specify disk (enter its number): 1
selecting c1t112d0[disk formatted]
FORMAT MENU:        
disk       - select a disk      
type       - select (define) a disk type      
partition  - select (define) a partition table        
current    - describe the current disk        
format     - format and analyze the disk        
repair     - repair a defective sector        
label      - write label to the disk        
analyze    - surface analysis        
defect     - defect list management      
backup     - search for backup labels      
verify     - read and display labels        
save       - save new disk/partition definitions      
inquiry    - show vendor, product and revision        
volname    - set 8-character volume name        
!<cmd>     - execute <cmd>, then return        
quit
format> inquiry
Vendor:   inspur  
Product:  AS800           
Revision: 361G
format> q
然后修改/kernel/drv/scsi_conf文件
如下所示：bash-3.00# cat /kernel/drv/scsi_vhci.conf
bash-3.00# cat /kernel/drv/scsi_vhci.conf
#
# Copyright 2004 Sun Microsystems, Inc.  All rights reserved.
# Use is subject to license terms.
#
#pragma ident   "@(#)scsi_vhci.conf     1.9     04/08/26 SMI"
#
name="scsi_vhci" class="root";
#
# Load balancing global configuration: setting load-balance="none" will cause
# all I/O to a given device (which supports multipath I/O) to occur via one
# path.  Setting load-balance="round-robin" will cause each path to the device
# to be used in turn.
#
load-balance="round-robin";
#
# Automatic failback configuration
# possible values are auto-failback="enable" or auto-failback="disable"
auto-failback="enable";
#
# For enabling MPxIO support for 3rd party symmetric device need an
# entry similar to following in this file. Just replace the "SUN     SENA"
# part with the Vendor ID/Product ID for the device, exactly as reported by
# Inquiry cmd.
#
# device-type-scsi-options-list =
# "SUN     SENA", "symmetric-option";
#
# symmetric-option = 0x1000000;
device-type-scsi-options-list =
"inspur    AS800", "symmetric-option";

symmetric-option = 0x1000000;


在然后 看下机器上的光纤设备，我下面显示的还有Qlogic的是因为我插过QLOGIC的卡……
bash-3.00# ls -l /dev/fc
total 10
lrwxrwxrwx   1 root     root          60 Jul 22 12:12 fp0 -> ../../devices/pci@1e,600000/pci@0/pci@8/lpfc@0/fp@0,0:devctl
lrwxrwxrwx   1 root     root          62 Jul 22 12:12 fp1 -> ../../devices/pci@1e,600000/pci@0/pci@8/lpfc@0,1/fp@0,0:devctl
lrwxrwxrwx   1 root     root          64 Jul 22 14:26 fp2 -> ../../devices/pci@1e,600000/pci@0/pci@2/QLGC,qlc@0/fp@0,0:devctl
lrwxrwxrwx   1 root     root          60 Jul 22 14:38 fp3 -> ../../devices/pci@1e,600000/pci@0/pci@2/lpfc@0/fp@0,0:devctl
lrwxrwxrwx   1 root     root          62 Jul 22 14:38 fp4 -> ../../devices/pci@1e,600000/pci@0/pci@2/lpfc@0,1/fp@0,0:devctl

然后编辑/kernel/drv/fcp.conf文件 添加下面的内容

bash-3.00# vi /kernel/drv/fcp.conf
"/kernel/drv/fcp.conf" 8 lines, 182 characters
#
# Copyright 1999 Sun Microsystems, Inc.  All rights reserved.
# Use is subject to license terms.
#
#ident  "@(#)fcp.conf   1.2     03/09/30 SMI"
#

name="fcp" parent="pseudo" instance=0;
name="fcp" parent="pci@1e,600000/pci@0/pci@2/lpfc@0" instance=0 port=0 mpxio-disable="no";
name="fcp" parent="pci@1e,600000/pci@0/pci@2/lpfc@0,1" instance=0 port=0 mpxio-disable="no";
~
然后保存后执行下面的命令：#stmsboot -e 重启后就可以正确认出来一块盘了

bash-3.00# luxadm probe
No Network Array enclosures found in /dev/es

Found Fibre Channel device(s):
  Node WWN:200000d0230014de  Device Typeisk device
    Logical Path:/dev/rdsk/c3t600D0230FFFFFFFF0014DE422CA20201d0s2

bash-3.00# format
Searching for disks...done


AVAILABLE DISK SELECTIONS:
       0. c0t0d0 <SEAGATE-ST973451SS-0001 cyl 38296 alt 2 hd 4 sec 935>
          /pci@1e,600000/pci@0/pci@a/pci@0/pci@8/scsi@1/sd@0,0
       1. c3t600D0230FFFFFFFF0014DE422CA20201d0 <inspur-AS800-361G cyl 37793 alt 2 hd 127 sec 64>
          /scsi_vhci/ssd@g600d0230ffffffff0014de422ca20201
Specify disk (enter its number): ^D


如果有什么不对的地方 或者需要修改的地方 请帮忙指出 谢谢 ：）

[ 本帖最后由 sgsfly 于 2008-7-22 17:21 编辑 ]

todaypuzzleme

写的不错，只是不知道MPXIO和各个厂家(IBM,HP,HDS,EMC，NETAPP)的兼容性如何，上述方案是不是也包括了以上厂家？

bencyber

不错，实战！！

sgsfly

我没那么多条件来测试……  只有LSI的存储 广达 普安的存储 测试过了都可以
其他的存储 没有机会接触  不过应该和第二种 普安的存储的连接方式 都应该可以的
毕竟是通过设备名来进行路径冗余的

todaypuzzleme

有机会我也测试一下，到时候把结果贴上来，谢谢sgsfly兄弟

yuhuohu

收藏 谢谢分享

dogg

谢谢分享

kkjerry

HITACHI DF600F
上面試了半天不OK
上個patch 138308-02.zip
stmsboot -e 就OK了

ustcboy

呵呵,如果用Sun支持列表里面的没有这么麻烦
可以直接:

        stmsboot -D fp -e
然后Yes--->之类重启即可.

jerryaix

好东西，不错