求救Redhat Linux系统重启，盘阵找不到！

Lippman

周六时服务器关机，今天早上服务器开机时，发现日立盘阵找不到了，上面做了逻辑卷，生成了/dev/mapper/vgams-lvams设备文件的，但是今早上发现这个文件没有了，用pvdisplay命令查看发现原来生成的一个pv的pv name认不到了。请问现在这种情况应该怎么处理，有什么办法在不损伤盘阵上数据的情况下重新生成mapper目录下的那个设备文件？或者如何才能备份出里面的数据呢？谢谢各位大侠救急了！！！！

[root@io01 etc]# pvdisplay
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.     ====> 就是丢失的/dev/sdb1这个pv的uuid
  ......
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  --- Physical volume ---
  PV Name               /dev/sdc1
  VG Name               vgams
  PV Size               975.11 GB / not usable 0
  Allocatable           yes (but full)
  PE Size (KByte)       4096
  Total PE              249629
  Free PE               0
  Allocated PE          249629
  PV UUID               y8Uxl5-pk5g-fed8-fpKG-mHde-nCyF-luYddV

  ......

  --- Physical volume ---
  PV Name               /dev/sdi1
  VG Name               vgams
  PV Size               975.11 GB / not usable 0
  Allocatable           yes (but full)
  PE Size (KByte)       4096
  Total PE              249629
  Free PE               0
  Allocated PE          249629
  PV UUID               BjDowe-lqey-Uc1J-15BY-fPsC-yLfT-upSLgt

  --- Physical volume ---
  PV Name               unknown device                              ====> 这里pv 名字找不到了，原本应该是/dev/sdb1
  VG Name               vgams
  PV Size               899.99 GB / not usable 0
  Allocatable           yes (but full)
  PE Size (KByte)       4096
  Total PE              230398
  Free PE               0
  Allocated PE          230398
  PV UUID               nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY         

[root@io01 etc]#

[ 本帖最后由 Lippman 于 2009-4-21 10:12 编辑 ]

jerrywjl

系统版本？是否有做多路径？

jerrywjl

关机，拔盘阵，开机，连盘阵，执行：echo "- - -" > /sys/class/scsi_host/hostN/scan，重扫存储。

jerrywjl

增加一个步骤，pvscan，vgscan和lvscan，提供详细输出信息。

Lippman

原帖由 jerrywjl 于 2009-4-20 11:07 发表
增加一个步骤，pvscan，vgscan和lvscan，提供详细输出信息。

jerrywjl，不知道是不是因为最后做的那个显示为unknown device的PV出了问题，导致整个卷组挂掉了？

[root@io01 ~]# pvscan
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  PV /dev/sdc1        VG vgams   lvm2 [975.11 GB / 0    free]
  PV /dev/sdd1        VG vgams   lvm2 [899.99 GB / 0    free]
  PV /dev/sde1        VG vgams   lvm2 [975.11 GB / 0    free]
  PV /dev/sdf1        VG vgams   lvm2 [899.99 GB / 0    free]
  PV /dev/sdg1        VG vgams   lvm2 [975.11 GB / 0    free]
  PV /dev/sdh1        VG vgams   lvm2 [899.99 GB / 0    free]
  PV /dev/sdi1        VG vgams   lvm2 [975.11 GB / 0    free]
  PV unknown device   VG vgams   lvm2 [899.99 GB / 0    free]
  Total: 8 [7.32 TB] / in use: 8 [7.32 TB] / in no VG: 0 [0   ]

[root@io01 ~]# vgscan
  Reading all physical volumes.  This may take a while...
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Volume group "vgams" not found
[root@io01 ~]#


[root@io01 ~]# lvscan
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Couldn't find device with uuid 'nsLqhQ-7new-6cSe-EWQz-kusd-U2Ht-zJ2joY'.
  Couldn't find all physical volumes for volume group vgams.
  Volume group "vgams" not found
[root@io01 ~]#

Lippman

原帖由 jerrywjl 于 2009-4-20 10:58 发表
关机，拔盘阵，开机，连盘阵，执行：echo "- - -" > /sys/class/scsi_host/hostN/scan，重扫存储。

echo完后会自动重新扫描存储么？我这样操作了但是还是没认到，重启了也没认到。
不知道是不是最后的那个无法识别的pv出了什么问题，导致整个vg以及lv都挂掉了。
能不能在不损害数据的情况下直接排除这个无法识别的pv？

[ 本帖最后由 Lippman 于 2009-4-20 14:51 编辑 ]

jerrywjl

原帖由 Lippman 于 2009-4-20 14:47 发表


echo完后会自动重新扫描存储么？我这样操作了但是还是没认到，重启了也没认到。
不知道是不是最后的那个无法识别的pv出了什么问题，导致整个vg以及lv都挂掉了。

硬件问题，查硬件去吧。

Lippman

原帖由 jerrywjl 于 2009-4-20 14:50 发表



硬件问题，查硬件去吧。

请问echo命令完成后，应该是用df命令就可以看到盘阵么？不需要重启么？

jerrywjl

原帖由 Lippman 于 2009-4-20 15:05 发表



请问echo命令完成后，应该是用df命令就可以看到盘阵么？不需要重启么？

echo那个，用于在系统运行过程中去扫描磁盘阵列即探测盘阵。

对于盘阵这种东西先要找到设备加载驱动才能获得设备分区情况，获得设备分区才能获取逻辑卷元数据，获得逻辑卷元数据才有可能识别文件系统。
你自己琢磨琢磨看到了哪一步？！

Lippman

原帖由 jerrywjl 于 2009-4-20 15:18 发表


echo那个，用于在系统运行过程中去扫描磁盘阵列即探测盘阵。

对于盘阵这种东西先要找到设备加载驱动才能获得设备分区情况，获得设备分区才能获取逻辑卷元数据，获得逻辑卷元数据才有可能识别文件系统。
...

谢谢，jerrywjl，我用lsmod查了驱动程序，驱动是在的，我觉得就是我做的一个pv 坏掉了，估计应该是硬件问题，不知道有没有办法把其他pv上的数据导出来。

下面是fdisk -l命令的输出，/dev/sdb到/dev/sdi是原来做的pv，现在看起来/dev/sdb是出问题了：

[root@io01 ~]# fdisk -l

Disk /dev/sda: 299.8 GB, 299882250240 bytes
255 heads, 63 sectors/track, 36458 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *           1        2611    20972826   83  Linux
/dev/sda2            2612        5222    20972857+  83  Linux
/dev/sda3            5223       18276   104856255   83  Linux
/dev/sda4           18277       36458   146046915    5  Extended
/dev/sda5           18277       35414   137660953+  83  Linux
/dev/sda6           35415       35675     2096451   82  Linux swap
/dev/sda7           35676       35936     2096451   82  Linux swap
/dev/sda8           35937       36197     2096451   82  Linux swap
/dev/sda9           36198       36458     2096451   82  Linux swap

Disk /dev/sdb: 966.3 GB, 966367641600 bytes                         ====> 这是第一个pv，坏的就是这个pv了，整个vg都挂了
255 heads, 63 sectors/track, 117487 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sdb1   ?      264386      257082  2088818490    1  FAT12
Partition 1 does not end on cylinder boundary.
/dev/sdb2   ?       66852       51358  2023024920+  42  SFS
Partition 2 does not end on cylinder boundary.
/dev/sdb3   ?      105920      105961      329394   6f  Unknown
Partition 3 does not end on cylinder boundary.
/dev/sdb4           87045      154994   545800106+  49  Unknown
Partition 4 does not end on cylinder boundary.

Partition table entries are not in disk order

Disk /dev/sdc: 1047.0 GB, 1047026204672 bytes
255 heads, 63 sectors/track, 127293 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sdc1               1      127293  1022480991   8e  Linux LVM

Disk /dev/sdd: 966.3 GB, 966367641600 bytes
255 heads, 63 sectors/track, 117487 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sdd1               1      117487   943714296   8e  Linux LVM

Disk /dev/sde: 1047.0 GB, 1047026204672 bytes
255 heads, 63 sectors/track, 127293 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sde1               1      127293  1022480991   8e  Linux LVM

Disk /dev/sdf: 966.3 GB, 966367641600 bytes
255 heads, 63 sectors/track, 117487 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sdf1               1      117487   943714296   8e  Linux LVM

Disk /dev/sdg: 1047.0 GB, 1047026204672 bytes
255 heads, 63 sectors/track, 127293 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sdg1               1      127293  1022480991   8e  Linux LVM

Disk /dev/sdh: 966.3 GB, 966367641600 bytes
255 heads, 63 sectors/track, 117487 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sdh1               1      117487   943714296   8e  Linux LVM

Disk /dev/sdi: 1047.0 GB, 1047026204672 bytes
255 heads, 63 sectors/track, 127293 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sdi1               1      127293  1022480991   8e  Linux LVM
[root@io01 ~]#

[ 本帖最后由 Lippman 于 2009-4-21 10:13 编辑 ]