免费注册 查看新帖 |

Chinaunix

  平台 论坛 博客 文库
123下一页
最近访问板块 发新帖
查看: 10761 | 回复: 28

[RAID与磁盘阵列] 感觉阵列的存储性能有点低,老大们看看怎么回事 [复制链接]

论坛徽章:
0
发表于 2008-12-23 11:23 |显示全部楼层
10可用积分
先介绍一下大概情况:
阵列是emc的cx-310,全光纤盘,与主机连接用的是4g的光纤通道卡,做的raid5


机器是IBM System x3650(7979B9C)
http://detail.zol.com.cn/135/134602/param.shtml

服务器的硬盘是SAS盘
操作系统是centos5.2,文件系统是ext3

[root@shisl2 ~]# uname -a
Linux shisl2 2.6.18-92.1.18.el5 #1 SMP Wed Nov 12 09:19:49 EST 2008 x86_64 x86_64 x86_64 GNU/Linux
[root@shisl2 ~]# more /etc/redhat-release
CentOS release 5.2 (Final)


下边是用dd测出来的速度(偶尔会更低):

sda是本机sas盘
sda


dd if=/dev/zero of=/app1/test/dd.log

 # dd if=/dev/zero of=/app1/test/dd.log

1975913+0 records in
1975912+0 records out
1011666944 bytes (1.0 GB) copied, 15.0658 seconds, 67.1 MB/s




dd if=/app1/test/dd.log of=/dev/null

 # dd if=/app1/test/dd.log of=/dev/null

1975912+0 records in
1975912+0 records out
1011666944 bytes (1.0 GB) copied, 6.53719 seconds, 155 MB/s



读写
dd if=/app1/test/dd.log of=/app1/test/dd2.log

 # dd if=/app1/test/dd.log of=/app1/test/dd2.log

1975912+0 records in
1975912+0 records out
1011666944 bytes (1.0 GB) copied, 17.1978 seconds, 58.8 MB/s

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
阵列

/home/sakai/mount/bak

dd if=/dev/zero of=/home/sakai/mount/bak/dd.log

# dd if=/dev/zero of=/home/sakai/mount/bak/dd.log

3544417+0 records in
3544417+0 records out
1814741504 bytes (1.8 GB) copied, 24.3567 seconds, 74.5 MB/s


dd if=/home/sakai/mount/bak/dd.log of=/dev/null

# dd if=/home/sakai/mount/bak/dd.log of=/dev/null

3544417+0 records in
3544417+0 records out
1814741504 bytes (1.8 GB) copied, 11.9376 seconds, 152 MB/s


读写
dd if=/home/sakai/mount/bak/dd.log of=/home/sakai/mount/bak/dd2.log

# dd if=/home/sakai/mount/bak/dd.log of=/home/sakai/mount/bak/dd2.log

3544417+0 records in
3544417+0 records out
1814741504 bytes (1.8 GB) copied, 26.4129 seconds, 68.7 MB/s

论坛徽章:
0
发表于 2008-12-23 11:44 |显示全部楼层
原帖由 yuio654 于 2008-12-23 11:23 发表
先介绍一下大概情况:
阵列是emc的cx-310,全光纤盘,与主机连接用的是4g的光纤通道卡,做的raid5


机器是IBM System x3650(7979B9C)
http://detail.zol.com.cn/135/134602/param.shtml

服务器的硬盘是 ...



郁闷的是在一个联想的pc上,用ubuntu竟然读到了500多m,远远超过了ibm服务器。反复测了很多次都非常快


  1. # lspci
  2. 00:00.0 Host bridge: Intel Corporation 5000P Chipset Memory Controller Hub (rev b1)
  3. 00:02.0 PCI bridge: Intel Corporation 5000 Series Chipset PCI Express x4 Port 2 (rev b1)
  4. 00:03.0 PCI bridge: Intel Corporation 5000 Series Chipset PCI Express x4 Port 3 (rev b1)
  5. 00:04.0 PCI bridge: Intel Corporation 5000 Series Chipset PCI Express x8 Port 4-5 (rev b1)
  6. 00:05.0 PCI bridge: Intel Corporation 5000 Series Chipset PCI Express x4 Port 5 (rev b1)
  7. 00:06.0 PCI bridge: Intel Corporation 5000 Series Chipset PCI Express x8 Port 6-7 (rev b1)
  8. 00:07.0 PCI bridge: Intel Corporation 5000 Series Chipset PCI Express x4 Port 7 (rev b1)
  9. 00:08.0 System peripheral: Intel Corporation 5000 Series Chipset DMA Engine (rev b1)
  10. 00:10.0 Host bridge: Intel Corporation 5000 Series Chipset FSB Registers (rev b1)
  11. 00:10.1 Host bridge: Intel Corporation 5000 Series Chipset FSB Registers (rev b1)
  12. 00:10.2 Host bridge: Intel Corporation 5000 Series Chipset FSB Registers (rev b1)
  13. 00:11.0 Host bridge: Intel Corporation 5000 Series Chipset Reserved Registers (rev b1)
  14. 00:13.0 Host bridge: Intel Corporation 5000 Series Chipset Reserved Registers (rev b1)
  15. 00:15.0 Host bridge: Intel Corporation 5000 Series Chipset FBD Registers (rev b1)
  16. 00:16.0 Host bridge: Intel Corporation 5000 Series Chipset FBD Registers (rev b1)
  17. 00:1c.0 PCI bridge: Intel Corporation 631xESB/632xESB/3100 Chipset PCI Express Root Port 1 (rev 09)
  18. 00:1c.1 PCI bridge: Intel Corporation 631xESB/632xESB/3100 Chipset PCI Express Root Port 2 (rev 09)
  19. 00:1d.0 USB Controller: Intel Corporation 631xESB/632xESB/3100 Chipset UHCI USB Controller #1 (rev 09)
  20. 00:1d.1 USB Controller: Intel Corporation 631xESB/632xESB/3100 Chipset UHCI USB Controller #2 (rev 09)
  21. 00:1d.2 USB Controller: Intel Corporation 631xESB/632xESB/3100 Chipset UHCI USB Controller #3 (rev 09)
  22. 00:1d.3 USB Controller: Intel Corporation 631xESB/632xESB/3100 Chipset UHCI USB Controller #4 (rev 09)
  23. 00:1d.7 USB Controller: Intel Corporation 631xESB/632xESB/3100 Chipset EHCI USB2 Controller (rev 09)
  24. 00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev d9)
  25. 00:1f.0 ISA bridge: Intel Corporation 631xESB/632xESB/3100 Chipset LPC Interface Controller (rev 09)
  26. 00:1f.2 IDE interface: Intel Corporation 631xESB/632xESB/3100 Chipset SATA IDE Controller (rev 09)
  27. 00:1f.3 SMBus: Intel Corporation 631xESB/632xESB/3100 Chipset SMBus Controller (rev 09)
  28. 01:06.0 VGA compatible controller: ATI Technologies Inc ES1000 (rev 02)
  29. 02:00.0 PCI bridge: Broadcom EPB PCI-Express to PCI-X Bridge (rev c3)
  30. 03:00.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM5708 Gigabit Ethernet (rev 12)
  31. 04:00.0 RAID bus controller: Adaptec AAC-RAID (Rocket) (rev 02)
  32. 05:00.0 PCI bridge: Broadcom EPB PCI-Express to PCI-X Bridge (rev c3)
  33. 06:00.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM5708 Gigabit Ethernet (rev 12)
  34. 07:00.0 Fibre Channel: QLogic Corp. ISP2432-based 4Gb Fibre Channel to PCI Express HBA (rev 03)
  35. 1a:00.0 PCI bridge: Intel Corporation 6311ESB/6321ESB PCI Express Upstream Port (rev 01)
  36. 1a:00.3 PCI bridge: Intel Corporation 6311ESB/6321ESB PCI Express to PCI-X Bridge (rev 01)
  37. 1b:00.0 PCI bridge: Intel Corporation 6311ESB/6321ESB PCI Express Downstream Port E1 (rev 01)
  38. 1b:01.0 PCI bridge: Intel Corporation 6311ESB/6321ESB PCI Express Downstream Port E2 (rev 01)
复制代码

[ 本帖最后由 yuio654 于 2008-12-23 11:46 编辑 ]

论坛徽章:
0
发表于 2008-12-23 12:56 |显示全部楼层
中午了,大家都在休息吗?

论坛徽章:
0
发表于 2008-12-23 13:26 |显示全部楼层
如果不用文件系统呢?

论坛徽章:
0
发表于 2008-12-23 13:50 |显示全部楼层
不懂,帮顶。

论坛徽章:
12
CU大牛徽章
日期:2013-09-18 15:20:4815-16赛季CBA联赛之同曦
日期:2016-02-01 20:28:25IT运维版块每日发帖之星
日期:2015-11-10 06:20:00操作系统版块每日发帖之星
日期:2015-10-28 06:20:002015亚冠之塔什干棉农
日期:2015-06-04 11:41:56丑牛
日期:2014-05-10 16:11:33技术图书徽章
日期:2013-09-23 13:25:58CU大牛徽章
日期:2013-09-18 15:21:17CU大牛徽章
日期:2013-09-18 15:21:12CU大牛徽章
日期:2013-09-18 15:21:06CU大牛徽章
日期:2013-09-18 15:20:58数据库技术版块每日发帖之星
日期:2016-02-08 06:20:00
发表于 2008-12-23 13:58 |显示全部楼层
用裸设备读写进行比较,不要用文件系统
如果是跑oracle数据库的话,用orion来进行测试

论坛徽章:
0
发表于 2008-12-23 13:59 |显示全部楼层
不做文件系统,直接读裸设备看是多少?

论坛徽章:
0
发表于 2008-12-23 14:46 |显示全部楼层
几块盘组成的RAID5?
难道阵列的cache是write-through?

论坛徽章:
0
发表于 2008-12-23 14:48 |显示全部楼层
联想的pc是台式机么?1块盘?500m不可能。
另外你看看cx3的缓存打开了么?这个是很影响性能的

论坛徽章:
0
发表于 2008-12-23 15:16 |显示全部楼层
原帖由 ops 于 2008-12-23 14:48 发表
联想的pc是台式机么?1块盘?500m不可能。
另外你看看cx3的缓存打开了么?这个是很影响性能的



联想的pc是个台式机,买的时间不长,
dd if=/bak/sdb/test_dd/test.log of=/dev/null
3941988+0 records in
3941988+0 records out
2018297856 bytes (2.0 GB) copied, 3.54748 seconds, 569 MB/s


cx3的缓存打开了,读写3/7


raid5一共是11块盘,其中一块是 hot spare


不用文件系统不知道怎么测试,老大们指点一下

[ 本帖最后由 yuio654 于 2008-12-23 15:24 编辑 ]
您需要登录后才可以回帖 登录 | 注册

本版积分规则 发表回复

  

北京盛拓优讯信息技术有限公司. 版权所有 京ICP备16024965号-6 北京市公安局海淀分局网监中心备案编号:11010802020122 niuxiaotong@pcpop.com 17352615567
未成年举报专区
中国互联网协会会员  联系我们:huangweiwei@itpub.net
感谢所有关心和支持过ChinaUnix的朋友们 转载本站内容请注明原作者名及出处

清除 Cookies - ChinaUnix - Archiver - WAP - TOP