HACMP5.1装好oralce后的问题

★jasson★

smitty clstop停止时报warning如下：
exist.
# tail -f /tmp/hacmp.out
:config_too_long[95] [ -x /usr/lpp/ssp/bin/spget_syspar ]
WARNING: Cluster cls22 has been running recovery program '/usr/es/sbin/cluster/events/node_down.rp' for 360 seconds. Please check cluster status.
WARNING: Cluster cls22 has been running recovery program '/usr/es/sbin/cluster/events/node_down.rp' for 390 seconds. Please check cluster status.
WARNING: Cluster cls22 has been running recovery program '/usr/es/sbin/cluster/events/node_down.rp' for 420 seconds. Please check cluster status.
WARNING: Cluster cls22 has been running recovery program '/usr/es/sbin/cluster/events/node_down.rp' for 450 seconds. Please check cluster status.
WARNING: Cluster cls22 has been running recovery program '/usr/es/sbin/cluster/events/node_down.rp' for 480 seconds. Please check cluster status.
WARNING: Cluster cls22 has been running recovery program '/usr/es/sbin/cluster/events/node_down.rp' for 540 seconds. Please check cluster status.
WARNING: Cluster cls22 has been running recovery program '/usr/es/sbin/cluster/events/node_down.rp' for 600 seconds. Please check cluster status.
WARNING: Cluster cls22 has been running recovery program '/usr/es/sbin/cluster/events/node_down.rp' for 660 seconds. Please check cluster status.
WARNING: Cluster cls22 has been running recovery program '/usr/es/sbin/cluster/events/node_down.rp' for 720 seconds. Please check cluster status.


停止不了
谁知道问题所在？

yanbing

要看hacmp.out的故障内容。。。

你贴出来的这个是最后的超时提示（是故障后的结果）

★jasson★

下个礼拜去现场再贴hacmp.out出来
还有一个现象就是，我的HACMP是并发版，共享卷组建了两个，两个vg再同一个资源组里面
再down HA的时候，其中有一台经常只有一个vg down下来，还有一个vg始终down不下来、

bobqi

你可以试试打上oracle的最新补丁，
现在是oracle9i的话可以到9.2.0.6

RSTSG

等你的hacmp.out 。

把那台出现超时的node的hacmp。out贴上来就可以了！

根据你后面的描述，应该就是vg释放不了的那个node有超时现象

★jasson★

HACMP.OUT输出，有点长，请耐心看看：）
                        HACMP Event Summary
Event: /usr/es/sbin/cluster/events/check_for_site_down edzdb graceful
Start time: Tue Apr 12 17:48:31 2005

End time: Tue Apr 12 17:48:31 2005

Action:         Resource:                       Script Name:
----------------------------------------------------------------------------
No resources changed as a result of this event
----------------------------------------------------------------------------

Apr 12 17:48:31 EVENT START: node_down edzdb graceful

:node_down[79] [[ high = high ]]
:node_down[79] version=1.45.1.1
:node_down[80] :node_down[80] cl_get_path
HA_DIR=es
:node_down[82] export NODENAME=edzdb
:node_down[83] export PARAM=graceful
:node_down[85] UPDATESTATDFILE=/usr/es/sbin/cluster/etc/updatestatd
:node_down[94] STATUS=0
:node_down[96] [[ -z  ]]
:node_down[97] EMULATE=REAL
:node_down[100] set -u
:node_down[102] ((  2 < 1  ))
:node_down[107] rm -f /tmp/.RPCLOCKDSTOPPED
:node_down[108] rm -f /usr/es/sbin/cluster/etc/updatestatd
:node_down[110] [[ graceful = forced ]]
:node_down[128] UPDATESTATD=0
:node_down[129] export UPDATESTATD
:node_down[138] set -a
:node_down[139] clsetenvgrp edzdb node_down graceful
:clsetenvgrp[50] [[ high = high ]]
:clsetenvgrp[50] version=1.16
:clsetenvgrp[52] usingVer=clSetenvgrp
:clsetenvgrp[57] clSetenvgrp edzdb node_down graceful
executing clSetenvgrp
clSetenvgrp: argc = 4
clSetenvgrp completed successfully
:clsetenvgrp[58] exit 0
:node_down[139] eval FORCEDOWN_GROUPS="" RESOURCE_GROUPS="" HOMELESS_GROUPS="" ERRSTATE_GROUPS="" PRINCIPAL_ACTIONS="" ASSOCIATE_ACT
IONS="" AUXILLIARY_ACTIONS="" SIBLING_GROUPS="" SIBLING_NODES_BY_GROUP="" SIBLING_ACQUIRING_GROUPS="" SIBLING_ACQUIRING_NODES_BY_GRO
UP="" SIBLING_RELEASING_GROUPS="" SIBLING_RELEASING_NODES_BY_GROUP="" SIBLING_PRE_EVENT_LOC=""
:node_down[139] FORCEDOWN_GROUPS= RESOURCE_GROUPS= HOMELESS_GROUPS= ERRSTATE_GROUPS= PRINCIPAL_ACTIONS= ASSOCIATE_ACTIONS= AUXILLIAR
Y_ACTIONS= SIBLING_GROUPS= SIBLING_NODES_BY_GROUP= SIBLING_ACQUIRING_GROUPS= SIBLING_ACQUIRING_NODES_BY_GROUP= SIBLING_RELEASING_GRO
UPS= SIBLING_RELEASING_NODES_BY_GROUP= SIBLING_PRE_EVENT_LOC=
:node_down[140] RC=0
:node_down[141] set +a
:node_down[142] ((  0 != 0  ))
:node_down[150] process_resources
:process_resources[1531] [[ high = high ]]
:process_resources[1531] ersion=1.40.1.6
:process_resources[1532] :process_resources[1532] cl_get_path
HA_DIR=es
:process_resources[1534] STATUS=0
:process_resources[1535] sddsrv_off=FALSE
:process_resources[1538] [ ! -n  ]
:process_resources[1540] EMULATE=REAL
:process_resources[1543] true
:process_resources[1545] set -a
:process_resources[1548] clRGPA
:clRGPA[48] [[ high = high ]]
:clRGPA[48] version=1.16
:clRGPA[50] usingVer=clrgpa
:clRGPA[55] clrgpa
:clRGPA[56] exit 0
:process_resources[1548] eval JOB_TYPE=RELEASE RESOURCE_GROUPS="edz_rg"
:process_resources[1548] JOB_TYPE=RELEASE RESOURCE_GROUPS=edz_rg
:process_resources[1550] RC=0
:process_resources[1551] set +a
:process_resources[1553] [ 0 -ne 0 ]
:process_resources[1763] set_resource_group_state RELEASING
:process_resources[3] STAT=0
edz_rg:process_resources[6] export GROUPNAME
edz_rg:process_resources[7] [ RELEASING != DOWN ]
edz_rg:process_resources[9] [ REAL = EMUL ]
edz_rg:process_resources[14] clchdaemons -d clstrmgr_scripts -t resource_locator -n edzdb -o edz_rg -v RELEASING
edz_rg:process_resources[15] [ 0 -ne 0 ]
edz_rg:process_resources[26] [ RELEASING = ACQUIRING ]
edz_rg:process_resources[33] [ RELEASING = RELEASING ]
edz_rg:process_resources[35] cl_RMupdate releasing edz_rg process_resources
Reference string: Tue.Apr.12.17:48:33.BEIST.2005.process_resources.edz_rg.ref
edz_rg:process_resources[36] continue
edz_rg:process_resources[65] return 0
edz_rg:process_resources[1764] RC=0
edz_rg:process_resources[1764] [[ 0 != 0 ]]
edz_rg:process_resources[1543] true
edz_rg:process_resources[1545] set -a
edz_rg:process_resources[1548] clRGPA
edz_rg:clRGPA[48] [[ high = high ]]
edz_rg:clRGPA[48] version=1.16
edz_rg:clRGPA[50] usingVer=clrgpa
edz_rg:clRGPA[55] clrgpa
edz_rg:clRGPA[56] exit 0
edz_rg:process_resources[1548] eval JOB_TYPE=APPLICATIONS ACTION=RELEASE ALL_APPLICATIONS="edz_db" RESOURCE_GROUPS="edz_rg " MISCDAT
A=""
edz_rg:process_resources[1548] JOB_TYPE=APPLICATIONS ACTION=RELEASE ALL_APPLICATIONS=edz_db RESOURCE_GROUPS=edz_rg  MISCDATA=
edz_rg:process_resources[1550] RC=0
edz_rg:process_resources[1551] set +a
edz_rg:process_resources[1553] [ 0 -ne 0 ]
edz_rg:process_resources[1678] export GROUPNAME=edz_rg
edz_rg :process_resources[1679] process_applications RELEASE
edz_rg :process_resources[4] [ RELEASE = ACQUIRE ]
edz_rg :process_resources[8] cmd_to_execute=stop_server
edz_rg :process_resources[12] STAT=0
edz_rg:process_resources[15] export GROUPNAME
edz_rg:process_resources[17] read LIST_OF_APPLICATIONS_FOR_RG
edz_rg:process_resources[17] get_list_head edz_db
edz_rg:process_resources[3] read listhead listtail
edz_rg:process_resources[3] edz_rg:process_resources[3] echo edz_db
IFS=:
edz_rg:process_resources[4] tr ,  
edz_rg:process_resources[4] echo edz_db
edz_rg:process_resources[18] read ALL_APPLICATIONS
edz_rg:process_resources[18] get_list_tail edz_db
edz_rg:process_resources[3] read listhead listtail
edz_rg:process_resources[3] edz_rg:process_resources[3] echo edz_db
IFS=:
edz_rg:process_resources[4] echo
edz_rg:process_resources[20] read MISCDATA_FOR_RG
edz_rg:process_resources[20] get_list_head
edz_rg:process_resources[3] read listhead listtail
edz_rg:process_resources[3] echo
edz_rg:process_resources[3] IFS=:
edz_rg:process_resources[4] tr ,  
edz_rg:process_resources[4] echo
edz_rg:process_resources[21] read MISCDATA
edz_rg:process_resources[21] get_list_tail
edz_rg:process_resources[3] read listhead listtail
edz_rg:process_resources[3] edz_rg:process_resources[3] echo
IFS=:
edz_rg:process_resources[4] echo
edz_rg:process_resources[23] export MISC_DATA=
edz_rg:process_resources[25] [ RELEASE = RELEASE ]
edz_rg:process_resources[30] TMPLIST=
edz_rg:process_resources[31] let cnt=0
edz_rg:process_resources[32] print edz_db
edz_rg:process_resources[32] set -A appnames edz_db
edz_rg:process_resources[34] ((   cnt < 1  ))
edz_rg:process_resources[35] TMPLIST=edz_db
edz_rg:process_resources[36] LIST_OF_APPLICATIONS_FOR_RG=edz_db
edz_rg:process_resources[37] let cnt=cnt+1
edz_rg:process_resources[34] ((   cnt < 1  ))
edz_rg:process_resources[40] LIST_OF_APPLICATIONS_FOR_RG=edz_db
edz_rg:process_resources[49] export APPLICATIONS=edz_db
edz_rg:process_resources[51] [ REAL = EMUL ]
edz_rg:process_resources[55] clcallev stop_server edz_db

Apr 12 17:48:35 EVENT START: stop_server edz_db

edz_rg:stop_server[48] [[ high = high ]]
edz_rg:stop_server[48] version=1.4.1.10
edz_rg:stop_server[49] edz_rg:stop_server[49] cl_get_path
HA_DIR=es
edz_rg:stop_server[51] STATUS=0
edz_rg:stop_server[55] [ ! -n  ]
edz_rg:stop_server[57] EMULATE=REAL
edz_rg:stop_server[60] PROC_RES=false
edz_rg:stop_server[64] [[ APPLICATIONS != 0 ]]
edz_rg:stop_server[64] [[ APPLICATIONS != GROUP ]]
edz_rg:stop_server[65] PROC_RES=true
edz_rg:stop_server[68] set -u
edz_rg:stop_server[71] ALLSERVERS=All_servers
edz_rg:stop_server[72] [ REAL = EMUL ]
edz_rg:stop_server[77] cl_RMupdate resource_releasing All_servers stop_server
Reference string: Tue.Apr.12.17:48:35.BEIST.2005.stop_server.All_servers.edz_rg.ref
edz_rg:stop_server[88] edz_rg:stop_server[88] cut -d: -f3
edz_rg:stop_server[88] cllsserv -cn edz_db
STOP=/etc/qwaresh/stopedzsh
edz_rg:stop_server[90] PATTERN=edzdb edz_db
edz_rg:stop_server[97] [ -x /etc/qwaresh/stopedzsh ]
edz_rg:stop_server[99] [ REAL = EMUL ]
edz_rg:stop_server[104] /etc/qwaresh/stopedzsh
edz_rg:stop_server[104] ODMDIR=/etc/objrepos
                                  ###     ###     ###
  ####    #####   ####   #####    ###     ###     ###
#          #    #    #  #    #   ###     ###     ###
  ####      #    #    #  #    #    #       #       #
      #     #    #    #  #####
#    #     #    #    #  #        ###     ###     ###
  ####      #     ####   #        ###     ###     ###


LSNRCTL for IBM/AIX RISC System/6000: Version 9.2.0.4.0 - Production on 12-APR-2005 17:48:36

Copyright (c) 1991, 2002, Oracle Corporation.  All rights reserved.

Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=10.119.128.69)(PORT=1521)))
The command completed successfully

SQL*Plus: Release 9.2.0.4.0 - Production on Tue Apr 12 17:48:37 2005

Copyright (c) 1982, 2002, Oracle Corporation.  All rights reserved.

SQL>; Connected.
SQL>;
Apr 12 17:54:31 EVENT START: config_too_long 360 /usr/es/sbin/cluster/events/node_down.rp

:config_too_long[64] [[ high = high ]]
:config_too_long[64] version=1.11
:config_too_long[65] :config_too_long[65] cl_get_path
HA_DIR=es
:config_too_long[67] NUM_SECS=360
:config_too_long[68] EVENT=/usr/es/sbin/cluster/events/node_down.rp
:config_too_long[70] HOUR=3600
:config_too_long[71] THRESHOLD=5
:config_too_long[72] SLEEP_INTERVAL=1
:config_too_long[78] PERIOD=30
:config_too_long[81] set -u
:config_too_long[86] LOOPCNT=0
:config_too_long[87] MESSAGECNT=0
:config_too_long[88] :config_too_long[88] cllsclstr -c
:config_too_long[88] cut -d : -f2
:config_too_long[88] grep -v cname
CLUSTER=cls11
:config_too_long[89] TIME=360
:config_too_long[90] sleep_cntr=0
:config_too_long[95] [ -x /usr/lpp/ssp/bin/spget_syspar ]
WARNING: Cluster cls11 has been running recovery program '/usr/es/sbin/cluster/events/node_down.rp' for 360 seconds. Please check cl
uster status.
WARNING: Cluster cls11 has been running recovery program '/usr/es/sbin/cluster/events/node_down.rp' for 390 seconds. Please check cl
uster status.
WARNING: Cluster cls11 has been running recovery program '/usr/es/sbin/cluster/events/node_down.rp' for 420 seconds. Please check cl
uster status.
WARNING: Cluster cls11 has been running recovery program '/usr/es/sbin/cluster/events/node_down.rp' for 450 seconds. Please check cl
uster status.
WARNING: Cluster cls11 has been running recovery program '/usr/es/sbin/cluster/events/node_down.rp' for 480 seconds. Please check cl
uster status.
WARNING: Cluster cls11 has been running recovery program '/usr/es/sbin/cluster/events/node_down.rp' for 540 seconds. Please check cl
uster status.
WARNING: Cluster cls11 has been running recovery program '/usr/es/sbin/cluster/events/node_down.rp' for 600 seconds. Please check cl
uster status.
WARNING: Cluster cls11 has been running recovery program '/usr/es/sbin/cluster/events/node_down.rp' for 660 seconds. Please check cl
uster status.
WARNING: Cluster cls11 has been running recovery program '/usr/es/sbin/cluster/events/node_down.rp' for 720 seconds. Please check cl
uster status.
WARNING: Cluster cls11 has been running recovery program '/usr/es/sbin/cluster/events/node_down.rp' for 780 seconds. Please check cl
uster status.

RSTSG

看起来像是oracle没有能够停止下来！！！

如果方便的话，请把下面这个脚本的内容贴出来看看。。

/etc/qwaresh/stopedzsh 。

原因应该就在这里

leijunxiang

我在p690上的hacmp也有这样的情况，老是有时间的告警。但是每次都会成功切换。大概是划分的表空间比较多的原因吧！

★jasson★

脚本如下：
banner "stop!!!" >;>; /tmp/hacmp.out
su - oracle " -c lsnrctl stop"
su - oracle " -c dbshut"

RSTSG

问题就在脚本上。。。

你用su - oracle -c dbshut来停止数据库。。。

但是dbshut里面的shutdown是没有参数的。也就是说一旦有一个客户端还连接在你的oracle上，你的oracle就停不下来。

建议解决方案：
1。将dbshut里面的shutdown都带上immediate参数；

2。或者直接写sqlplus /nolog的脚本内容，也是用immediate参数；

3。如果你的客户端实在是很多，应该考虑abort方式。