10g RAC,重起系统后，ＧＳＤ等一些服务没起来？

exitgogo

1：环境
OS used : RHEL AS4 update 4
DB ver : ORACLE 10.2.0.1.0
共享存储 : ASM＋raw


问题：
重启RAC以后，一些服务不能启动，手动启动也没用。


下面是系统自动启动以后的情况；
[oracle@rac1 ~]$ crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora....CL1.srv application ONLINE UNKNOWN rac1
ora....CL2.srv application ONLINE UNKNOWN rac2
ora....TEST.cs application ONLINE UNKNOWN rac2
ora....L1.inst application ONLINE OFFLINE
ora....L2.inst application ONLINE OFFLINE
ora.ORCL.db application ONLINE UNKNOWN rac1
ora....SM1.asm application ONLINE UNKNOWN rac1
ora....C1.lsnr application ONLINE UNKNOWN rac1
ora.rac1.gsd application ONLINE UNKNOWN rac1
ora.rac1.ons application ONLINE UNKNOWN rac1
ora.rac1.vip application ONLINE ONLINE rac1
ora....SM2.asm application ONLINE UNKNOWN rac2
ora....C2.lsnr application ONLINE UNKNOWN rac2
ora.rac2.gsd application ONLINE UNKNOWN rac2
ora.rac2.ons application ONLINE UNKNOWN rac2
ora.rac2.vip application ONLINE ONLINE rac2
[oracle@rac1 ~]$

可以看到，只有vip能自动启动！


手工启动试试！
$ srvctl start nodeapps -n rac1

CRS-1028: Dependency analysis failed because of:
CRS-0223: Resource 'ora.rac1.gsd' has placement error.
CRS-1028: Dependency analysis failed because of:
CRS-0223: Resource 'ora.rac1.vip' has placement error.
CRS-1028: Dependency analysis failed because of:
CRS-0223: Resource 'ora.rac1.ons' has placement error.
CRS-1028: Dependency analysis failed because of:
CRS-0223: Resource 'ora.rac1.LISTENER_RAC1.lsnr' has placement error.

尝试：

$crsctl check crs
CSS appears healthy
CRS appears healthy
EVM appears healthy

------------------------------------------------------------
[oracle@rac1 ~]$ crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora....CL1.srv application ONLINE UNKNOWN rac1
ora....CL2.srv application ONLINE UNKNOWN rac2
ora....TEST.cs application ONLINE UNKNOWN rac2
ora....L1.inst application ONLINE OFFLINE
ora....L2.inst application ONLINE OFFLINE
ora.ORCL.db application ONLINE UNKNOWN rac1
ora....SM1.asm application ONLINE UNKNOWN rac1
ora....C1.lsnr application ONLINE UNKNOWN rac1
ora.rac1.gsd application ONLINE UNKNOWN rac1
ora.rac1.ons application ONLINE UNKNOWN rac1
ora.rac1.vip application ONLINE ONLINE rac1
ora....SM2.asm application ONLINE UNKNOWN rac2
ora....C2.lsnr application ONLINE UNKNOWN rac2
ora.rac2.gsd application ONLINE UNKNOWN rac2
ora.rac2.ons application ONLINE UNKNOWN rac2
ora.rac2.vip application ONLINE ONLINE rac2
[oracle@rac1 ~]$

[oracle@rac1 bin]$ crsctl start resources
Starting resources.
Successfully started CRS resources

[oracle@rac1 bin]$ pwd
/oracle/app/oracle/oracle/product/10.2.0/crs/bin
[oracle@rac1 bin]$ gsdctl stop
[oracle@rac1 bin]$ gsdctl status
[oracle@rac1 bin]$ ./gsdctl status
[oracle@rac1 bin]$ gsdctl start
[oracle@rac1 bin]$ srvctl start nodeapps -n rac1
CRS-1028: Dependency analysis failed because of:
CRS-0223: Resource 'ora.rac1.gsd' has placement error.
CRS-1028: Dependency analysis failed because of:
CRS-0223: Resource 'ora.rac1.vip' has placement error.
CRS-1028: Dependency analysis failed because of:
CRS-0223: Resource 'ora.rac1.ons' has placement error.
CRS-1028: Dependency analysis failed because of:
CRS-0223: Resource 'ora.rac1.LISTENER_RAC1.lsnr' has placement error.

请大家帮忙看看，谢谢！

exitgogo

无奈，重启rac，启动后，信息如下：

[oracle@rac1 ~]$ crs_stat -t
Name           Type           Target    State     Host        
------------------------------------------------------------
ora....CL1.srv application    ONLINE    UNKNOWN   rac1        
ora....CL2.srv application    ONLINE    UNKNOWN   rac2        
ora....TEST.cs application    ONLINE    UNKNOWN   rac2        
ora....L1.inst application    ONLINE    UNKNOWN   rac1        
ora....L2.inst application    ONLINE    UNKNOWN   rac2        
ora.ORCL.db    application    ONLINE    UNKNOWN   rac1        
ora....SM1.asm application    ONLINE    ONLINE    rac1        
ora....C1.lsnr application    ONLINE    UNKNOWN   rac1        
ora.rac1.gsd   application    ONLINE    UNKNOWN   rac1        
ora.rac1.ons   application    ONLINE    UNKNOWN   rac1        
ora.rac1.vip   application    ONLINE    ONLINE    rac1        
ora....SM2.asm application    ONLINE    ONLINE    rac2        
ora....C2.lsnr application    ONLINE    UNKNOWN   rac2        
ora.rac2.gsd   application    ONLINE    UNKNOWN   rac2        
ora.rac2.ons   application    ONLINE    UNKNOWN   rac2        
ora.rac2.vip   application    ONLINE    ONLINE    rac2

看到这次只有vip和asm启动了


查看crs启动日志，如下：

2007-05-03 14:26:38.176: [    CRSD][3086927552]0Daemon Version: 10.2.0.1.0 Active Version: 10.2.0.1.0
2007-05-03 14:26:38.177: [    CRSD][3086927552]0Active Version and Software Version are same
2007-05-03 14:26:38.177: [ CRSMAIN][3086927552]0Initializing OCR
2007-05-03 14:26:39.692: [  OCRRAW][3086927552]proprioo: for disk 0 (/dev/raw/raw4), id match (1), my id set (1827378105,1796804619) total id sets (1), 1st set (1827378105,1796804619), 2nd set (0,0) my votes (1), total votes (2)
2007-05-03 14:26:39.694: [  OCRRAW][3086927552]proprioo: for disk 1 (/dev/raw/raw5), id match (1), my id set (1827378105,1796804619) total id sets (1), 1st set (1827378105,1796804619), 2nd set (0,0) my votes (1), total votes (2)
2007-05-03 14:26:40.571: [  OCRMAS][3041975216]th_master:12: I AM THE NEW OCR MASTER at incar 1. Node Number = 2
2007-05-03 14:26:41.294: [  OCRRAW][3041975216]proprioo: for disk 0 (/dev/raw/raw4), id match (1), my id set (1827378105,1796804619) total id sets (1), 1st set (1827378105,1796804619), 2nd set (0,0) my votes (1), total votes (2)
2007-05-03 14:26:41.310: [  OCRRAW][3041975216]proprioo: for disk 1 (/dev/raw/raw5), id match (1), my id set (1827378105,1796804619) total id sets (1), 1st set (1827378105,1796804619), 2nd set (0,0) my votes (1), total votes (2)
2007-05-03 14:26:41.733: [    CRSD][3086927552]0ENV Logging level for Module: allcomp  0
2007-05-03 14:26:41.735: [    CRSD][3086927552]0ENV Logging level for Module: default  0
2007-05-03 14:26:41.737: [    CRSD][3086927552]0ENV Logging level for Module: COMMCRS  0
2007-05-03 14:26:41.739: [    CRSD][3086927552]0ENV Logging level for Module: COMMNS  0
2007-05-03 14:26:41.741: [    CRSD][3086927552]0ENV Logging level for Module: CRSUI  0
2007-05-03 14:26:41.743: [    CRSD][3086927552]0ENV Logging level for Module: CRSCOMM  0
2007-05-03 14:26:41.746: [    CRSD][3086927552]0ENV Logging level for Module: CRSRTI  0
2007-05-03 14:26:41.764: [    CRSD][3086927552]0ENV Logging level for Module: CRSMAIN  0
2007-05-03 14:26:41.836: [    CRSD][3086927552]0ENV Logging level for Module: CRSPLACE  0
2007-05-03 14:26:41.839: [    CRSD][3086927552]0ENV Logging level for Module: CRSAPP  0
2007-05-03 14:26:41.841: [    CRSD][3086927552]0ENV Logging level for Module: CRSRES  0
2007-05-03 14:26:41.843: [    CRSD][3086927552]0ENV Logging level for Module: CRSOCR  0
2007-05-03 14:26:41.845: [    CRSD][3086927552]0ENV Logging level for Module: CRSTIMER  0
2007-05-03 14:26:41.853: [    CRSD][3086927552]0ENV Logging level for Module: CRSEVT  0
2007-05-03 14:26:41.855: [    CRSD][3086927552]0ENV Logging level for Module: CRSD  0
2007-05-03 14:26:41.857: [    CRSD][3086927552]0ENV Logging level for Module: CLUCLS  0
2007-05-03 14:26:41.861: [    CRSD][3086927552]0ENV Logging level for Module: OCRRAW  0
2007-05-03 14:26:41.863: [    CRSD][3086927552]0ENV Logging level for Module: OCROSD  0
2007-05-03 14:26:41.865: [    CRSD][3086927552]0ENV Logging level for Module: CSSCLNT  0
2007-05-03 14:26:41.867: [    CRSD][3086927552]0ENV Logging level for Module: OCRAPI  0
2007-05-03 14:26:41.870: [    CRSD][3086927552]0ENV Logging level for Module: OCRUTL  0
2007-05-03 14:26:41.873: [    CRSD][3086927552]0ENV Logging level for Module: OCRMSG  0
2007-05-03 14:26:41.875: [    CRSD][3086927552]0ENV Logging level for Module: OCRCLI  0
2007-05-03 14:26:41.877: [    CRSD][3086927552]0ENV Logging level for Module: OCRCAC  0
2007-05-03 14:26:41.879: [    CRSD][3086927552]0ENV Logging level for Module: OCRSRV  0
2007-05-03 14:26:41.882: [    CRSD][3086927552]0ENV Logging level for Module: OCRMAS  0
2007-05-03 14:26:41.886: [ CRSMAIN][3086927552]0Filename is /oracle/app/oracle/product/10.2.0/crs/crs/init/rac2.pid
[  clsdmt][2842667952]Listening to (ADDRESS=(PROTOCOL=ipc)(KEY=rac2DBG_CRSD))
2007-05-03 14:26:42.565: [ CRSMAIN][3086927552]0Using Authorizer location: /oracle/app/oracle/product/10.2.0/crs/crs/auth/
2007-05-03 14:26:45.257: [ CRSMAIN][3086927552]0Initializing RTI
2007-05-03 14:26:45.271: [CRSTIMER][2821278640]0Timer Thread Starting.
2007-05-03 14:26:48.975: [  CRSRES][3086927552]0Parameter SECURITY = 1, running in USER Mode
2007-05-03 14:26:48.976: [ CRSMAIN][3086927552]0Initializing EVMMgr
2007-05-03 14:26:59.650: [ CRSMAIN][3086927552]0CRSD locked during state recovery, please wait.
2007-05-03 14:27:00.897: [ CRSMAIN][3086927552]0CRSD recovered, unlocked.
2007-05-03 14:27:00.905: [ CRSMAIN][3086927552]0QS socket on: (ADDRESS=(PROTOCOL=ipc)(KEY=ora_crsqs))
2007-05-03 14:27:00.943: [ CRSMAIN][3086927552]0CRSD UI socket on: (ADDRESS=(PROTOCOL=ipc)(KEY=CRSD_UI_SOCKET))
2007-05-03 14:27:01.051: [ CRSMAIN][3086927552]0E2E socket on: (ADDRESS=(PROTOCOL=tcp)(HOST=priv2)(PORT=49896))
2007-05-03 14:27:01.052: [ CRSMAIN][3086927552]0Starting Threads
2007-05-03 14:27:01.053: [ CRSMAIN][3086927552]0CRS Daemon Started.
2007-05-03 14:27:09.691: [ COMMCRS][2694048688]clsc_send_msg: (0x8ac24e NS err (12571, 12560), transport (530, 111, 0)

2007-05-03 14:27:09.692: [ CRSCOMM][2715028400]0CLSC connection failed, ret = 9
2007-05-03 14:27:09.692: [  CRSEVT][2715028400]0invokepeer ret 200
2007-05-03 14:27:09.773: [  CRSRES][2715028400]0Remote start never sent to rac1: X_E2E_NotSent : Failed to connect to node: rac1
(File: caa_CmdRTI.cpp, line: 492

2007-05-03 14:27:09.773: [  CRSRES][2715028400][ALERT]0Remote start for `ora.rac1.vip` failed on member `rac1`
2007-05-03 14:27:11.309: [  CRSRES][2704538544]0startRunnable: setting CLI values
2007-05-03 14:27:11.350: [  CRSRES][2715028400]0startRunnable: setting CLI values
2007-05-03 14:27:11.863: [  CRSRES][2704538544]0Attempting to start `ora.rac2.vip` on member `rac2`
2007-05-03 14:27:11.959: [  CRSRES][2715028400]0Attempting to start `ora.rac1.vip` on member `rac2`
2007-05-03 14:27:26.071: [  CRSRES][2704538544]0Start of `ora.rac2.vip` on member `rac2` succeeded.
2007-05-03 14:27:27.267: [  CRSRES][2704538544]0startRunnable: setting CLI values
2007-05-03 14:27:27.401: [  CRSRES][2704538544]0Attempting to start `ora.rac2.ASM2.asm` on member `rac2`
2007-05-03 14:27:30.260: [  CRSRES][2715028400]0Start of `ora.rac1.vip` on member `rac2` succeeded.
2007-05-03 14:27:31.524: [  CRSRES][2715028400]0StopResource: setting CLI values
2007-05-03 14:27:31.641: [  CRSRES][2715028400]0Attempting to stop `ora.rac1.vip` on member `rac2`
2007-05-03 14:27:33.596: [  CRSRES][2715028400]0Stop of `ora.rac1.vip` on member `rac2` succeeded.
2007-05-03 14:27:33.949: [  CRSRES][2715028400]0Attempting to start `ora.rac1.vip` on member `rac1`
2007-05-03 14:27:41.684: [  CRSRES][2715028400]0Start of `ora.rac1.vip` on member `rac1` succeeded.
2007-05-03 14:27:41.871: [  CRSRES][2715028400]0Attempting to start `ora.rac1.ASM1.asm` on member `rac1`
2007-05-03 14:28:13.925: [  CRSRES][2670164912]0startRunnable: setting CLI values
2007-05-03 14:28:14.163: [  CRSRES][2670164912]0Attempting to start `ora.rac2.ons` on member `rac2`
2007-05-03 14:28:16.494: [  CRSEVT][2670164912]0CAAMonitorHandler :: 0:Action Script /oracle/app/oracle/product/10.2.0/crs/bin/racgwrap(start) timed out for ora.rac2.ons! (timeout=600)
2007-05-03 14:28:16.496: [  CRSAPP][2670164912]0StartResource error for ora.rac2.ons error code = -2
2007-05-03 14:28:16.676: [  CRSEVT][2670164912]0CAAMonitorHandler :: 0:Action Script /oracle/app/oracle/product/10.2.0/crs/bin/racgwrap(stop) timed out for ora.rac2.ons! (timeout=600)
2007-05-03 14:28:16.678: [  CRSAPP][2670164912]0StopResource error for ora.rac2.ons error code = -2
2007-05-03 14:28:16.863: [  CRSRES][2670164912]0X_OP_StopResourceFailed : Stop Resource failed
(File: rti.cpp, line: 1698

2007-05-03 14:28:16.864: [  CRSRES][2670164912][ALERT]0`ora.rac2.ons` on member `rac2` has experienced an unrecoverable failure.
2007-05-03 14:28:16.865: [  CRSRES][2670164912]0Human intervention required to resume its availability.
2007-05-03 14:28:17.698: [  CRSRES][2704538544]0Start of `ora.rac2.ASM2.asm` on member `rac2` succeeded.
2007-05-03 14:28:18.964: [  CRSRES][2704538544]0startRunnable: setting CLI values
2007-05-03 14:28:19.014: [  CRSRES][2704538544]0Attempting to start `ora.ORCL.ORCL2.inst` on member `rac2`
2007-05-03 14:28:19.440: [  CRSEVT][2704538544]0CAAMonitorHandler :: 0:Action Script /oracle/app/oracle/product/10.2.0/db_1/bin/racgwrap(start) timed out for ora.ORCL.ORCL2.inst! (timeout=600)
2007-05-03 14:28:19.442: [  CRSAPP][2704538544]0StartResource error for ora.ORCL.ORCL2.inst error code = -2
2007-05-03 14:28:19.717: [  CRSEVT][2704538544]0CAAMonitorHandler :: 0:Action Script /oracle/app/oracle/product/10.2.0/db_1/bin/racgwrap(stop) timed out for ora.ORCL.ORCL2.inst! (timeout=600)
2007-05-03 14:28:19.718: [  CRSAPP][2704538544]0StopResource error for ora.ORCL.ORCL2.inst error code = -2
2007-05-03 14:28:20.277: [  CRSRES][2704538544]0X_OP_StopResourceFailed : Stop Resource failed
(File: rti.cpp, line: 1698

2007-05-03 14:28:20.277: [  CRSRES][2704538544][ALERT]0`ora.ORCL.ORCL2.inst` on member `rac2` has experienced an unrecoverable failure.
2007-05-03 14:28:20.278: [  CRSRES][2704538544]0Human intervention required to resume its availability.
2007-05-03 14:28:21.236: [  CRSRES][2704538544]0startRunnable: setting CLI values
2007-05-03 14:28:21.563: [  CRSRES][2704538544]0Attempting to start `ora.rac2.LISTENER_RAC2.lsnr` on member `rac2`
2007-05-03 14:28:23.151: [  CRSEVT][2704538544]0CAAMonitorHandler :: 0:Action Script /oracle/app/oracle/product/10.2.0/db_1/bin/racgwrap(start) timed out for ora.rac2.LISTENER_RAC2.lsnr! (timeout=600)
2007-05-03 14:28:23.152: [  CRSAPP][2704538544]0StartResource error for ora.rac2.LISTENER_RAC2.lsnr error code = -2
2007-05-03 14:28:23.296: [  CRSEVT][2704538544]0CAAMonitorHandler :: 0:Action Script /oracle/app/oracle/product/10.2.0/db_1/bin/racgwrap(stop) timed out for ora.rac2.LISTENER_RAC2.lsnr! (timeout=600)
2007-05-03 14:28:23.297: [  CRSAPP][2704538544]0StopResource error for ora.rac2.LISTENER_RAC2.lsnr error code = -2
2007-05-03 14:28:23.322: [  CRSRES][2704538544]0X_OP_StopResourceFailed : Stop Resource failed
(File: rti.cpp, line: 1698

2007-05-03 14:28:23.322: [  CRSRES][2704538544][ALERT]0`ora.rac2.LISTENER_RAC2.lsnr` on member `rac2` has experienced an unrecoverable failure.
2007-05-03 14:28:23.322: [  CRSRES][2704538544]0Human intervention required to resume its availability.
2007-05-03 14:28:29.726: [  CRSRES][2715028400]0Start of `ora.rac1.ASM1.asm` on member `rac1` succeeded.
2007-05-03 14:28:31.240: [  CRSRES][2715028400]0Attempting to start `ora.ORCL.ORCL1.inst` on member `rac1`
2007-05-03 14:28:33.081: [  CRSRES][2715028400][ALERT]0`ora.ORCL.ORCL1.inst` on member `rac1` has experienced an unrecoverable failure.
2007-05-03 14:28:33.082: [  CRSRES][2715028400]0Human intervention required to resume its availability.
2007-05-03 14:28:34.142: [  CRSRES][2715028400]0Attempting to start `ora.rac1.LISTENER_RAC1.lsnr` on member `rac1`
2007-05-03 14:28:36.273: [  CRSRES][2715028400][ALERT]0`ora.rac1.LISTENER_RAC1.lsnr` on member `rac1` has experienced an unrecoverable failure.
2007-05-03 14:28:36.273: [  CRSRES][2715028400]0Human intervention required to resume its availability.
2007-05-03 14:28:37.996: [  CRSRES][2715028400]0startRunnable: setting CLI values
2007-05-03 14:28:39.257: [  CRSRES][2648632240]0CRS-1028: Dependency analysis failed because of:
'Resource in UNKNOWN state: ora.rac1.ons'

2007-05-03 14:28:40.519: [  CRSRES][2659675056]0startRunnable: setting CLI values
2007-05-03 14:28:40.794: [  CRSRES][2617019312]0CRS-1028: Dependency analysis failed because of:
'Resource in UNKNOWN state: ora.rac2.ons'

2007-05-03 14:28:41.148: [  CRSRES][2715028400]0Attempting to start `ora.ORCL.ORATEST.ORCL2.srv` on member `rac2`
2007-05-03 14:28:42.622: [  CRSRES][2627509168]0startRunnable: setting CLI values
2007-05-03 14:28:42.631: [  CRSRES][2659675056]0Attempting to start `ora.ORCL.ORATEST.cs` on member `rac2`
2007-05-03 14:28:42.738: [  CRSRES][2704538544]0Attempting to start `ora.ORCL.ORATEST.ORCL1.srv` on member `rac1`
2007-05-03 14:28:43.618: [  CRSRES][2627509168]0Attempting to start `ora.rac2.gsd` on member `rac2`
2007-05-03 14:28:44.354: [  CRSRES][2670164912]0Attempting to start `ora.rac1.gsd` on member `rac1`
2007-05-03 14:28:45.987: [  CRSEVT][2659675056]0CAAMonitorHandler :: 0:Action Script /oracle/app/oracle/product/10.2.0/db_1/bin/racgwrap(start) timed out for ora.ORCL.ORATEST.cs! (timeout=600)
2007-05-03 14:28:45.988: [  CRSAPP][2659675056]0StartResource error for ora.ORCL.ORATEST.cs error code = -2
2007-05-03 14:28:46.512: [  CRSEVT][2715028400]0CAAMonitorHandler :: 0:Action Script /oracle/app/oracle/product/10.2.0/db_1/bin/racgwrap(start) timed out for ora.ORCL.ORATEST.ORCL2.srv! (timeout=600)
2007-05-03 14:28:46.515: [  CRSAPP][2715028400]0StartResource error for ora.ORCL.ORATEST.ORCL2.srv error code = -2
2007-05-03 14:28:46.689: [  CRSEVT][2659675056]0CAAMonitorHandler :: 0:Action Script /oracle/app/oracle/product/10.2.0/db_1/bin/racgwrap(stop) timed out for ora.ORCL.ORATEST.cs! (timeout=600)
2007-05-03 14:28:46.691: [  CRSAPP][2659675056]0StopResource error for ora.ORCL.ORATEST.cs error code = -2
2007-05-03 14:28:46.975: [  CRSEVT][2715028400]0CAAMonitorHandler :: 0:Action Script /oracle/app/oracle/product/10.2.0/db_1/bin/racgwrap(stop) timed out for ora.ORCL.ORATEST.ORCL2.srv! (timeout=600)
2007-05-03 14:28:46.976: [  CRSAPP][2715028400]0StopResource error for ora.ORCL.ORATEST.ORCL2.srv error code = -2
2007-05-03 14:28:47.004: [  CRSRES][2659675056]0X_OP_StopResourceFailed : Stop Resource failed
(File: rti.cpp, line: 1698

2007-05-03 14:28:47.005: [  CRSRES][2659675056][ALERT]0`ora.ORCL.ORATEST.cs` on member `rac2` has experienced an unrecoverable failure.
2007-05-03 14:28:47.005: [  CRSRES][2659675056]0Human intervention required to resume its availability.
2007-05-03 14:28:47.078: [  CRSRES][2715028400]0X_OP_StopResourceFailed : Stop Resource failed
(File: rti.cpp, line: 1698

2007-05-03 14:28:47.078: [  CRSRES][2715028400][ALERT]0`ora.ORCL.ORATEST.ORCL2.srv` on member `rac2` has experienced an unrecoverable failure.
2007-05-03 14:28:47.079: [  CRSRES][2715028400]0Human intervention required to resume its availability.
2007-05-03 14:28:47.957: [  CRSEVT][2627509168]0CAAMonitorHandler :: 0:Action Script /oracle/app/oracle/product/10.2.0/crs/bin/racgwrap(start) timed out for ora.rac2.gsd! (timeout=600)
2007-05-03 14:28:47.958: [  CRSAPP][2627509168]0StartResource error for ora.rac2.gsd error code = -2
2007-05-03 14:28:48.184: [  CRSEVT][2627509168]0CAAMonitorHandler :: 0:Action Script /oracle/app/oracle/product/10.2.0/crs/bin/racgwrap(stop) timed out for ora.rac2.gsd! (timeout=600)
2007-05-03 14:28:48.188: [  CRSAPP][2627509168]0StopResource error for ora.rac2.gsd error code = -2
2007-05-03 14:28:48.272: [  CRSRES][2627509168]0X_OP_StopResourceFailed : Stop Resource failed
(File: rti.cpp, line: 1698

2007-05-03 14:28:48.273: [  CRSRES][2627509168][ALERT]0`ora.rac2.gsd` on member `rac2` has experienced an unrecoverable failure.
2007-05-03 14:28:48.273: [  CRSRES][2627509168]0Human intervention required to resume its availability.
2007-05-03 14:28:49.407: [  CRSRES][2606529456]0Attempting to start `ora.ORCL.db` on member `rac1`
2007-05-03 14:28:53.938: [  CRSRES][2606529456][ALERT]0`ora.ORCL.db` on member `rac1` has experienced an unrecoverable failure.
2007-05-03 14:28:53.939: [  CRSRES][2606529456]0Human intervention required to resume its availability.
2007-05-03 14:28:54.240: [  CRSRES][2670164912][ALERT]0`ora.rac1.gsd` on member `rac1` has experienced an unrecoverable failure.
2007-05-03 14:28:54.241: [  CRSRES][2670164912]0Human intervention required to resume its availability.
2007-05-03 14:28:54.300: [  CRSRES][2704538544][ALERT]0`ora.ORCL.ORATEST.ORCL1.srv` on member `rac1` has experienced an unrecoverable failure.
2007-05-03 14:28:54.301: [  CRSRES][2704538544]0Human intervention required to resume its availability.
2007-05-03 14:37:56.812: [  CRSEVT][2606529456]0CAAMonitorHandler :: 0:Action Script /oracle/app/oracle/product/10.2.0/crs/bin/racgwrap(check) timed out for ora.rac2.vip! (timeout=60)
2007-05-03 14:37:56.814: [  CRSAPP][2606529456]0CheckResource error for ora.rac2.vip error code = -2
2007-05-03 14:37:57.086: [  CRSEVT][2617019312]0CAAMonitorHandler :: 0:Action Script /oracle/app/oracle/product/10.2.0/crs/bin/racgwrap(check) timed out for ora.rac2.vip! (timeout=60)
2007-05-03 14:37:57.088: [  CRSAPP][2617019312]0CheckResource error for ora.rac2.vip error code = -2
2007-05-03 14:37:57.638: [  CRSEVT][2606529456]0CAAMonitorHandler :: 0:Action Script /oracle/app/oracle/product/10.2.0/crs/bin/racgwrap(check) timed out for ora.rac2.vip! (timeout=60)
2007-05-03 14:37:57.640: [  CRSAPP][2606529456]0CheckResource error for ora.rac2.vip error code = -2
2007-05-03 14:37:57.820: [  CRSEVT][2606529456]0CAAMonitorHandler :: 0:Action Script /oracle/app/oracle/product/10.2.0/crs/bin/racgwrap(check) timed out for ora.rac2.vip! (timeout=60)
2007-05-03 14:37:57.822: [  CRSAPP][2606529456]0CheckResource error for ora.rac2.vip error code = -2
2007-05-03 14:37:57.983: [  CRSEVT][2617019312]0CAAMonitorHandler :: 0:Action Script /oracle/app/oracle/product/10.2.0/crs/bin/racgwrap(check) timed out for ora.rac2.vip! (timeout=60)
2007-05-03 14:37:57.984: [  CRSAPP][2617019312]0CheckResource error for ora.rac2.vip error code = -2
2007-05-03 14:37:58.154: [  CRSEVT][2606529456]0CAAMonitorHandler :: 0:Action Script /oracle/app/oracle/product/10.2.0/crs/bin/racgwrap(check) timed out for ora.rac2.vip! (timeout=60)
2007-05-03 14:37:58.156: [  CRSAPP][2606529456]0CheckResource error for ora.rac2.vip error code = -2
2007-05-03 14:37:58.355: [  CRSEVT][2606529456]0CAAMonitorHandler :: 0:Action Script /oracle/app/oracle/product/10.2.0/crs/bin/racgwrap(check) timed out for ora.rac2.vip! (timeout=60)
2007-05-03 14:37:58.357: [  CRSAPP][2606529456]0CheckResource error for ora.rac2.vip error code = -2
2007-05-03 14:37:58.607: [  CRSEVT][2617019312]0CAAMonitorHandler :: 0:Action Script /oracle/app/oracle/product/10.2.0/crs/bin/racgwrap(check) timed out for ora.rac2.vip! (timeout=60)

从上面看出，在启动其它服务时候，遇到类似ora.ORCL.ORATEST.cs error code = -2错误，导致两个节点服务不能正常启动。

但是，手工通过sqlplus启动是可以的！只是
ora....CL1.srv application   
ora....CL2.srv application           
ora....TEST.cs application  

这几个服务始终无法启动，这样导致sqlplus system/manager@ORATEST始终不能连接。rac无法使用！

blue_stone

sqlplus system/manager@ORATEST 应该是和listener有关的, 和集群服务没什么关系啊
两个节点的listener都起来了么?

exitgogo

谢谢blue_stone ，问题已经解决，time synchronization问题



可通过设置ntp来解决，同时，如果通过srvctl启动或者关闭出现CRS-0223: Resource 'ora.rac2.ons' has placement error类似问题，可以先通过$ORA_CRS_HOME/bin/crs_stop -all 停掉所有STATE=UNKNOWN的服务，然后再次用$ORA_CRS_HOME/bin/crs_start -all 或者srvctl启动即可成功！

wangyl1977

老大现在在哪呢? 5.1回西安还是在北京?

原帖由 exitgogo 于 2007-5-4 15:09 发表
谢谢blue_stone ，问题已经解决，time synchronization问题



可通过设置ntp来解决，同时，如果通过srvctl启动或者关闭出现CRS-0223: Resource 'ora.rac2.ons' has placement error类似问题，可以先通过$ORA ...

exitgogo

原帖由 wangyl1977 于 2007-5-4 20:18 发表
老大现在在哪呢? 5.1回西安还是在北京?

请查阅站内短信！

dong0058

我遇到的问题同你的一样。
我已经设置了ntp服务器，两个机器也已经做到了时间的同步，可是问题仍然存在呀！
每次两个节点重启之后，都要手动的做：
crs_stat -t
crs_stop 停掉所有的stat=unknown的服务
再逐一地启动才行！

盼望解决中！