CRS-0184: Cannot communicate with the CRS daemon

zhshujun

今天不小心重新启动了windows机器，导致用vmware做的2node redhat linux 4AS的oracle RAC其中一起机器重启后运行crs_stat -t时出现

CRS-0184: Cannot communicate with the CRS daemon错误。

使用$ORA_CRS_HOME/bin/crsctl stop crs和$ORA_CRS_HOME/bin/crsctl start crs后，仍然不起作用，查看$ORA_CRS_HOME/log/rac1/crsd/crsd.log发现：

2009-09-04 03:11:29.256: [  CRSEVT][3676748720]0CAAMonitorHandler :: 0:Could not join /u01/app/oracle/product/10.2.0/crs_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child

2009-09-04 03:11:29.261: [  CRSEVT][3676748720]0CAAMonitorHandler :: 0:Action Script. /u01/app/oracle/product/10.2.0/crs_1/bin/racgwrap(check) timed out for ora.rac1.vip! (timeout=60)
2009-09-04 03:11:29.263: [  CRSAPP][3676748720]0CheckResource error for ora.rac1.vip error code = -2
2009-09-04 03:11:32.414: [  CRSRES][3623582640]0rac1 : CRS-1019: Resource ora.test.test2.inst (application) cannot run on rac1

2009-09-04 03:11:34.534: [  CRSRES][3676748720]0startRunnable: setting CLI values
2009-09-04 03:11:34.584: [  CRSRES][3676748720]0Attempting to start `ora.test.test1.inst` on member `rac1`
2009-09-04 03:11:35.692: [  CRSEVT][3740548016]0CAAMonitorHandler :: 0:Could not join /u01/app/oracle/product/10.2.0/crs_1/bin/racgwrap(start)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child

2009-09-04 03:11:35.691: [  CRSEVT][3740548016]0CAAMonitorHandler :: 0:Action Script. /u01/app/oracle/product/10.2.0/crs_1/bin/racgwrap(start) timed out for ora.rac2.vip! (timeout=60)
2009-09-04 03:11:35.693: [  CRSAPP][3740548016]0StartResource error for ora.rac2.vip error code = -2
2009-09-04 03:12:09.148: [  CRSRES][3751037872]0Start of `ora.rac1.gsd` on member `rac1` succeeded.
2009-09-04 03:12:38.965: [  CRSEVT][3740548016]0CAAMonitorHandler :: 0:Could not join /u01/app/oracle/product/10.2.0/crs_1/bin/racgwrap(stop)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child

2009-09-04 03:12:38.971: [  CRSEVT][3740548016]0CAAMonitorHandler :: 0:Action Script. /u01/app/oracle/product/10.2.0/crs_1/bin/racgwrap(stop) timed out for ora.rac2.vip! (timeout=60)
2009-09-04 03:12:38.972: [  CRSAPP][3740548016]0StopResource error for ora.rac2.vip error code = -2
2009-09-04 03:12:39.005: [  CRSRES][3740548016]0X_OP_StopResourceFailed : Stop Resource failed
(File: rti.cpp, line: 1803

2009-09-04 03:12:39.005: [  CRSRES][3740548016][ALERT]0`ora.rac2.vip` on member `rac1` has experienced an unrecoverable failure.
2009-09-04 03:12:39.007: [  CRSRES][3740548016]0Human intervention required to resume its availability.
2009-09-04 03:12:39.345: [  CRSRES][3740548016]0CRS-1028: Dependency analysis failed because of:
'Resource in UNKNOWN state: ora.rac2.vip'

后到google上搜索了一下，还真有解决办法：

the reason why it was unable to start was that each time server reboots it creates a socket at /tmp/.oracle or /var/tmp/.oracle directory .

Also if there are previously existing sockets they cannot be reused or deleted automatically from this directory .oracle.

Therefore the solution to above problem was obtained by deleting all the files ins

the reason why it was unable to start was that each time server reboots it creates a socket at /tmp/.oracle or /var/tmp/.oracle directory .

Also if there are previously existing sockets they cannot be reused or deleted automatically from this directory .oracle.

Therefore the solution to above problem was obtained by deleting all the files inside .oracle directoery in /var/tmp or /tmp.

ide .oracle directoery in /var/tmp or /tmp.

然后重新启动机器就可以了。

问题解决了，
删除node1机器上的/etc/oracle/scls_scr/rac1/oracle/cssfatal 文件
如果不删这个文件，运行root.sh 脚本时会报错。
然后重新运行下$ORA_CRS_HOME/root.sh脚本
inode1:root::/db> cd oracle/product/10.2.0/crs
inode1:root::/db/oracle/product/10.2.0/crs> ./root.sh
WARNING: directory '/db/oracle/product/10.2.0' is not owned by root
WARNING: directory '/db/oracle/product' is not owned by root
WARNING: directory '/db/oracle' is not owned by root
WARNING: directory '/db' is not owned by root
Checking to see if Oracle CRS stack is already configured
Checking to see if any 9i GSD is up

Setting the permissions on OCR backup directory
Setting up NS directories
Oracle Cluster Registry configuration upgraded successfully
WARNING: directory '/db/oracle/product/10.2.0' is not owned by root
WARNING: directory '/db/oracle/product' is not owned by root
WARNING: directory '/db/oracle' is not owned by root
WARNING: directory '/db' is not owned by root
clscfg: EXISTING configuration version 3 detected.
clscfg: version 3 is 10G Release 2.
Successfully accumulated necessary OCR keys.
Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
node <nodenumber>: <nodename> <private interconnect name> <hostname>
node 1: inode1 inode1-priv inode1
node 2: inode2 inode2-priv inode2
clscfg: Arguments check out successfully.

NO KEYS WERE WRITTEN. Supply -force parameter to override.
-force is destructive and will destroy any previous cluster
configuration.
Oracle Cluster Registry for cluster has already been initialized
Startup will be queued to init within 30 seconds.
Adding daemons to inittab
Adding daemons to inittab
Expecting the CRS daemons to be up within 600 seconds.
CSS is active on these nodes.
        inode1
        inode2
CSS is active on all nodes.
Waiting for the Oracle CRSD and EVMD to start
Oracle CRS stack installed and running under init(1M)
Running vipca(silent) for configuring nodeapps
IP address "inode1-vip" has already been used. Enter an unused IP address.
inode1:root::/db/oracle/product/10.2.0/crs> cd bin
inode1:root::/db/oracle/product/10.2.0/crs/bin> ./crsctl check crs
CSS appears healthy
CRS appears healthy
EVM appears healthy