oracle 11g rac无法正常启动

y331044508

1. [root@racdb1 ~]# cat /etc/issue | grep Linux
   
2. Red Hat Enterprise Linux Server release 5.6 (Tikanga)
   
3. 
   
4. oracle 11g 11.2.0.1
   
5. 
   
6. [root@racdb1 racdb1]# oracleasm listdisks
   
7. ASM_DATA
   
8. ASM_DATA1
   
9. ASM_DATA2
   
10. ASM_FRA
    
11. OCR_VOTE
    
12. 
    
13. [root@racdb1 bin]# ./crsctl start crs
    
14. CRS-4640: Oracle High Availability Services is already active
    
15. CRS-4000: Command Start failed, or completed with errors.
    
16. 
    
17. 除了这几个进程之外其他进程都没有启动起来
    
18. [root@racdb1 cdata]# ps -elf|grep d.bin
    
19. 4 S root      4005     1  0  78   0 - 116211 -     11:33 ?        00:00:02 /u01/app/11.2.0/grid/bin/ohasd.bin reboot
    
20. 4 S root      4577     1  0  78   0 - 85904 -      11:36 ?        00:00:01 /u01/app/11.2.0/grid/bin/orarootagent.bin
    
21. 0 S root      6804     1  0  78   0 - 32029 -      13:39 ?        00:00:02 /u01/app/11.2.0/grid/bin/crsd.bin reboot
    
22. 4 S root      6835     1  0 -40   - - 73698 -      13:39 ?        00:00:02 /u01/app/11.2.0/grid/bin/cssdmonitor
    
23. [root@racdb1 racdb1]# ps -ef |grep ora
    
24. root      3099  3076  0 11:32 ?        00:00:03 hald-addon-storage: polling /dev/hdc
    
25. root      4577     1  0 11:36 ?        00:00:01 /u01/app/11.2.0/grid/bin/orarootagent.bin
    
26. root      6947  5583  0 13:48 pts/3    00:00:00 su - oracle
    
27. oracle    6948  6947  0 13:48 pts/3    00:00:00 -bash
    
28. root      7103  5510  0 14:06 pts/2    00:00:00 grep ora
    
29. 
    
30. [root@racdb1 bin]# ./crsctl start cluster -all
    
31. CRS-2503: 资源 'ora.evmd' 处于未知状态, 必须先停止该资源
    
32. CRS-2679: 尝试清除 'ora.gipcd' (在 'racdb1' 上)
    
33. CRS-2679: 尝试清除 'ora.mdnsd' (在 'racdb1' 上)
    
34. CRS-2680: 未能清除 'ora.gipcd' (在 'racdb1' 上)
    
35. CRS-2680: 未能清除 'ora.mdnsd' (在 'racdb1' 上)
    
36. CRS-2679: 尝试清除 'ora.gpnpd' (在 'racdb1' 上)
    
37. CRS-2680: 未能清除 'ora.gpnpd' (在 'racdb1' 上)
    
38. CRS-2672: 尝试启动 'ora.cssd' (在 'racdb1' 上)
    
39. CRS-2672: 尝试启动 'ora.diskmon' (在 'racdb1' 上)
    
40. CRS-2674: 未能启动 'ora.cssd' (在 'racdb1' 上)
    
41. CRS-2679: 尝试清除 'ora.cssd' (在 'racdb1' 上)
    
42. CRS-2681: 成功清除 'ora.cssd' (在 'racdb1' 上)
    
43. CRS-2674: 未能启动 'ora.diskmon' (在 'racdb1' 上)
    
44. CRS-2679: 尝试清除 'ora.diskmon' (在 'racdb1' 上)
    
45. CRS-5016: 进程 "/u01/app/11.2.0/grid/bin/diskmon" (由代理 "/u01/app/11.2.0/grid/bin/orarootagent.bin" 衍生, 用于操作 "clean") 失败: 详细信息见 "(:CLSN00010:)" (位于 "/u01/app/11.2.0/grid/log/racdb1/agent/ohasd/orarootagent_root/orarootagent_root.log")
    
46. CRS-2681: 成功清除 'ora.diskmon' (在 'racdb1' 上)
    
47. 
    
48. /u01/app/11.2.0/grid/log/racdb1/agent/ohasd/orarootagent_root/orarootagent_root.log
    
49. 2013-07-05 14:08:19.696: [    AGFW][1096329536] Agent sending reply for: RESOURCE_CLEAN[ora.diskmon 1 1] ID 4100:4043
    
50. 2013-07-05 14:08:19.697: [ora.diskmon][1205655872] [check] DiskmonAgent::check {
    
51. 2013-07-05 14:08:19.697: [ora.diskmon][1205655872] [check] DiskmonAgent::connect {
    
52. 2013-07-05 14:08:19.697: [ora.diskmon][1205655872] [check] DiskmonAgent::connect: skgznp_connect failed with error 56815 and the timeout expired
    
53. 2013-07-05 14:08:19.697: [ora.diskmon][1205655872] [check] (null) category: 56815, operation: connect, loc: skgznpcon6, OS error: 111, other:
    
54. 2013-07-05 14:08:19.697: [ora.diskmon][1205655872] [check] DiskmonAgent::connect } error
    
55. 2013-07-05 14:08:19.697: [ora.diskmon][1205655872] [check] DiskmonAgent::check } 2
    
56. 2013-07-05 14:08:19.697: [    AGFW][1205655872] check for resource: ora.diskmon 1 1 completed with status: PLANNED_OFFLINE
    
57. 2013-07-05 14:08:19.698: [    AGFW][1096329536] ora.diskmon 1 1 state changed from: CLEANING to: PLANNED_OFFLINE
    
58. 2013-07-05 14:08:19.698: [    AGFW][1096329536] Agent sending last reply for: RESOURCE_CLEAN[ora.diskmon 1 1] ID 4100:4043
    
59. 2013-07-05 14:08:55.772: [    AGFW][1096329536] Agent received the message: AGENT_HB[Engine] ID 12293:4061
    
60. 2013-07-05 14:09:00.344: [    AGFW][1096329536] CHECK initiated by timer for: ora.drivers.acfs 1 1
    
61. 2013-07-05 14:09:00.345: [    AGFW][1163696448] Executing command: check for resource: ora.drivers.acfs 1 1
    
62. 2013-07-05 14:09:00.345: [ora.drivers.acfs][1163696448] [check] Arg Value = check
    
63. 2013-07-05 14:09:00.345: [ora.drivers.acfs][1163696448] [check] Total Count of Environment Variables = 3
    
64. 2013-07-05 14:09:00.345: [ora.drivers.acfs][1163696448] [check] Adding Environment Variables _ORA_AGENT_ACTION=TRUE
    
65. 2013-07-05 14:09:00.345: [ora.drivers.acfs][1163696448] [check] Adding Environment Variables __IS_HASD_AGENT=
    
66. 2013-07-05 14:09:00.345: [ora.drivers.acfs][1163696448] [check] Skipping empty Env variable from USR_ORA_ENV
    
67. 2013-07-05 14:09:00.345: [ora.drivers.acfs][1163696448] [check] Utils:execCmd action = 3 flags = 6 ohome = (null) cmdname = acfsload.
    
68. 2013-07-05 14:09:00.345: [ora.drivers.acfs][1163696448] [check] getOracleHomeAttrib: oracle_home = /u01/app/11.2.0/grid
    
69. 2013-07-05 14:09:00.346: [ora.drivers.acfs][1163696448] [check] Utils:execCmd Running the binary from /u01/app/11.2.0/grid/bin/acfsload
    
70. 2013-07-05 14:09:00.449: [ora.drivers.acfs][1163696448] [check] execCmd ret = 0
    
71. 2013-07-05 14:09:00.449: [    AGFW][1163696448] check for resource: ora.drivers.acfs 1 1 completed with status: ONLINE
    
72. 2013-07-05 14:09:25.780: [    AGFW][1096329536] Agent received the message: AGENT_HB[Engine] ID 12293:4069
    
73. 2013-07-05 14:09:55.786: [    AGFW][1096329536] Agent received the message: AGENT_HB[Engine] ID 12293:4077
    
74. 2013-07-05 14:10:00.360: [    AGFW][1096329536] CHECK initiated by timer for: ora.drivers.acfs 1 1
    
75. 2013-07-05 14:10:00.361: [    AGFW][1216145728] Executing command: check for resource: ora.drivers.acfs 1 1
    
76. 2013-07-05 14:10:00.362: [ora.drivers.acfs][1216145728] [check] Arg Value = check
    
77. 2013-07-05 14:10:00.362: [ora.drivers.acfs][1216145728] [check] Total Count of Environment Variables = 3
    
78. 2013-07-05 14:10:00.362: [ora.drivers.acfs][1216145728] [check] Adding Environment Variables _ORA_AGENT_ACTION=TRUE
    
79. 2013-07-05 14:10:00.362: [ora.drivers.acfs][1216145728] [check] Adding Environment Variables __IS_HASD_AGENT=
    
80. 2013-07-05 14:10:00.362: [ora.drivers.acfs][1216145728] [check] Skipping empty Env variable from USR_ORA_ENV
    
81. 2013-07-05 14:10:00.362: [ora.drivers.acfs][1216145728] [check] Utils:execCmd action = 3 flags = 6 ohome = (null) cmdname = acfsload.
    
82. 2013-07-05 14:10:00.362: [ora.drivers.acfs][1216145728] [check] getOracleHomeAttrib: oracle_home = /u01/app/11.2.0/grid
    
83. 2013-07-05 14:10:00.363: [ora.drivers.acfs][1216145728] [check] Utils:execCmd Running the binary from /u01/app/11.2.0/grid/bin/acfsload
    
84. 2013-07-05 14:10:00.466: [ora.drivers.acfs][1216145728] [check] execCmd ret = 0
    
85. 2013-07-05 14:10:00.466: [    AGFW][1216145728] check for resource: ora.drivers.acfs 1 1 completed with status: ONLINE
    
86. 
    
87. /u01/app/11.2.0/grid/log/racdb1/alertracdb1.log
    
88. 2013-07-05 13:36:01.652
    
89. [ohasd(4005)]CRS-5828:无法启动代理 '/u01/app/11.2.0/grid/bin/oraagent_grid'。详细资料见 (:CRSAGF00130:) (位于 /u01/app/11.2.0/grid/log/racdb1/ohasd/ohasd.log)。
    
90. 2013-07-05 13:39:31.705
    
91. [ohasd(4005)]CRS-5828:无法启动代理 '/u01/app/11.2.0/grid/bin/oraagent_grid'。详细资料见 (:CRSAGF00130:) (位于 /u01/app/11.2.0/grid/log/racdb1/ohasd/ohasd.log)。
    
92. 2013-07-05 13:39:33.030
    
93. [cssd(6789)]CRS-1713:CSSD 守护程序已在 clustered 模式下启动
    
94. 2013-07-05 13:39:36.118
    
95. [cssd(6789)]CRS-2302:无法获取 GPnP 概要文件。错误 CLSGPNP_NO_DAEMON (GPNPD 守护程序未运行)。
    
96. 2013-07-05 13:39:36.230
    
97. [ohasd(4005)]CRS-2765:资源 'ora.cssdmonitor' 已失败 (在服务器 'racdb1' 上)。
    
98. 2013-07-05 13:39:36.374
    
99. [ohasd(4005)]CRS-2765:资源 'ora.crsd' 已失败 (在服务器 'racdb1' 上)。
    
100. 2013-07-05 13:40:31.734
     
101. [/u01/app/11.2.0/grid/bin/orarootagent.bin(4577)]CRS-5818:已中止命令 'start for resource: ora.diskmon 1 1' (对于资源 'ora.diskmon')。详细资料见 (:CRSAGF00113:) (位于 /u01/app/11.2.0/grid/log/racdb1/agent/ohasd/orarootagent_root/orarootagent_root.log)。
     
102. 2013-07-05 13:40:35.742
     
103. [ohasd(4005)]CRS-2757:命令 'Start' 在等待来自资源 'ora.diskmon' 的响应时超时。详细资料见 (:CRSPE00111:) (位于 /u01/app/11.2.0/grid/log/racdb1/ohasd/ohasd.log)。
     
104. 2013-07-05 13:40:35.852
     
105. [/u01/app/11.2.0/grid/bin/orarootagent.bin(4577)]CRS-5016:进程 "/u01/app/11.2.0/grid/bin/diskmon" (由代理 "/u01/app/11.2.0/grid/bin/orarootagent.bin" 衍生, 用于操作 "clean") 失败: 详细信息见 "(:CLSN00010:)" (位于 "/u01/app/11.2.0/grid/log/racdb1/agent/ohasd/orarootagent_root/orarootagent_root.log")
     
106. 
     
107. /u01/app/11.2.0/grid/log/racdb1/cssd/ocssd.log
     
108. 2013-07-05 13:39:36.091: [    GPnP][3852594912]clsgpnp_InitCKProviders: [at clsgpnp0.c:3891] Init gpnp local security key provider 1 of 2: file wallet (LSKP-FSW) OK
     
109. 2013-07-05 13:39:36.091: [    GPnP][3852594912]clsgpnp_InitCKProviders: [at clsgpnp0.c:3897] Init gpnp local security key proveders 2 of 2: OLR wallet (LSKP-CLSW-OLR)
     
110. [   CLWAL][3852594912]clsw_Initialize: OLR initlevel [70000]
     
111. 2013-07-05 13:39:36.094: [    GPnP][3852594912]clsgpnp_InitCKProviders: [at clsgpnp0.c:3919] Init gpnp local security key provider 2 of 2: OLR wallet (LSKP-CLSW-OLR) OK
     
112. 2013-07-05 13:39:36.094: [    GPnP][3852594912]clsgpnp_getCK: [at clsgpnp0.c:1950] <Get gpnp security keys (wallet) for id:1,typ;7. (2 providers - fatal if all fail)
     
113. 2013-07-05 13:39:36.094: [    GPnP][3852594912]clsgpnpkwf_getWalletPath: [at clsgpnpkwf.c:498] req_id=1 ck_prov_id=1 wallet path: /u01/app/11.2.0/grid/gpnp/racdb1/wallets/peer/
     
114. 2013-07-05 13:39:36.104: [    GPnP][3852594912]clsgpnpwu_walletfopen: [at clsgpnpwu.c:494] Opened SSO wallet: '/u01/app/11.2.0/grid/gpnp/racdb1/wallets/peer/cwallet.sso'
     
115. 2013-07-05 13:39:36.104: [    GPnP][3852594912]clsgpnp_getCK: [at clsgpnp0.c:1965] Result: (0) CLSGPNP_OK. Get gpnp wallet - provider 1 of 2 (LSKP-FSW(1))
     
116. 2013-07-05 13:39:36.104: [    GPnP][3852594912]clsgpnp_getCK: [at clsgpnp0.c:1982] Got gpnp security keys (wallet).>
     
117. 2013-07-05 13:39:36.107: [    GPnP][3852594912]clsgpnp_getCK: [at clsgpnp0.c:1950] <Get gpnp security keys (wallet) for id:1,typ;4. (2 providers - fatal if all fail)
     
118. 2013-07-05 13:39:36.107: [    GPnP][3852594912]clsgpnpkwf_getWalletPath: [at clsgpnpkwf.c:498] req_id=1 ck_prov_id=1 wallet path: /u01/app/11.2.0/grid/gpnp/racdb1/wallets/peer/
     
119. 2013-07-05 13:39:36.117: [    GPnP][3852594912]clsgpnpwu_walletfopen: [at clsgpnpwu.c:494] Opened SSO wallet: '/u01/app/11.2.0/grid/gpnp/racdb1/wallets/peer/cwallet.sso'
     
120. 2013-07-05 13:39:36.117: [    GPnP][3852594912]clsgpnp_getCK: [at clsgpnp0.c:1965] Result: (0) CLSGPNP_OK. Get gpnp wallet - provider 1 of 2 (LSKP-FSW(1))
     
121. 2013-07-05 13:39:36.117: [    GPnP][3852594912]clsgpnp_getCK: [at clsgpnp0.c:1982] Got gpnp security keys (wallet).>
     
122. 2013-07-05 13:39:36.117: [    GPnP][3852594912]clsgpnp_Init: [at clsgpnp0.c:837] GPnP client pid=6789, tl=3, f=3
     
123. 2013-07-05 13:39:36.117: [    GPnP][3852594912]clsgpnp_getDaemonLocalName: [at clsgpnp0.c:2576] Result: (0) CLSGPNP_OK. Local gpnp connect: 'ipc://GPNPD_racdb1'
     
124. 2013-07-05 13:39:36.118: [    GPnP][3852594912]clsgpnpm_connect: [at clsgpnpm.c:1100] GIPC gipcretConnectionRefused (29) gipcConnect(ipc-ipc://GPNPD_racdb1)
     
125. 2013-07-05 13:39:36.118: [    GPnP][3852594912]clsgpnpm_connect: [at clsgpnpm.c:1101] Result: (48) CLSGPNP_COMM_ERR. Failed to connect to call url "ipc://GPNPD_racdb1"
     
126. 2013-07-05 13:39:36.118: [    GPnP][3852594912]clsgpnp_getProfileEx: [at clsgpnp.c:546] Result: (13) CLSGPNP_NO_DAEMON. Can't get GPnP service profile from local GPnP daemon
     
127. 2013-07-05 13:39:36.118: [ default][3852594912]无法获取 GPnP 概要文件。错误 CLSGPNP_NO_DAEMON (GPNPD 守护程序未运行)。
     
128. 2013-07-05 13:39:36.118: [    CSSD][3852594912]clsgpnp_getProfile failed, rc(13)
     
129. 
     
130. /u01/app/11.2.0/grid/log/racdb1/crsd/crsd.log
     
131. 2013-07-05 13:43:45.356: [ CSSCLNT][2007818832]clssscConnect: gipc request failed with 29 (0x16)
     
132. 2013-07-05 13:43:45.356: [ CSSCLNT][2007818832]clsssInitNative: connect failed, rc 29
     
133. 2013-07-05 13:43:45.356: [  CRSRTI][2007818832] CSS is not ready. Received status 3 from CSS. Waiting for good status ..
     
134. 
     
135. 2013-07-05 13:43:46.359: [ CSSCLNT][2007818832]clssscConnect: gipc request failed with 29 (0x16)
     
136. 2013-07-05 13:43:46.359: [ CSSCLNT][2007818832]clsssInitNative: connect failed, rc 29
     
137. 2013-07-05 13:43:46.359: [  CRSRTI][2007818832] CSS is not ready. Received status 3 from CSS. Waiting for good status ..
     
138. 
     
139. 2013-07-05 13:43:47.362: [ CSSCLNT][2007818832]clssscConnect: gipc request failed with 29 (0x16)
     
140. 2013-07-05 13:43:47.362: [ CSSCLNT][2007818832]clsssInitNative: connect failed, rc 29
     
141. 2013-07-05 13:43:47.362: [  CRSRTI][2007818832] CSS is not ready. Received status 3 from CSS. Waiting for good status ..
     
142. 
     
143. 2013-07-05 13:43:48.365: [ CSSCLNT][2007818832]clssscConnect: gipc request failed with 29 (0x16)
     
144. 2013-07-05 13:43:48.365: [ CSSCLNT][2007818832]clsssInitNative: connect failed, rc 29
     
145. 2013-07-05 13:43:48.366: [  CRSRTI][2007818832] CSS is not ready. Received status 3 from CSS. Waiting for good status ..
     
146. 
     
147. 刚开始发现系统根目录空间不足，直接把/u01/app/11.2.0/grid/log/racdb1下面的日志全部删除掉了，后来就成这样了;之后我自己又重新创建了这些日志目录；
     
148. 
     
149. [root@racdb1 racdb1]# ll
     
150. 总计 76
     
151. drwxr-xr-x 2 grid   oinstall  4096 07-05 11:14 admin
     
152. drwxr-xr-x 3 root   oinstall  4096 07-05 11:14 agent
     
153. -rw-rw-r-- 1 oracle oinstall 13835 07-05 14:00 alertracdb1.log
     
154. drwxr----T 2 grid   oinstall  4096 07-05 10:52 client
     
155. drwxr-xr-x 2 root   oinstall  4096 07-05 13:43 crsd
     
156. drwxr-xr-x 2 grid   oinstall  4096 07-05 13:32 cssd
     
157. drwxr-xr-x 2 root   oinstall  4096 07-05 11:14 ctssd
     
158. drwxr-xr-x 2 grid   oinstall  4096 07-05 11:50 diskmon
     
159. drwxr-xr-x 2 grid   oinstall  4096 07-05 11:14 evmd
     
160. drwxr-xr-x 2 grid   oinstall  4096 07-05 11:14 gipcd
     
161. drwxr-xr-x 2 root   oinstall  4096 07-05 11:14 gnsd
     
162. drwxr-xr-x 2 grid   oinstall  4096 07-05 11:14 gpnpd
     
163. drwxr-xr-x 2 grid   oinstall  4096 07-05 11:14 mdnsd
     
164. drwxr-xr-x 2 root   oinstall  4096 07-05 11:39 ohasd
     
165. drwxr-xr-x 2 grid   oinstall  4096 07-05 11:14 racg
     
166. drwxr-xr-x 2 grid   oinstall  4096 07-05 11:14 srvm

复制代码

y331044508

1. [root@racdb1 client]# cat crsctl.log
   
2. Oracle Database 11g Clusterware Release 11.2.0.1.0 - Production Copyright 1996, 2009 Oracle. All rights reserved.
   
3. 2013-07-05 09:40:12.675: [  OCRASM][1647945936]proprasmo: kgfoCheckMount return [6]. Cannot proceed with dirty open.
   
4. 2013-07-05 09:40:12.676: [  OCRASM][1647945936]proprasmo: Error in open/create file in dg [DATA]
   
5. [  OCRASM][1647945936]SLOS : SLOS: cat=6, opn=kgfo, dep=0, loc=kgfoCkMt03
   
6. diskgroup DATA not mounted ()
   
7. 
   
8. 2013-07-05 09:40:12.738: [  OCRASM][1647945936]proprasmo: kgfoCheckMount returned [6]
   
9. 2013-07-05 09:40:12.738: [  OCRASM][1647945936]proprasmo: The ASM disk group DATA is not found or not mounted
   
10. 2013-07-05 09:40:12.739: [  OCRRAW][1647945936]proprioo: Failed to open [+DATA]. Returned proprasmo() with [26]. Marking location as UNAVAILABLE.
    
11. 2013-07-05 09:40:12.739: [  OCRRAW][1647945936]proprioo: No OCR/OLR devices are usable
    
12. 2013-07-05 09:40:12.739: [  OCRASM][1647945936]proprasmcl: asmhandle is NULL
    
13. 2013-07-05 09:40:12.739: [  OCRRAW][1647945936]proprinit: Could not open raw device
    
14. 2013-07-05 09:40:12.739: [  OCRASM][1647945936]proprasmcl: asmhandle is NULL
    
15. 2013-07-05 09:40:12.740: [ default][1647945936]a_init:7!: Backend init unsuccessful : [26]
    
16. 2013-07-05 09:45:13.118: [  OCRASM][2853984464]proprasmo: kgfoCheckMount return [6]. Cannot proceed with dirty open.
    
17. 2013-07-05 09:45:13.118: [  OCRASM][2853984464]proprasmo: Error in open/create file in dg [DATA]
    
18. [  OCRASM][2853984464]SLOS : SLOS: cat=6, opn=kgfo, dep=0, loc=kgfoCkMt03
    
19. diskgroup DATA not mounted ()
    
20. 
    
21. [root@racdb2 ~]# oracleasm listdisks
    
22. ASM_DATA
    
23. ASM_DATA1
    
24. ASM_DATA2
    
25. ASM_FRA
    
26. OCR_VOTE
    
27. 
    
28. [root@racdb1 bin]# ./crsctl query crs activeversion  
    
29. Oracle Cluster Registry initialization failed accessing Oracle Cluster Registry device: PROC-26: Error while accessing the physical storage ASM error [SLOS: cat=7, opn=kgfoAl06, dep=29701, loc=kgfokge
    
30. ORA-29701: unable to connect to Cluster Synchronization Service
    
31. ] [7]
    
32. [root@racdb1 bin]#
    
33. [root@racdb1 bin]# ./crsctl check crs
    
34. CRS-4638: Oracle High Availability Services is online
    
35. CRS-4535: Cannot communicate with Cluster Ready Services
    
36. CRS-4530: Communications failure contacting Cluster Synchronization Services daemon
    
37. CRS-4534: Cannot communicate with Event Manager
    
38. [root@racdb1 bin]#
    
39. [root@racdb1 bin]# ps -ef | grep d.bin
    
40. root      9032  8491  0 15:25 ?        00:00:01 /u01/app/11.2.0/grid/bin/ohasd.bin restart
    
41. root      9080     1  0 15:25 ?        00:00:00 /u01/app/11.2.0/grid/bin/orarootagent.bin
    
42. root     10212     1  0 16:55 ?        00:00:00 /u01/app/11.2.0/grid/bin/cssdmonitor
    
43. root     10319 10258  0 17:00 pts/10   00:00:00 grep d.bin
    
44. [root@racdb1 bin]#
    
45. [root@racdb1 bin]# ./crsctl stat res -t -init
    
46. --------------------------------------------------------------------------------
    
47. NAME           TARGET  STATE        SERVER                   STATE_DETAILS      
    
48. --------------------------------------------------------------------------------
    
49. Cluster Resources
    
50. --------------------------------------------------------------------------------
    
51. ora.asm
    
52.       1        ONLINE  OFFLINE                                                   
    
53. ora.crsd
    
54.       1        ONLINE  OFFLINE                                                   
    
55. ora.cssd
    
56.       1        ONLINE  OFFLINE                                                   
    
57. ora.cssdmonitor
    
58.       1        ONLINE  ONLINE       racdb1                                       
    
59. ora.ctssd
    
60.       1        ONLINE  OFFLINE                                                   
    
61. ora.diskmon
    
62.       1        ONLINE  OFFLINE                                                   
    
63. ora.drivers.acfs
    
64.       1        ONLINE  ONLINE       racdb1                                       
    
65. ora.evmd
    
66.       1        ONLINE  OFFLINE                                                   
    
67. ora.gipcd
    
68.       1        ONLINE  UNKNOWN      racdb1                                       
    
69. ora.gpnpd
    
70.       1        ONLINE  UNKNOWN      racdb1                                       
    
71. ora.mdnsd
    
72.       1        ONLINE  UNKNOWN      racdb1   
    
73. [root@racdb1 bin]# ps -ef | grep pmon
    
74. root     10337 10258  0 17:02 pts/10   00:00:00 grep pmon
    
75. [root@racdb1 bin]#
    
76. [root@racdb1 bin]#su - grid
    
77. -bash-3.2$ asmcmd
    
78. Connected to an idle instance.
    
79. ASMCMD> startup
    
80. ORA-01078: failure in processing system parameters
    
81. ORA-29701: unable to connect to Cluster Synchronization Service
    
82. Connected to an idle instance.
    
83. ASMCMD>
    
84.       
    

复制代码

y331044508

问题找到了，是因为crs访问不到而导致ASM启动不起来，找了几天也没有找到解决的办法，最后实在无奈重新创建了crs就OK了。
在两个节点上删除之前的crs配置信息，
/u01/app/11.2.0/grid/crs/install
[root@racdb2 install]# ./rootcrs.pl -verbose -deconfig -force
然后重新运行root.sh脚本创建crs即可
/u01/app/11.2.0/grid
[root@racdb2 install]# ./root.sh

zhenjiang412518

你好，我今天遇到跟你一模一样的问题，也解决了，请见下面链接
http://blog.csdn.net/chunhua_love/article/details/24727639

原因跟你的应该一样，你说是因为crs访问不到而导致ASM启动不起来，这个我不是很明白呢，能再具体说说么？谢谢！