[求救]Oracle11g在shtudown immediate;时报ORA-00600 错 , 主要原因是:MMNL is not a

BigBreado

求大神帮帮忙，关闭数据库的时候报600错，这个错始终解决不了无法下手啊！！好像主要原因是ORA-00072 MMNL is not active
这个MMNL 如何拯救啊？求大神的灵指 指点指点我啊！

----------双手奉上   alert_testerror.log 日志


Thu Oct 22 15:55:18 2015
Shutting down instance (immediate)
Stopping background process SMCO
Shutting down instance: further logons disabled
Thu Oct 22 15:55:20 2015
Stopping background process CJQ0
Stopping background process QMNC
Stopping background process MMNL
Thu Oct 22 15:55:33 2015
Background process MMNL not dead after 10 seconds
Killing background process MMNL
Thu Oct 22 16:00:35 2015
Errors in file /home/oracle/app/oracle/diag/rdbms/test_error/testerror/trace/testerror_ora_11954.trc  (incident=9817):
ORA-00600: internal error code, arguments: [ksb_shut_detached_process3], [MMNL], [10], [300], [], [], [], [], [], [], [], []
Incident details in: /home/oracle/app/oracle/diag/rdbms/test_error/testerror/incident/incdir_9817/testerror_ora_11954_i9817.trc
Use ADRCI or Support Workbench to package the incident.
See Note 411.1 at My Oracle Support for error and packaging details.
Thu Oct 22 16:00:41 2015
Dumping diagnostic data in directory=[cdmp_20151022160041], requested by (instance=1, osid=11954), summary=[incident=9817].
Thu Oct 22 16:01:32 2015
PMON (ospid: 11553): terminating the instance due to error 471
Thu Oct 22 16:01:33 2015
System state dump requested by (instance=1, osid=11553 (PMON)), summary=[abnormal instance termination].
System State dumped to trace file /home/oracle/app/oracle/diag/rdbms/test_error/testerror/trace/testerror_diag_11565.trc
Dumping diagnostic data in directory=[cdmp_20151022160133], requested by (instance=1, osid=11553 (PMON)), summary=[abnormal instance termination].
Instance terminated by PMON, pid = 11553


-----------鞠躬奉上 testerror_ora_11954.trc 系统的跟踪文件


Trace file /home/oracle/app/oracle/diag/rdbms/test_error/testerror/trace/testerror_ora_11954.trc
Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options
ORACLE_HOME = /home/oracle/app/oracle/product/11.2.0/dbhome_1
System name:        Linux
Node name:        localhost.localdomain
Release:        2.6.32-220.el6.x86_64
Version:        #1 SMP Wed Nov 9 08:03:13 EST 2011
Machine:        x86_64
VM name:        VMWare Version: 6
Instance name: testerror
Redo thread mounted by this instance: 1
Oracle process number: 27
Unix process pid: 11954, image: oracle@localhost.localdomain (TNS V1-V3)


*** 2015-10-22 15:55:19.039
*** SESSION ID356.5567) 2015-10-22 15:55:19.039
*** CLIENT ID) 2015-10-22 15:55:19.039
*** SERVICE NAMESYS$USERS) 2015-10-22 15:55:19.039
*** MODULE NAMEsqlplus@localhost.localdomain (TNS V1-V3)) 2015-10-22 15:55:19.039
*** ACTION NAME) 2015-10-22 15:55:19.039

Stopping background process SMCO

*** 2015-10-22 15:55:20.545
Stopping background process QMNC

*** 2015-10-22 15:55:23.563
Stopping background process MMNL

*** 2015-10-22 15:55:33.602
Process diagnostic dump for oracle@localhost.localdomain (MMNL), OS id=11585,
pid: 16, proc_ser: 1, sid: <no session>
-------------------------------------------------------------------------------
os thread scheduling delay history: (sampling every 1.000000 secs)
  0.000000 secs at [ 15:55:32 ]
    NOTE: scheduling delay has not been sampled for 0.668146 secs  0.000000 secs from [ 15:55:28 - 15:55:33 ], 5 sec avg
  0.000000 secs from [ 15:54:33 - 15:55:33 ], 1 min avg
  0.000000 secs from [ 15:50:34 - 15:55:33 ], 5 min avg
loadavg : 2.73 2.38 2.51
Memory (Avail / Total) = 479.02M / 90820.88M
Swap (Avail / Total) = 27698.42M /  63999.99M
F S UID        PID  PPID  C PRI  NI ADDR SZ WCHAN  STIME TTY          TIME CMD
0 D oracle   11585     1  0  80   0 - 244767 sync_p Apr29 ?       01:51:39 ora_mmnl_testerror
Short stack dump: ORA-00072: process "Unix process pid: 11585, image: oracle@localhost.localdomain (MMNL)" is not active

Skipping session state dump because target process has no session.
-------------------------------------------------------------------------------
Process diagnostic dump actual duration=0.280000 sec
  (max dump time=30.000000 sec)

*** 2015-10-22 15:55:33.887

*** 2015-10-22 15:55:33.887
Background process MMNL not dead after 10 seconds

*** 2015-10-22 15:55:33.888
Killing background process MMNL

*** 2015-10-22 15:58:04.059
Waited 150 secs for detached process MMNL to exit. Dumping diagnostics:


*** 2015-10-22 15:58:04.059
Process diagnostic dump for oracle@localhost.localdomain (MMNL), OS id=11585,
pid: 16, proc_ser: 1, sid: <no session>
-------------------------------------------------------------------------------
os thread scheduling delay history: (sampling every 1.000000 secs)
  0.000000 secs at [ 15:58:03 ]
    NOTE: scheduling delay has not been sampled for 0.344692 secs  0.000000 secs from [ 15:57:59 - 15:58:04 ], 5 sec avg
  0.000000 secs from [ 15:57:04 - 15:58:04 ], 1 min avg
  0.000000 secs from [ 15:53:04 - 15:58:04 ], 5 min avg

*** 2015-10-22 15:58:05.834
loadavg : 5.09 3.58 2.94
Memory (Avail / Total) = 496.38M / 90820.88M
Swap (Avail / Total) = 28392.10M /  63999.99M
F S UID        PID  PPID  C PRI  NI ADDR SZ WCHAN  STIME TTY          TIME CMD
0 R oracle   11585     1  0  80   0 -     0 ?      Apr29 ?        01:54:11 [oracle]
Short stack dump: ORA-00072: process "Unix process pid: 11585, image: oracle@localhost.localdomain (MMNL)" is not active

-------------------------------------------------------------------------------
Process diagnostic dump actual duration=1.770000 sec
  (max dump time=30.000000 sec)

*** 2015-10-22 15:58:05.835

*** 2015-10-22 15:58:41.872
Waited 187 secs for detached process MMNL to exit. Dumping diagnostics:


*** 2015-10-22 15:58:41.872
Process diagnostic dump for oracle@localhost.localdomain (MMNL), OS id=11585,
pid: 16, proc_ser: 1, sid: <no session>
-------------------------------------------------------------------------------
os thread scheduling delay history: (sampling every 1.000000 secs)
  0.000000 secs at [ 15:58:40 ]
    NOTE: scheduling delay has not been sampled for 0.952603 secs  0.000000 secs from [ 15:58:36 - 15:58:41 ], 5 sec avg
  0.000000 secs from [ 15:57:42 - 15:58:41 ], 1 min avg
  0.000000 secs from [ 15:53:42 - 15:58:41 ], 5 min avg

*** 2015-10-22 15:58:43.788
loadavg : 7.06 4.24 3.18
Memory (Avail / Total) = 527.36M / 90820.88M
Swap (Avail / Total) = 28392.79M /  63999.99M
F S UID        PID  PPID  C PRI  NI ADDR SZ WCHAN  STIME TTY          TIME CMD
0 R oracle   11585     1  0  80   0 -     0 ?      Apr29 ?        01:54:49 [oracle]
Short stack dump: ORA-00072: process "Unix process pid: 11585, image: oracle@localhost.localdomain (MMNL)" is not active

-------------------------------------------------------------------------------
Process diagnostic dump actual duration=1.910000 sec
  (max dump time=30.000000 sec)

*** 2015-10-22 15:58:43.789

*** 2015-10-22 15:59:19.835
Waited 225 secs for detached process MMNL to exit. Dumping diagnostics:


*** 2015-10-22 15:59:19.835
Process diagnostic dump for oracle@localhost.localdomain (MMNL), OS id=11585,
pid: 16, proc_ser: 1, sid: <no session>
-------------------------------------------------------------------------------
os thread scheduling delay history: (sampling every 1.000000 secs)
  0.000000 secs at [ 15:59:19 ]
    NOTE: scheduling delay has not been sampled for 0.672333 secs  0.000000 secs from [ 15:59:15 - 15:59:20 ], 5 sec avg
  0.000000 secs from [ 15:58:20 - 15:59:20 ], 1 min avg
  0.000000 secs from [ 15:54:20 - 15:59:20 ], 5 min avg
loadavg : 7.23 4.68 3.38
Memory (Avail / Total) = 456.62M / 90820.88M
Swap (Avail / Total) = 28392.85M /  63999.99M
F S UID        PID  PPID  C PRI  NI ADDR SZ WCHAN  STIME TTY          TIME CMD
0 R oracle   11585     1  0  80   0 -     0 ?      Apr29 ?        01:55:25 [oracle]
Short stack dump: ORA-00072: process "Unix process pid: 11585, image: oracle@localhost.localdomain (MMNL)" is not active

-------------------------------------------------------------------------------
Process diagnostic dump actual duration=0.200000 sec
  (max dump time=30.000000 sec)

*** 2015-10-22 15:59:20.029

*** 2015-10-22 15:59:58.073
Waited 264 secs for detached process MMNL to exit. Dumping diagnostics:


*** 2015-10-22 15:59:58.073
Process diagnostic dump for oracle@localhost.localdomain (MMNL), OS id=11585,
pid: 16, proc_ser: 1, sid: <no session>
-------------------------------------------------------------------------------
os thread scheduling delay history: (sampling every 1.000000 secs)
  0.000000 secs at [ 15:59:57 ]
    NOTE: scheduling delay has not been sampled for 0.709209 secs  0.000000 secs from [ 15:59:53 - 15:59:58 ], 5 sec avg
  0.000000 secs from [ 15:58:59 - 15:59:58 ], 1 min avg
  0.000000 secs from [ 15:54:58 - 15:59:58 ], 5 min avg

*** 2015-10-22 16:00:00.034
loadavg : 7.36 4.95 3.51
Memory (Avail / Total) = 447.87M / 90820.88M
Swap (Avail / Total) = 28392.91M /  63999.99M
F S UID        PID  PPID  C PRI  NI ADDR SZ WCHAN  STIME TTY          TIME CMD
0 R oracle   11585     1  0  80   0 -     0 ?      Apr29 ?        01:56:05 [oracle]
Short stack dump: ORA-00072: process "Unix process pid: 11585, image: oracle@localhost.localdomain (MMNL)" is not active

-------------------------------------------------------------------------------
Process diagnostic dump actual duration=1.960000 sec
  (max dump time=30.000000 sec)

*** 2015-10-22 16:00:00.034

*** 2015-10-22 16:00:35.442
Incident 9817 created, dump file: /home/oracle/app/oracle/diag/rdbms/test_error/testerror/incident/incdir_9817/testerror_ora_11954_i9817.trc
ORA-00600: internal error code, arguments: [ksb_shut_detached_process3], [MMNL], [10], [300], [], [], [], [], [], [], [], []

ORA-00072: process "Unix process pid: 11585, image: oracle@localhost.localdomain (MMNL)" is not active

-------------------------------------------------------------------------------
Process diagnostic dump actual duration=5.120000 sec
  (max dump time=30.000000 sec)

*** 2015-10-22 16:00:40.584

Internal debug info:
  dtp pid: 11585
  pso of dtp pid: 11585

BigBreado

小妹 在线等

zhofly

MOS上提供的解决方法是在操作系统级别kill 掉LOCAL=NO的进程，因为这些进程不能被PMON进程清理导致shutdown 过程hang住

BigBreado

每次600后都有一个 占COU 100%的进程，如下。   kill也杀不掉父进程也不知道在哪，过一天自己就没了但小妹我等不了啊，这个服务器有30多个实例强制shutdown 4个实例系统就慢的要死。卡的都心碎了

oracle    11585     1  0 Jun03 ?        02:41:54 [oracle]

BigBreado

找不到啊 回复 3# zhofly


   

flutter

怎么会找不到呢，ps -aef | grep oracle 看不到 ？

这个服务器有30多个实例。。。。你这是啥服务器？啥数据库环境啊？

有这种部署法吗？？

BigBreado

  ps -aef | grep oracle 找到也是这个
oracle    11585     1  0 Jun03 ?        02:41:54 [oracle]

kill 不掉啊，这个进程好烦怎么办@flutter