- 论坛徽章:
- 0
|
log.rar
(988.82 KB, 下载次数: 20)
oracle11g rac总是会自动关闭，帮帮忙啊！
环境是两台HP3600+eva4400，装的是hpux11.31+oracle11g+mscg+rac，内存原来4个G,后来又加了4个G，oracle sga设置了1G，swap设置8G，现在的情况是几乎没隔段时间oracle进程就自动没了，加了内存后变的更加频繁了，必须要自己手动crsctl起，分析了日志，报了好多的错误，也不知是哪些错误引起的，请各位高手帮忙看看啊。如果解决了，我一定把问题好好的总结然后发上来。。。
下面是alert一些日志的摘录，
Wed Mar 10 07:09:36 2010
Process startup failed, error stack:
Errors in file /on3000/app/oracle/diag/rdbms/on3000/on30001/trace/on30001_psp0_8633.trc:
ORA-27300: OS system dependent operation:fork failed with status: 12
ORA-27301: OS failure message: Not enough space
ORA-27302: failure occurred at: skgpspawn3
Wed Mar 10 07:09:37 2010
Process m004 died, see its trace file
Wed Mar 10 07:29:38 2010
Process startup failed, error stack:
Errors in file /on3000/app/oracle/diag/rdbms/on3000/on30001/trace/on30001_psp0_8633.trc:
ORA-27300: OS system dependent operation:fork failed with status: 12
ORA-27301: OS failure message: Not enough space
ORA-27302: failure occurred at: skgpspawn3
Wed Mar 10 07:29:39 2010
Process m004 died, see its trace file
Wed Mar 10 07:30:01 2010
Process startup failed, error stack:
Errors in file /on3000/app/oracle/diag/rdbms/on3000/on30001/trace/on30001_psp0_8633.trc:
ORA-27300: OS system dependent operation:fork failed with status: 12
ORA-27301: OS failure message: Not enough space
ORA-27302: failure occurred at: skgpspawn3
Wed Mar 10 07:30:02 2010
Process J000 died, see its trace file
kkjcre1p: unable to spawn jobq slave process
Errors in file /on3000/app/oracle/diag/rdbms/on3000/on30001/trace/on30001_cjq0_8843.trc:
Process startup failed, error stack:
Errors in file /on3000/app/oracle/diag/rdbms/on3000/on30001/trace/on30001_psp0_8633.trc:
ORA-27300: OS system dependent operation:fork failed with status: 12
ORA-27301: OS failure message: Not enough space
ORA-27302: failure occurred at: skgpspawn3
Process J000 died, see its trace file
kkjcre1p: unable to spawn jobq slave process
Errors in file /on3000/app/oracle/diag/rdbms/on3000/on30001/trace/on30001_cjq0_8843.trc:
Sat Apr 10 05:00:00 2010
Setting Resource Manager plan DEFAULT_MAINTENANCE_PLAN via parameter
Sat Apr 10 05:00:01 2010
Sat Apr 10 05:00:01 2010
Logminer Bld: Lockdown Complete. DB_TXN_SCN is UnwindToSCN (LockdownSCN) is 58233090
Sat Apr 10 10:08:28 2010
Errors in file /on3000/app/oracle/diag/rdbms/on3000/on30001/trace/on30001_m000_2750.trc:
ORA-04035: unable to allocate 4096 bytes of shared memory in shared object cache "JOXSHM" of size "52428800"
Sat Apr 10 10:09:11 2010
Errors in file /on3000/app/oracle/diag/rdbms/on3000/on30001/trace/on30001_m000_3168.trc:
ORA-04035: unable to allocate 4096 bytes of shared memory in shared object cache "JOXSHM" of size "52428800"
Sat Apr 10 10:09:21 2010
Errors in file /on3000/app/oracle/diag/rdbms/on3000/on30001/trace/on30001_m001_3308.trc:
ORA-04035: unable to allocate 4096 bytes of shared memory in shared object cache "JOXSHM" of size "52428800"
Sat Apr 10 10:28:21 2010
Errors in file /on3000/app/oracle/diag/rdbms/on3000/on30001/trace/on30001_m001_12660.trc:
ORA-04035: unable to allocate 4096 bytes of shared memory in shared object cache "JOXSHM" of size "52428800"
Sat Apr 10 10:31:30 2010
Errors in file /on3000/app/oracle/diag/rdbms/on3000/on30001/trace/on30001_m001_14241.trc:
ORA-04035: unable to allocate 4096 bytes of shared memory in shared object cache "JOXSHM" of size "52428800"
Sat Apr 10 10:31:33 2010
Errors in file /on3000/app/oracle/diag/rdbms/on3000/on30001/trace/on30001_m000_14270.trc:
ORA-04035: unable to allocate 4096 bytes of shared memory in shared object cache "JOXSHM" of size "52428800"
Sun Apr 11 05:59:55 2010
Exception [type: unknown signal, unknown code] [ADDR:0x0] [PC:0xC0000000001C8490, __lwp_kill()+48] [exception issued by pid: 0, uid: 0]
Errors in file /on3000/app/oracle/diag/rdbms/on3000/on30001/trace/on30001_dia0_6162.trc (incident=84085):
ORA-07445: exception encountered: core dump [__lwp_kill()+48] [unknown signal] [ADDR:0x0] [PC:0xC0000000001C8490] [unknown code] []
Incident details in: /on3000/app/oracle/diag/rdbms/on3000/on30001/incident/incdir_84085/on30001_dia0_6162_i84085.trc
Sun Apr 11 05:59:58 2010
Trace dumping is performing id=[cdmp_20100411055958]
Sun Apr 11 06:00:39 2010
Restarting dead background process DIA0
Sun Apr 11 06:00:39 2010
DIA0 started with pid=10, OS id=14763
Sun Apr 11 06:00:40 2010
Sweep Incident[84085]: completed
Sun Apr 11 08:32:04 2010
Process startup failed, error stack:
Errors in file /on3000/app/oracle/diag/rdbms/on3000/on30001/trace/on30001_psp0_6156.trc:
ORA-27300: OS system dependent operation:fork failed with status: 12
ORA-27301: OS failure message: Not enough space
ORA-27302: failure occurred at: skgpspawn3
Sun Apr 11 08:32:05 2010
Process m000 died, see its trace file
Sun Apr 11 08:34:04 2010
Process startup failed, error stack:
Errors in file /on3000/app/oracle/diag/rdbms/on3000/on30001/trace/on30001_psp0_6156.trc:
crsd.log日志的摘录，好多下面的错误
2010-04-15 03:32:45.073: [ CRSEVT][24658] CAAMonitorHandler :: 0:Action Script /on3000/app/oracle/11.1/db_1/bin/racgwrap(check) timed out for ora.ys01.LISTENER_YS01.lsnr! (timeout=600)
2010-04-15 03:32:45.073: [ CRSAPP][24658] CheckResource error for ora.ys01.LISTENER_YS01.lsnr error code = -2
2010-04-15 03:50:19.694: [ CRSEVT][24661] CAAMonitorHandler :: 0:Could not join /on3000/app/oracle/11.1/crs/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2010-04-15 03:50:19.695: [ CRSEVT][24661] CAAMonitorHandler :: 0:Action Script /on3000/app/oracle/11.1/crs/bin/racgwrap(check) timed out for ora.ys01.gsd! (timeout=600)
2010-04-15 03:50:19.695: [ CRSAPP][24661] CheckResource error for ora.ys01.gsd error code = -2
2010-04-15 03:53:15.113: [ CRSEVT][24662] CAAMonitorHandler :: 0:Could not join /on3000/app/oracle/11.1/db_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2010-04-15 03:53:15.113: [ CRSEVT][24662] CAAMonitorHandler :: 0:Action Script /on3000/app/oracle/11.1/db_1/bin/racgwrap(check) timed out for ora.ys01.LISTENER_YS01.lsnr! (timeout=600)
2010-04-15 03:53:15.114: [ CRSAPP][24662] CheckResource error for ora.ys01.LISTENER_YS01.lsnr error code = -2
2010-04-15 04:10:49.733: [ CRSEVT][24665] CAAMonitorHandler :: 0:Could not join /on3000/app/oracle/11.1/crs/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2010-04-15 04:10:49.734: [ CRSEVT][24665] CAAMonitorHandler :: 0:Action Script /on3000/app/oracle/11.1/crs/bin/racgwrap(check) timed out for ora.ys01.gsd! (timeout=600)
2010-04-15 04:10:49.734: [ CRSAPP][24665] CheckResource error for ora.ys01.gsd error code = -2
2010-04-15 04:13:45.170: [ CRSEVT][24666] CAAMonitorHandler :: 0:Could not join /on3000/app/oracle/11.1/db_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2010-04-15 04:13:45.170: [ CRSEVT][24666] CAAMonitorHandler :: 0:Action Script /on3000/app/oracle/11.1/db_1/bin/racgwrap(check) timed out for ora.ys01.LISTENER_YS01.lsnr! (timeout=600)
2010-04-15 04:13:45.170: [ CRSAPP][24666] CheckResource error for ora.ys01.LISTENER_YS01.lsnr error code = -2
2010-04-15 04:31:19.783: [ CRSEVT][24669] CAAMonitorHandler :: 0:Could not join /on3000/app/oracle/11.1/crs/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2010-04-15 04:31:19.784: [ CRSEVT][24669] CAAMonitorHandler :: 0:Action Script /on3000/app/oracle/11.1/crs/bin/racgwrap(check) timed out for ora.ys01.gsd! (timeout=600)
2010-04-15 04:31:19.784: [ CRSAPP][24669] CheckResource error for ora.ys01.gsd error code = -2
2010-04-15 04:34:15.214: [ CRSEVT][24670] CAAMonitorHandler :: 0:Could not join /on3000/app/oracle/11.1/db_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2010-04-15 04:34:15.214: [ CRSEVT][24670] CAAMonitorHandler :: 0:Action Script /on3000/app/oracle/11.1/db_1/bin/racgwrap(check) timed out for ora.ys01.LISTENER_YS01.lsnr! (timeout=600)
2010-04-15 04:34:15.215: [ CRSAPP][24670] CheckResource error for ora.ys01.LISTENER_YS01.lsnr error code = -2
2010-04-15 04:51:49.855: [ CRSEVT][24673] CAAMonitorHandler :: 0:Could not join /on3000/app/oracle/11.1/crs/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2010-04-15 04:51:49.856: [ CRSEVT][24673] CAAMonitorHandler :: 0:Action Script /on3000/app/oracle/11.1/crs/bin/racgwrap(check) timed out for ora.ys01.gsd! (timeout=600)
2010-04-15 04:51:49.856: [ CRSAPP][24673] CheckResource error for ora.ys01.gsd error code = -2
2010-04-15 04:54:45.254: [ CRSEVT][24674] CAAMonitorHandler :: 0:Could not join /on3000/app/oracle/11.1/db_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2010-04-15 04:54:45.254: [ CRSEVT][24674] CAAMonitorHandler :: 0:Action Script /on3000/app/oracle/11.1/db_1/bin/racgwrap(check) timed out for ora.ys01.LISTENER_YS01.lsnr! (timeout=600)
2010-04-15 04:54:45.254: [ CRSAPP][24674] CheckResource error for ora.ys01.LISTENER_YS01.lsnr error code = -2
2010-04-15 05:12:19.904: [ CRSEVT][24677] CAAMonitorHandler :: 0:Could not join /on3000/app/oracle/11.1/crs/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2010-04-15 05:12:19.904: [ CRSEVT][24677] CAAMonitorHandler :: 0:Action Script /on3000/app/oracle/11.1/crs/bin/racgwrap(check) timed out for ora.ys01.gsd! (timeout=600)
2010-04-15 05:12:19.905: [ CRSAPP][24677] CheckResource error for ora.ys01.gsd error code = -2
2010-04-15 05:15:15.313: [ CRSEVT][24678] CAAMonitorHandler :: 0:Could not join /on3000/app/oracle/11.1/db_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2010-04-15 05:15:15.313: [ CRSEVT][24678] CAAMonitorHandler :: 0:Action Script /on3000/app/oracle/11.1/db_1/bin/racgwrap(check) timed out for ora.ys01.LISTENER_YS01.lsnr! (timeout=600)
2010-04-15 05:15:15.314: [ CRSAPP][24678] CheckResource error for ora.ys01.LISTENER_YS01.lsnr error code = -2
2010-04-15 05:32:49.953: [ CRSEVT][24681] CAAMonitorHandler :: 0:Could not join /on3000/app/oracle/11.1/crs/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2010-04-15 05:32:49.954: [ CRSEVT][24681] CAAMonitorHandler :: 0:Action Script /on3000/app/oracle/11.1/crs/bin/racgwrap(check) timed out for ora.ys01.gsd! (timeout=600)
2010-04-15 05:32:49.954: [ CRSAPP][24681] CheckResource error for ora.ys01.gsd error code = -2
2010-04-15 05:35:45.363: [ CRSEVT][24682] CAAMonitorHandler :: 0:Could not join /on3000/app/oracle/11.1/db_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2010-04-15 05:35:45.363: [ CRSEVT][24682] CAAMonitorHandler :: 0:Action Script /on3000/app/oracle/11.1/db_1/bin/racgwrap(check) timed out for ora.ys01.LISTENER_YS01.lsnr! (timeout=600)
2010-04-15 05:35:45.363: [ CRSAPP][24682] CheckResource error for ora.ys01.LISTENER_YS01.lsnr error code = -2
2010-04-15 05:53:19.993: [ CRSEVT][24685] CAAMonitorHandler :: 0:Could not join /on3000/app/oracle/11.1/crs/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2010-04-15 05:53:19.994: [ CRSEVT][24685] CAAMonitorHandler :: 0:Action Script /on3000/app/oracle/11.1/crs/bin/racgwrap(check) timed out for ora.ys01.gsd! (timeout=600)
2010-04-15 05:53:19.994: [ CRSAPP][24685] CheckResource error for ora.ys01.gsd error code = -2
2010-04-15 05:56:15.413: [ CRSEVT][24686] CAAMonitorHandler :: 0:Could not join /on3000/app/oracle/11.1/db_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2010-04-15 05:56:15.413: [ CRSEVT][24686] CAAMonitorHandler :: 0:Action Script /on3000/app/oracle/11.1/db_1/bin/racgwrap(check) timed out for ora.ys01.LISTENER_YS01.lsnr! (timeout=600)
2010-04-15 05:56:15.413: [ CRSAPP][24686] CheckResource error for ora.ys01.LISTENER_YS01.lsnr error code = -2
2010-04-15 06:13:50.043: [ CRSEVT][24689] CAAMonitorHandler :: 0:Could not join /on3000/app/oracle/11.1/crs/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2010-04-15 06:13:50.044: [ CRSEVT][24689] CAAMonitorHandler :: 0:Action Script /on3000/app/oracle/11.1/crs/bin/racgwrap(check) timed out for ora.ys01.gsd! (timeout=600)
2010-04-15 06:13:50.044: [ CRSAPP][24689] CheckResource error for ora.ys01.gsd error code = -2
2010-04-15 06:16:45.464: [ CRSEVT][24690] CAAMonitorHandler :: 0:Could not join /on3000/app/oracle/11.1/db_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2010-04-15 06:16:45.464: [ CRSEVT][24690] CAAMonitorHandler :: 0:Action Script /on3000/app/oracle/11.1/db_1/bin/racgwrap(check) timed out for ora.ys01.LISTENER_YS01.lsnr! (timeout=600)
2010-04-15 06:16:45.465: [ CRSAPP][24690] CheckResource error for ora.ys01.LISTENER_YS01.lsnr error code = -2
2010-04-15 06:34:20.103: [ CRSEVT][24693] CAAMonitorHandler :: 0:Could not join /on3000/app/oracle/11.1/crs/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2010-04-15 06:34:20.104: [ CRSEVT][24693] CAAMonitorHandler :: 0:Action Script /on3000/app/oracle/11.1/crs/bin/racgwrap(check) timed out for ora.ys01.gsd! (timeout=600)
2010-04-15 06:34:20.104: [ CRSAPP][24693] CheckResource error for ora.ys01.gsd error code = -2
2010-04-15 06:37:15.503: [ CRSEVT][24694] CAAMonitorHandler :: 0:Could not join /on3000/app/oracle/11.1/db_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2010-04-15 06:37:15.503: [ CRSEVT][24694] CAAMonitorHandler :: 0:Action Script /on3000/app/oracle/11.1/db_1/bin/racgwrap(check) timed out for ora.ys01.LISTENER_YS01.lsnr! (timeout=600)
2010-04-15 06:37:15.503: [ CRSAPP][24694] CheckResource error for ora.ys01.LISTENER_YS01.lsnr error code = -2
2010-04-15 06:44:20.126: [ CRSEVT][24697] CAAMonitorHandler :: 0:Could not execute /on3000/app/oracle/11.1/crs/bin/racgwrap(check) for ora.ys01.gsd
category: 1234, operation: scls_process_spawn, loc: read_pipe, OS error: 12, other: EOF on read pipe
2010-04-15 06:44:20.127: [ CRSAPP][24697] CheckResource error for ora.ys01.gsd error code = -1
2010-04-15 06:47:15.527: [ CRSEVT][24698] CAAMonitorHandler :: 0:Could not execute /on3000/app/oracle/11.1/db_1/bin/racgwrap(check) for ora.ys01.LISTENER_YS01.lsnr
category: 1234, operation: scls_process_spawn, loc: read_pipe, OS error: 12, other: EOF on read pipe
2010-04-15 06:47:15.527: [ CRSAPP][24698] CheckResource error for ora.ys01.LISTENER_YS01.lsnr error code = -1
2010-04-15 07:04:50.173: [ CRSEVT][24699] CAAMonitorHandler :: 0:Could not join /on3000/app/oracle/11.1/crs/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2010-04-15 07:04:50.174: [ CRSEVT][24699] CAAMonitorHandler :: 0:Action Script /on3000/app/oracle/11.1/crs/bin/racgwrap(check) timed out for ora.ys01.gsd! (timeout=600)
2010-04-15 07:04:50.174: [ CRSAPP][24699] CheckResource error for ora.ys01.gsd error code = -2
2010-04-15 07:07:45.574: [ CRSEVT][24700] CAAMonitorHandler :: 0:Could not join /on3000/app/oracle/11.1/db_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2010-04-15 07:07:45.574: [ CRSEVT][24700] CAAMonitorHandler :: 0:Action Script /on3000/app/oracle/11.1/db_1/bin/racgwrap(check) timed out for ora.ys01.LISTENER_YS01.lsnr! (timeout=600)
2010-04-15 07:07:45.574: [ CRSAPP][24700] CheckResource error for ora.ys01.LISTENER_YS01.lsnr error code = -2
2010-04-15 07:17:45.598: [ CRSEVT][24704] CAAMonitorHandler :: 0:Could not execute /on3000/app/oracle/11.1/db_1/bin/racgwrap(check) for ora.ys01.LISTENER_YS01.lsnr
category: 1234, operation: scls_process_spawn, loc: read_pipe, OS error: 12, other: EOF on read pipe
2010-04-15 07:17:45.598: [ CRSAPP][24704] CheckResource error for ora.ys01.LISTENER_YS01.lsnr error code = -1
2010-04-15 07:25:20.224: [ CRSEVT][24703] CAAMonitorHandler :: 0:Could not join /on3000/app/oracle/11.1/crs/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2010-04-15 07:25:20.225: [ CRSEVT][24703] CAAMonitorHandler :: 0:Action Script /on3000/app/oracle/11.1/crs/bin/racgwrap(check) timed out for ora.ys01.gsd! (timeout=600)
2010-04-15 07:25:20.225: [ CRSAPP][24703] CheckResource error for ora.ys01.gsd error code = -2
2010-04-15 07:27:45.624: [ CRSEVT][24706] CAAMonitorHandler :: 0:Could not execute /on3000/app/oracle/11.1/db_1/bin/racgwrap(check) for ora.ys01.LISTENER_YS01.lsnr
category: 1234, operation: scls_process_spawn, loc: read_pipe, OS error: 12, other: EOF on read pipe
2010-04-15 07:27:45.624: [ CRSAPP][24706] CheckResource error for ora.ys01.LISTENER_YS01.lsnr error code = -1
2010-04-15 07:35:20.250: [ CRSEVT][24707] CAAMonitorHandler :: 0:Could not execute /on3000/app/oracle/11.1/crs/bin/racgwrap(check) for ora.ys01.gsd
category: 1234, operation: scls_process_spawn, loc: read_pipe, OS error: 12, other: EOF on read pipe
2010-04-15 07:35:20.251: [ CRSAPP][24707] CheckResource error for ora.ys01.gsd error code = -1
2010-04-15 07:37:45.640: [ CRSEVT][24708] CAAMonitorHandler :: 0:Could not execute /on3000/app/oracle/11.1/db_1/bin/racgwrap(check) for ora.ys01.LISTENER_YS01.lsnr
category: 1234, operation: scls_process_spawn, loc: read_pipe, OS error: 12, other: EOF on read pipe
2010-04-15 07:37:45.640: [ CRSAPP][24708] CheckResource error for ora.ys01.LISTENER_YS01.lsnr error code = -1
是不是和内存有关系啊，帮忙看看吧。。谢谢了！ |
|
免费注册
发表于 2010-04-17 21:22
