莫名宕机,各位大大帮忙分析一下

SeanSu

莫名宕机,各位大大帮忙分析一下\r\n\r\n\r\n环境OS5.3,HA5.4,ora10g rac,tsm5.3,今天莫名其妙地宕机,下面是errpt的内容,宕机的时候TSM在做备份,怀疑是否TSM引起的\r\n\r\nIDENTIFIER TIMESTAMP  T C RESOURCE_NAME  DESCRIPTION\r\nAA8AB241   0827092707 T O clstrmgrES     OPERATOR NOTIFICATION\r\nAFA89905   0827092707 I O grpsvcs        Group Services daemon started\r\n97419D60   0827092707 I O topsvcs        Topology Services daemon started\r\nA6DF45AA   0827092307 I O RMCdaemon      The daemon is started.\r\n7F88E76D   0827092307 P S console        SOFTWARE PROGRAM ERROR\r\n7F88E76D   0827092307 P S console        SOFTWARE PROGRAM ERROR\r\n67145A39   0827092207 U S SYSDUMP        SYSTEM DUMP\r\nF48137AC   0827092107 U O minidump       COMPRESSED MINIMAL DUMP\r\n9D035E4D   0827091607 P S SYSVMM         DATA STORAGE INTERRUPT, PROCESSOR\r\n9DBCFDEE   0827092307 T O errdemon       ERROR LOGGING TURNED ON\r\n\r\n/usr/tivoli/tsm/client/backshell# errpt -aj 9DBCFDEE \r\n---------------------------------------------------------------------------\r\nLABEL:          ERRLOG_ON\r\nIDENTIFIER:     9DBCFDEE\r\n\r\nDate/Time:       Mon Aug 27 09:23:08 BEIST 2007\r\nSequence Number: 1179\r\nMachine Id:      00C6DA2D4C00\r\nNode Id:         localhost\r\nClass:           O\r\nType:            TEMP\r\nResource Name:   errdemon        \r\n\r\nDescription\r\nERROR LOGGING TURNED ON\r\n\r\nProbable Causes\r\nERRDEMON STARTED AUTOMATICALLY\r\n\r\nUser Causes\r\n/USR/LIB/ERRDEMON COMMAND\r\n\r\n        Recommended Actions\r\n        NONE\r\n\r\n---------------------------------------------------------------------------\r\nLABEL:          ERRLOG_ON\r\nIDENTIFIER:     9DBCFDEE\r\n\r\nDate/Time:       Sun Aug 26 01:14:05 BEIST 2007\r\nSequence Number: 1168\r\nMachine Id:      00C6DA2D4C00\r\nNode Id:         localhost\r\nClass:           O\r\nType:            TEMP\r\nResource Name:   errdemon        \r\n\r\nDescription\r\nERROR LOGGING TURNED ON\r\n\r\nProbable Causes\r\nERRDEMON STARTED AUTOMATICALLY\r\n\r\nUser Causes\r\n/USR/LIB/ERRDEMON COMMAND\r\n\r\n        Recommended Actions\r\n        NONE\r\n\r\n---------------------------------------------------------------------------\r\nLABEL:          ERRLOG_ON\r\nIDENTIFIER:     9DBCFDEE\r\n\r\nDate/Time:       Mon Aug  6 09:16:04 BEIST 2007\r\nSequence Number: 1161\r\nMachine Id:      00C6DA2D4C00\r\nNode Id:         localhost\r\nClass:           O\r\nType:            TEMP\r\nResource Name:   errdemon        \r\n\r\nDescription\r\nERROR LOGGING TURNED ON\r\n\r\nProbable Causes\r\nERRDEMON STARTED AUTOMATICALLY\r\n\r\nUser Causes\r\n/USR/LIB/ERRDEMON COMMAND\r\n\r\n        Recommended Actions\r\n        NONE\r\n\r\n/usr/tivoli/tsm/client/backshell# errpt -aj 9D035E4D \r\n---------------------------------------------------------------------------\r\nLABEL:          DSI_PROC\r\nIDENTIFIER:     9D035E4D\r\n\r\nDate/Time:       Mon Aug 27 09:16:48 BEIST 2007\r\nSequence Number: 1180\r\nMachine Id:      00C6DA2D4C00\r\nNode Id:         localhost\r\nClass:           S\r\nType:            PERM\r\nResource Name:   SYSVMM          \r\n\r\nDescription\r\nDATA STORAGE INTERRUPT, PROCESSOR\r\n\r\nProbable Causes\r\nSOFTWARE PROGRAM\r\n\r\nFailure Causes\r\nSOFTWARE PROGRAM\r\n\r\n        Recommended Actions\r\n        IF PROBLEM PERSISTS THEN DO THE FOLLOWING\r\n        CONTACT APPROPRIATE SERVICE REPRESENTATIVE\r\n\r\nDetail Data\r\nDATA STORAGE INTERRUPT STATUS REGISTER\r\n0000 0000 0000 0000 \r\nSEGMENT REGISTER, SEGREG\r\n4000 0000 0000 7FFF \r\nDATA STORAGE INTERRUPT ADDRESS REGISTER\r\nFFFF D000 F200 8000 \r\nEXVAL\r\n1FFF FFA8 FFFF FFFF \r\n---------------------------------------------------------------------------\r\nLABEL:          DSI_PROC\r\nIDENTIFIER:     9D035E4D\r\n\r\nDate/Time:       Sun Aug 26 01:06:48 BEIST 2007\r\nSequence Number: 1169\r\nMachine Id:      00C6DA2D4C00\r\nNode Id:         localhost\r\nClass:           S\r\nType:            PERM\r\nResource Name:   SYSVMM          \r\n\r\nDescription\r\nDATA STORAGE INTERRUPT, PROCESSOR\r\n\r\nProbable Causes\r\nSOFTWARE PROGRAM\r\n\r\nFailure Causes\r\nSOFTWARE PROGRAM\r\n\r\n        Recommended Actions\r\n        IF PROBLEM PERSISTS THEN DO THE FOLLOWING\r\n        CONTACT APPROPRIATE SERVICE REPRESENTATIVE\r\n\r\nDetail Data\r\nDATA STORAGE INTERRUPT STATUS REGISTER\r\n0000 0000 0000 0000 \r\nSEGMENT REGISTER, SEGREG\r\n4000 0000 0000 7FFF \r\nDATA STORAGE INTERRUPT ADDRESS REGISTER\r\nFFFF D000 F200 8000 \r\nEXVAL\r\n1FFF FFA8 FFFF FFFF

chinadns

67145A39   0827092207 U S SYSDUMP        SYSTEM DUMP\r\nF48137AC   0827092107 U O minidump       COMPRESSED MINIMAL DUMP

SeanSu

errpt -aj 67145A39\r\n---------------------------------------------------------------------------\r\nLABEL:          DUMP_STATS\r\nIDENTIFIER:     67145A39\r\n\r\nDate/Time:       Mon Aug 27 09:22:36 BEIST 2007\r\nSequence Number: 1182\r\nMachine Id:      00C6DA2D4C00\r\nNode Id:         localhost\r\nClass:           S\r\nType:            UNKN\r\nResource Name:   SYSDUMP         \r\n\r\nDescription\r\nSYSTEM DUMP\r\n\r\nProbable Causes\r\nUNEXPECTED SYSTEM HALT\r\n\r\nUser Causes\r\nSYSTEM DUMP REQUESTED BY USER\r\n\r\n        Recommended Actions\r\n        PERFORM PROBLEM DETERMINATION PROCEDURES\r\n\r\nFailure Causes\r\nUNEXPECTED SYSTEM HALT\r\n\r\n        Recommended Actions\r\n        PERFORM PROBLEM DETERMINATION PROCEDURES\r\n\r\nDetail Data\r\nDUMP DEVICE\r\n/dev/lg_dumplv\r\nDUMP SIZE\r\n             136634368\r\nTIME\r\nMon Aug 27 09:16:56 2007\r\nDUMP TYPE (1 = PRIMARY, 2 = SECONDARY)\r\n           0\r\nDUMP STATUS\r\n           0\r\nERROR CODE\r\n           0\r\nDUMP INTEGRITY\r\nCompressed dump - Run dmpfmt with -c flag                                 on dump after uncompressing.\r\nFILE NAME\r\n\r\nPROCESSOR ID\r\n           2\r\n---------------------------------------------------------------------------\r\nLABEL:          DUMP_STATS\r\nIDENTIFIER:     67145A39\r\n\r\nDate/Time:       Sun Aug 26 01:13:33 BEIST 2007\r\nSequence Number: 1171\r\nMachine Id:      00C6DA2D4C00\r\nNode Id:         localhost\r\nClass:           S\r\nType:            UNKN\r\nResource Name:   SYSDUMP         \r\n\r\nDescription\r\nSYSTEM DUMP\r\n\r\nProbable Causes\r\nUNEXPECTED SYSTEM HALT\r\n\r\nUser Causes\r\nSYSTEM DUMP REQUESTED BY USER\r\n\r\n        Recommended Actions\r\n        PERFORM PROBLEM DETERMINATION PROCEDURES\r\n\r\nFailure Causes\r\nUNEXPECTED SYSTEM HALT\r\n\r\n        Recommended Actions\r\n        PERFORM PROBLEM DETERMINATION PROCEDURES\r\n\r\nDetail Data\r\nDUMP DEVICE\r\n/dev/lg_dumplv\r\nDUMP SIZE\r\n             213793280\r\nTIME\r\nSun Aug 26 01:06:56 2007\r\nDUMP TYPE (1 = PRIMARY, 2 = SECONDARY)\r\n           0\r\nDUMP STATUS\r\n           0\r\nERROR CODE\r\n           0\r\nDUMP INTEGRITY\r\nCompressed dump - Run dmpfmt with -c flag                                 on dump after uncompressing.\r\nFILE NAME\r\n\r\nPROCESSOR ID\r\n          10

SeanSu

第二个只是一个dump的log,有些怀疑是HA的补丁问题

gududeng

打一下补丁 HA和TSM的都打 系统要是有也打下

weizeyan

看一下dump设备\r\nsysdumpdev-l

金牌小卧底

可以用mdmprpt 先简要分析下minidump的内容

yanbing

把snap -ac发给我好了，帮你看看！\r\n\r\n可以QQ点对点直传，我QQ号码：176915

yanbing

疯了，刚发现，是TMD哪个在挖坟啊！！！