errpt 问题

congrd

昨天小机P520报错如下：864D2CE3   0922141905 P S topsvcs        NIM thread blocked
864D2CE3   0922141905 P S topsvcs        NIM thread blocked
864D2CE3   0922141905 P S topsvcs        NIM thread blocked
864D2CE3   0922141905 P S topsvcs        NIM thread blocked
864D2CE3   0922141905 P S topsvcs        NIM thread blocked
864D2CE3   0922141905 P S topsvcs        NIM thread blocked
FA723BD9   0922141905 I S topsvcs        DeadMan Switch (DMS) close to trigger
864D2CE3   0922141905 P S topsvcs        NIM thread blocked
864D2CE3   0922141905 P S topsvcs        NIM thread blocked
864D2CE3   0922141905 P S topsvcs        NIM thread blocked
864D2CE3   0922141905 P S topsvcs        NIM thread blocked
864D2CE3   0922141905 P S topsvcs        NIM thread blocked
864D2CE3   0922141905 P S topsvcs        NIM thread blocked
3C81E43F   0922141905 P U topsvcs        Late in sending heartbeat



---------------------------------------------------------------------------
LABEL:          TS_NIM_ERROR_STUCK_
IDENTIFIER:     864D2CE3

Date/Time:       Thu Sep 22 14:19:23 BEIST 2005
Sequence Number: 443
Machine Id:      00C1199F4C00
Node Id:         p201_host
Class:           S
Type:            PERM
Resource Name:   topsvcs

Description
NIM thread blocked

Probable Causes
A thread in a Topology Services Network Interface Module (NIM) process
was blocked
Topology Services NIM process cannot get timely access to CPU

User Causes
Excessive memory consumption is causing high memory contention
Excessive disk I/O is causing high memory contention

        Recommended Actions
        Examine I/O and memory activity on the system
        Reduce load on the system
        Tune virtual memory parameters
        Call IBM Service if problem persists

Failure Causes
Excessive virtual memory activity prevents NIM from making progress
Excessive disk I/O traffic is interfering with paging I/O

        Recommended Actions
        Examine I/O and memory activity on the system
        Reduce load on the system
        Tune virtual memory parameters
        Call IBM Service if problem persists

Detail Data
DETECTING MODULE
rsct,nim_control.C,1.38,5455
ERROR ID
6XnGH40fnYA1/.vW05g8fg0...................
REFERENCE CODE

Thread which was blocked
receive thread
Interval in seconds during which process was blocked
         120
Interface name
en2

p201_host#errpt -aj FA723BD9
---------------------------------------------------------------------------
LABEL:          TS_DMS_WARNING_ST
IDENTIFIER:     FA723BD9

Date/Time:       Thu Sep 22 14:19:23 BEIST 2005
Sequence Number: 437
Machine Id:      00C1199F4C00
Node Id:         p201_host
Class:           S
Type:            INFO
Resource Name:   topsvcs

Description
DeadMan Switch (DMS) close to trigger

Probable Causes
Topology Services daemon cannot get timely access to CPU

User Causes
Excessive I/O load is causing high I/O interrupt traffic
Excessive memory consumption is causing high memory contention

        Recommended Actions
        Reduce application load on the system
        Change (relax) Topology Services tunable parameters
        Call IBM Service if problem persists

Failure Causes
Problem in Operating System prevents processes from running
Excessive I/O interrupt traffic prevents processes from running
Excessive virtual memory activity prevents Topology Services from making progress
The system clock was set forward

        Recommended Actions
        Examine I/O and memory activity on the system
        Reduce load on the system
        Change (relax) Topology Services tunable parameters
        Call IBM Service if problem persists

Detail Data
DETECTING MODULE
rsct,haDMS_kex.c   1.3.1.5,607
ERROR ID

REFERENCE CODE

Time remaining until DMS triggers (in msec)
           0
DMS trigger interval (in msec)
       20000


p201_host#errpt -aj 3C81E43F
---------------------------------------------------------------------------
LABEL:          TS_LATEHB_PE
IDENTIFIER:     3C81E43F

Date/Time:       Thu Sep 22 14:19:23 BEIST 2005
Sequence Number: 430
Machine Id:      00C1199F4C00
Node Id:         p201_host
Class:           U
Type:            PERF
Resource Name:   topsvcs
Resource Class:  NONE
Resource Type:   NONE
Location:
VPD:

Description
Late in sending heartbeat

Probable Causes
Heavy CPU load
Severe physical memory shortage
Heavy I/O activities

Failure Causes
Daemon can not get required system resource

        Recommended Actions
        Reduce the system load

Detail Data
DETECTING MODULE
rsct,bootstrp.C,1.184,4520
ERROR ID
6zESUw.fnYA1/MaI.5g8fg0...................
REFERENCE CODE

A heartbeat is late by the following number of seconds
         120

以前没遇到过，谁知道是什么原因导致的系统高I/O和内存不足？谢谢
（应用问题可以排除）

huxh

关注中，好象与HACMP有关
我这边也常出，不过好象从来不影响应用，N久以前好象咨询过IBM，给了一个解决方法（更改默认的高/低水平位？这个不能很确定），有没有效果也不记得了

congrd

是HA的问题吗？
这台机器是做了HA,不过与它做双机的另一台机器没有报错呀？！

老农

Description
DeadMan Switch (DMS) close to trigger

Probable Causes
Topology Services daemon cannot get timely access to CPU

User Causes
Excessive I/O load is causing high I/O interrupt traffic
Excessive memory consumption is causing high memory contention

       Recommended Actions
       Reduce application load on the system
       Change (relax) Topology Services tunable parameters
       Call IBM Service if problem persists

Failure Causes
Problem in Operating System prevents processes from running
Excessive I/O interrupt traffic prevents processes from running
Excessive virtual memory activity prevents Topology Services from making progress
The system clock was set forward

       Recommended Actions
       Examine I/O and memory activity on the system
       Reduce load on the system
       Change (relax) Topology Services tunable parameters
       Call IBM Service if problem persists

congrd

农哥也到这来了。今早LU上不去了，总说我密码不对！
只好发到这来了
你贴的我也看到了，可看不明白
谁能帮我解释一下？谢谢

老农

LU在换论坛程序，要稍等。

这些信息要求监测你的系统负载情况，还有有些参数是否正确调整过。还有HACMP的补丁版本等。

congrd

看来以后真得多看看了，这台是新机器，P520+Aix5.3+ML02+HACMP5.1+Oracle9I。刚用了2个月，一直都没什么问题，昨天还是第一次报错！

lstars0507

我把这个故障顶起来！
我也是这样的！
这么解决呀，各位仁兄！

fswenly

学习解决办法中。

rosenlee

如同崇拜神一样崇拜农哥