solaris9+cluster3.1频繁切换的问题，在线等

jdsnxingsc

双机比较频繁的切换，基本是每天都有切换，不知道是什么原因，请大侠指教，发生切换时候的messages日志如下：
Aug 17 07:23:09 JDSN-SEC in.mpathd[456]: [ID 594170 daemon.error] NIC failure detected on ce0 of group ipmp1
Aug 17 07:23:09 JDSN-SEC Cluster.PNM: [ID 890413 daemon.notice] ipmp1: state transition from OK to DOWN.
Aug 17 07:23:19 JDSN-SEC Cluster.RGM.rgmd: [ID 707948 daemon.notice] launching method <hafoip_monitor_stop> for resource <JDSN-ORA>, resource group <ha-ora>, timeout <300> seconds
Aug 17 07:23:19 JDSN-SEC Cluster.RGM.rgmd: [ID 707948 daemon.notice] launching method <hastorageplus_monitor_stop> for resource <hasp-ora>, resource group <ha-ora>, timeout <90> seconds
Aug 17 07:23:19 JDSN-SEC Cluster.RGM.rgmd: [ID 707948 daemon.notice] launching method <bin/oracle_listener_monitor_stop> for resource <ora-listener-res>, resource group <ha-ora>, timeout <120> seconds
Aug 17 07:23:19 JDSN-SEC Cluster.RGM.rgmd: [ID 707948 daemon.notice] launching method <bin/oracle_server_monitor_stop> for resource <ora-server-res>, resource group <ha-ora>, timeout <120> seconds
Aug 17 07:23:19 JDSN-SEC Cluster.RGM.rgmd: [ID 736390 daemon.notice] method <hastorageplus_monitor_stop> completed successfully for resource <hasp-ora>, resource group <ha-ora>, time used: 0% of timeout <90 seconds>
Aug 17 07:23:19 JDSN-SEC Cluster.RGM.rgmd: [ID 707948 daemon.notice] launching method <hastorageplus_stop> for resource <hasp-ora>, resource group <ha-ora>, timeout <1800> seconds
Aug 17 07:23:19 JDSN-SEC Cluster.RGM.rgmd: [ID 736390 daemon.notice] method <hastorageplus_stop> completed successfully for resource <hasp-ora>, resource group <ha-ora>, time used: 0% of timeout <1800 seconds>
Aug 17 07:23:19 JDSN-SEC Cluster.RGM.rgmd: [ID 736390 daemon.notice] method <hafoip_monitor_stop> completed successfully for resource <JDSN-ORA>, resource group <ha-ora>, time used: 0% of timeout <300 seconds>
Aug 17 07:23:19 JDSN-SEC Cluster.RGM.rgmd: [ID 736390 daemon.notice] method <bin/oracle_server_monitor_stop> completed successfully for resource <ora-server-res>, resource group <ha-ora>, time used: 0% of timeout <120 seconds>
Aug 17 07:23:19 JDSN-SEC Cluster.RGM.rgmd: [ID 707948 daemon.notice] launching method <bin/oracle_server_stop> for resource <ora-server-res>, resource group <ha-ora>, timeout <300> seconds
Aug 17 07:23:20 JDSN-SEC Cluster.RGM.rgmd: [ID 736390 daemon.notice] method <bin/oracle_listener_monitor_stop> completed successfully for resource <ora-listener-res>, resource group <ha-ora>, time used: 0% of timeout <120 seconds>
Aug 17 07:23:20 JDSN-SEC Cluster.RGM.rgmd: [ID 707948 daemon.notice] launching method <bin/oracle_listener_stop> for resource <ora-listener-res>, resource group <ha-ora>, timeout <180> seconds
Aug 17 07:23:23 JDSN-SEC Cluster.RGM.rgmd: [ID 736390 daemon.notice] method <bin/oracle_listener_stop> completed successfully for resource <ora-listener-res>, resource group <ha-ora>, time used: 2% of timeout <180 seconds>
Aug 17 07:23:24 JDSN-SEC in.mpathd[456]: [ID 299542 daemon.error] NIC repair detected on ce0 of group ipmp1
Aug 17 07:23:24 JDSN-SEC Cluster.PNM: [ID 890413 daemon.notice] ipmp1: state transition from DOWN to OK.
Aug 17 07:24:31 JDSN-SEC Cluster.RGM.rgmd: [ID 736390 daemon.notice] method <bin/oracle_server_stop> completed successfully for resource <ora-server-res>, resource group <ha-ora>, time used: 23% of timeout <300 seconds>
Aug 17 07:24:31 JDSN-SEC Cluster.RGM.rgmd: [ID 707948 daemon.notice] launching method <hafoip_stop> for resource <JDSN-ORA>, resource group <ha-ora>, timeout <300> seconds
Aug 17 07:24:31 JDSN-SEC ip: [ID 979104 kern.notice] TCP_IOC_ABORT_CONN: local = 010.000.000.031:0, remote = 000.000.000.000:0, start = -2, end = 6
Aug 17 07:24:31 JDSN-SEC ip: [ID 524725 kern.notice] TCP_IOC_ABORT_CONN: aborted 24 connections
Aug 17 07:24:31 JDSN-SEC Cluster.RGM.rgmd: [ID 736390 daemon.notice] method <hafoip_stop> completed successfully for resource <JDSN-ORA>, resource group <ha-ora>, time used: 0% of timeout <300 seconds>
Aug 17 07:24:31 JDSN-SEC Cluster.RGM.rgmd: [ID 707948 daemon.notice] launching method <hastorageplus_postnet_stop> for resource <hasp-ora>, resource group <ha-ora>, timeout <1800> seconds
Aug 17 07:24:31 JDSN-SEC Cluster.RGM.rgmd: [ID 736390 daemon.notice] method <hastorageplus_postnet_stop> completed successfully for resource <hasp-ora>, resource group <ha-ora>, time used: 0% of timeout <1800 seconds>
Aug 17 07:24:32 JDSN-SEC Cluster.Framework: [ID 801593 daemon.notice] stdout: no longer primary for oraset
发生错误的messages_log.ora-server-res日志如下：
Aug 17 07:23:19 SC[SUNWscor.oracle_server.monitor_stop]:ha-orara-server-res: Stopping fault monitor using pmfadm tag ORASERV_MON_ora-server-res
Aug 17 07:23:20 SC[SUNWscor.oracle_server.stop]:ha-orara-server-res: Stopping oracle server using shutdown immediate

SQL*Plus: Release 9.2.0.1.0 - Production on Thu Aug 17 07:23:20 2006

Copyright (c) 1982, 2002, Oracle Corporation.  All rights reserved.


Connected to:
Oracle9i Enterprise Edition Release 9.2.0.1.0 - 64bit Production
With the Partitioning, OLAP and Oracle Data Mining options
JServer Release 9.2.0.1.0 - Production

SQL> Database closed.
Database dismounted.
ORACLE instance shut down.
SQL> Disconnected from Oracle9i Enterprise Edition Release 9.2.0.1.0 - 64bit Production
With the Partitioning, OLAP and Oracle Data Mining options
JServer Release 9.2.0.1.0 - Production
Aug 17 07:24:31 SC[SUNWscor.oracle_server.stop]:ha-orara-server-res: Server stopped successfully.
Aug 17 10:48:59 SC[SUNWscor.oracle_server.start]:ha-orara-server-res: Starting Oracle server.

SQL*Plus: Release 9.2.0.1.0 - Production on Thu Aug 17 10:48:59 2006

Copyright (c) 1982, 2002, Oracle Corporation.  All rights reserved.

Connected to an idle instance.

SQL> ORACLE instance started.

Total System Global Area 1578601320 bytes
Fixed Size                     732008 bytes
Variable Size                 1157627904 bytes
Database Buffers          419430400 bytes
Redo Buffers                     811008 bytes
Database mounted.
Database opened.
SQL> Disconnected from Oracle9i Enterprise Edition Release 9.2.0.1.0 - 64bit Production
With the Partitioning, OLAP and Oracle Data Mining options
JServer Release 9.2.0.1.0 - Production

///////////////////////////////////////////////////////////////////////////////////////////////////
# ./scstat
------------------------------------------------------------------

-- Cluster Nodes --

                    Node name           Status
                    ---------           ------
  Cluster node:     JDSN-FIR            Online
  Cluster node:     JDSN-SEC            Online

------------------------------------------------------------------

-- Cluster Transport Paths --

                    Endpoint            Endpoint            Status
                    --------            --------            ------
  Transport path:   JDSN-FIR:ce2        JDSN-SEC:ce2        Path online
  Transport path:   JDSN-FIR:ce1        JDSN-SEC:ce1        Path online

------------------------------------------------------------------

-- Quorum Summary --

  Quorum votes possible:      3
  Quorum votes needed:        2
  Quorum votes present:       3


-- Quorum Votes by Node --

                    Node Name           Present Possible Status
                    ---------           ------- -------- ------
  Node votes:       JDSN-FIR            1        1       Online
  Node votes:       JDSN-SEC            1        1       Online


-- Quorum Votes by Device --

                    Device Name         Present Possible Status
                    -----------         ------- -------- ------
  Device votes:     /dev/did/rdsk/d1s2  1        1       Online

------------------------------------------------------------------

-- Device Group Servers --

                         Device Group        Primary             Secondary
                         ------------        -------             ---------
  Device group servers:  oraset              JDSN-SEC            JDSN-FIR


-- Device Group Status --

                              Device Group        Status
                              ------------        ------
  Device group status:        oraset              Online

------------------------------------------------------------------

-- Resource Groups and Resources --

            Group Name          Resources
            ----------          ---------
Resources: ha-ora              JDSN-ORA hasp-ora ora-listener-res ora-server-re
s


-- Resource Groups --

            Group Name          Node Name           State
            ----------          ---------           -----
     Group: ha-ora              JDSN-FIR            Offline
     Group: ha-ora              JDSN-SEC            Online


-- Resources --

            Resource Name       Node Name           State     Status Message
            -------------       ---------           -----     --------------
  Resource: JDSN-ORA            JDSN-FIR            Offline   Offline - LogicalH
ostname offline.
  Resource: JDSN-ORA            JDSN-SEC            Online    Online - LogicalHo
stname online.

  Resource: hasp-ora            JDSN-FIR            Offline   Offline
  Resource: hasp-ora            JDSN-SEC            Online    Online

  Resource: ora-listener-res    JDSN-FIR            Offline   Offline
  Resource: ora-listener-res    JDSN-SEC            Online    Online

  Resource: ora-server-res      JDSN-FIR            Offline   Offline
  Resource: ora-server-res      JDSN-SEC            Online    Online

------------------------------------------------------------------

-- IPMP Groups --

              Node Name           Group   Status         Adapter   Status
              ---------           -----   ------         -------   ------
  IPMP Group: JDSN-FIR            ipmp1   Online         ce0       Online

  IPMP Group: JDSN-SEC            ipmp1   Online         ce0       Online