NIC failure detected

雪凤凰

双机双网卡，报错了，请问为什么会出现错误，如何解决，谢谢！
cqapp% tail -100 /var/adm/messages|grep err
Mar  4 10:09:36 cqapp in.mpathd[702]: [ID 594170 daemon.error] NIC failure detected on ce0 of group ipmp1
Mar  4 10:09:36 cqapp in.mpathd[702]: [ID 832587 daemon.error] Successfully failed over from NIC ce0 to NIC ce2
Mar  4 10:09:49 cqapp in.mpathd[702]: [ID 620804 daemon.error] Successfully failed back to NIC ce0
Mar  4 10:09:49 cqapp in.mpathd[702]: [ID 299542 daemon.error] NIC repair detected on ce0 of group ipmp1
Mar  4 11:43:59 cqapp in.mpathd[702]: [ID 168056 daemon.error] All Interfaces in group ipmp1 have failed
Mar  4 11:44:00 cqapp in.mpathd[702]: [ID 168056 daemon.error] All Interfaces in group ipmp1 have failed
Mar  4 11:44:11 cqapp SC[SUNW.LogicalHostname,cqc-rg,cqc,hafoip_monitor_check]: [ID 502438 daemon.error] IPMP group ipmp1 has status DOWN.
Mar  4 11:44:11 cqapp Cluster.RGM.rgmd: [ID 352149 daemon.error] monitor_check: method <hafoip_monitor_check> failed on resource <cqc> in resource group <cqc-rg> on node <cqapp>, exit code <1>, time used: 0% of timeout <300 seconds>
Mar  4 11:44:11 cqapp Cluster.RGM.rgmd: [ID 487778 daemon.error] RGM isn't failing resource group <cqc-rg> off of node <2>, because there are no other current or potential masters
Mar  4 11:44:24 cqapp in.mpathd[702]: [ID 620804 daemon.error] Successfully failed back to NIC ce0
Mar  4 11:44:24 cqapp in.mpathd[702]: [ID 299542 daemon.error] NIC repair detected on ce0 of group ipmp1
Mar  4 11:44:24 cqapp in.mpathd[702]: [ID 237757 daemon.error] At least 1 interface (ce0) of group ipmp1 has repaired
Mar  4 11:44:24 cqapp in.mpathd[702]: [ID 620804 daemon.error] Successfully failed back to NIC ce2
Mar  4 11:44:24 cqapp in.mpathd[702]: [ID 299542 daemon.error] NIC repair detected on ce2 of group ipmp1
Mar  4 11:45:03 cqapp in.mpathd[702]: [ID 168056 daemon.error] All Interfaces in group ipmp1 have failed
Mar  4 11:45:04 cqapp in.mpathd[702]: [ID 168056 daemon.error] All Interfaces in group ipmp1 have failed
Mar  4 11:45:26 cqapp in.mpathd[702]: [ID 620804 daemon.error] Successfully failed back to NIC ce0
Mar  4 11:45:26 cqapp in.mpathd[702]: [ID 299542 daemon.error] NIC repair detected on ce0 of group ipmp1
Mar  4 11:45:26 cqapp in.mpathd[702]: [ID 237757 daemon.error] At least 1 interface (ce0) of group ipmp1 has repaired
Mar  4 11:45:28 cqapp in.mpathd[702]: [ID 620804 daemon.error] Successfully failed back to NIC ce2
Mar  4 11:45:28 cqapp in.mpathd[702]: [ID 299542 daemon.error] NIC repair detected on ce2 of group ipmp1
Mar  4 15:09:46 cqapp in.mpathd[702]: [ID 168056 daemon.error] All Interfaces in group ipmp1 have failed
Mar  4 15:09:47 cqapp in.mpathd[702]: [ID 168056 daemon.error] All Interfaces in group ipmp1 have failed
Mar  4 15:09:57 cqapp SC[SUNW.LogicalHostname,cqc-rg,cqc,hafoip_monitor_check]: [ID 502438 daemon.error] IPMP group ipmp1 has status DOWN.
Mar  4 15:09:57 cqapp Cluster.RGM.rgmd: [ID 352149 daemon.error] monitor_check: method <hafoip_monitor_check> failed on resource <cqc> in resource group <cqc-rg> on node <cqapp>, exit code <1>, time used: 0% of timeout <300 seconds>
Mar  4 15:09:57 cqapp Cluster.RGM.rgmd: [ID 487778 daemon.error] RGM isn't failing resource group <cqc-rg> off of node <2>, because there are no other current or potential masters
Mar  4 15:10:25 cqapp in.mpathd[702]: [ID 620804 daemon.error] Successfully failed back to NIC ce2
Mar  4 15:10:25 cqapp in.mpathd[702]: [ID 299542 daemon.error] NIC repair detected on ce2 of group ipmp1
Mar  4 15:10:25 cqapp in.mpathd[702]: [ID 237757 daemon.error] At least 1 interface (ce2) of group ipmp1 has repaired
Mar  4 15:10:26 cqapp in.mpathd[702]: [ID 620804 daemon.error] Successfully failed back to NIC ce0
Mar  4 15:10:26 cqapp in.mpathd[702]: [ID 299542 daemon.error] NIC repair detected on ce0 of group ipmp1
Mar  5 11:54:42 cqapp in.mpathd[702]: [ID 594170 daemon.error] NIC failure detected on ce2 of group ipmp1
Mar  5 11:54:42 cqapp in.mpathd[702]: [ID 832587 daemon.error] Successfully failed over from NIC ce2 to NIC ce0
Mar  5 11:54:55 cqapp in.mpathd[702]: [ID 620804 daemon.error] Successfully failed back to NIC ce2
Mar  5 11:54:55 cqapp in.mpathd[702]: [ID 299542 daemon.error] NIC repair detected on ce2 of group ipmp1
Mar  5 16:16:35 cqapp in.mpathd[702]: [ID 594170 daemon.error] NIC failure detected on ce2 of group ipmp1
Mar  5 16:16:35 cqapp in.mpathd[702]: [ID 832587 daemon.error] Successfully failed over from NIC ce2 to NIC ce0
Mar  5 16:17:00 cqapp in.mpathd[702]: [ID 620804 daemon.error] Successfully failed back to NIC ce2
Mar  5 16:17:00 cqapp in.mpathd[702]: [ID 299542 daemon.error] NIC repair detected on ce2 of group ipmp1
Mar  6 09:48:14 cqapp in.mpathd[702]: [ID 168056 daemon.error] All Interfaces in group ipmp1 have failed
Mar  6 09:48:16 cqapp in.mpathd[702]: [ID 168056 daemon.error] All Interfaces in group ipmp1 have failed
Mar  6 09:48:28 cqapp in.mpathd[702]: [ID 620804 daemon.error] Successfully failed back to NIC ce0
Mar  6 09:48:28 cqapp in.mpathd[702]: [ID 299542 daemon.error] NIC repair detected on ce0 of group ipmp1
Mar  6 09:48:28 cqapp in.mpathd[702]: [ID 237757 daemon.error] At least 1 interface (ce0) of group ipmp1 has repaired
Mar  6 09:48:29 cqapp in.mpathd[702]: [ID 620804 daemon.error] Successfully failed back to NIC ce2
Mar  6 09:48:29 cqapp in.mpathd[702]: [ID 299542 daemon.error] NIC repair detected on ce2 of group ipmp1

lqiao

网线不好,网卡有问题或者网关ping不通都可能出现问题.

雪凤凰

网卡参数设置不当会出现这样的问题么？
以前没有报错过
第一次出现的
而且现在似乎还恢复正常了...

lqiao

网卡参数设置不对也会影响的,实际上in.mpathd进程判断网卡好坏的依据默认是每100ms ping一次网关,连续5次不通就认为网卡失败.

Lainhearter

很有可能是网关ping不通，两个口同时坏的可能性不大

东方蜘蛛

网关不稳定，赶快检查网络！！！！