免费注册 查看新帖 |

ChinaUnix.net

  平台 论坛 博客 文库
最近访问板块 发新帖
查看: 2219 | 回复: 4

[网络子系统] 求助:Linux系统ebtables配合iptables总死机 [复制链接]

论坛徽章:
1
金牛座
日期:2014-05-29 15:55:47
发表于 2015-08-21 13:23 |显示全部楼层
环境:使用Linux做了一个网桥,p1p1和p1p2建立网桥br1,以及独立网卡em1。流经p1p2的数据会用ebtables强制转发,然后使用iptables做NAT。
情况:该构架已经稳定运行1年多了,很多服务器甚至2~3个月几乎没碰过,也就是说没修改过配置,但是从这周1开始大批服务器突然死机。原来以为是硬件问题,但后来发现硬件更换后故障依旧,现象也一样。
错误信息:死机前我们抓到的信息如下:

  1. Aug 20 20:33:53 br1-7 kernel: IP: [<ffffffff8128e532>] memmove+0x42/0x1a0
  2. Aug 20 20:33:53 br1-7 kernel: PGD 1a86063 PUD 8067 PMD 9067 PTE 0
  3. Aug 20 20:33:53 br1-7 kernel: Oops: 0000 [#1] SMP
  4. Aug 20 20:33:53 br1-7 kernel:
  5. Aug 20 20:33:53 br1-7 kernel: last sysfs file: /sys/devices/system/cpu/online
  6. Aug 20 20:33:53 br1-7 kernel: CPU 15
  7. Aug 20 20:33:53 br1-7 kernel: Modules linked in:
  8. Aug 20 20:33:53 br1-7 kernel: ebtable_filter iptable_raw httpcontentchange(U) xt_state xt_physdev iptable_mangle xt_MARK ebt_redirect ebt_ip ebtable_nat ebtables bridge ipt_LOG act_police cls_u32 sch_ingress sch_prio sch_sfq sch_htb ipip tunnel4 ip_gre
  9. Aug 20 20:33:53 br1-7 kernel: ip_tunnel xt_TCPMSS xt_tcpmss nf_nat_ftp nf_conntrack_ftp iptable_nat iptable_filter ip_tables nf_nat_pptp nf_conntrack_pptp nf_conntrack_proto_gre nf_nat_proto_gre nf_nat nf_conntrack_ipv4 nf_conntrack nf_defrag_ipv4 8021q garp stp llc ipv6 dm_mod power_meter iTCO_wdt iTCO_vendor_support dcdbas serio_raw lpc_ich mfd_core ixgbe dca ptp pps_core mdio i7core_edac edac_core sg bnx2 ext4 jbd2 mbcache sd_mod crc_t10dif pata_acpi ata_generic ata_piix mptsas mptscsih mptbase scsi_transport_sas [last unloaded: scsi_wait_scan]
  10. Aug 20 20:33:53 br1-7 kernel:
  11. Aug 20 20:33:53 br1-7 kernel: Pid: 0, comm: swapper Not tainted 2.6.32-431.el6.x86_64 #1 Dell Inc. PowerEdge R410/0N83VF
  12. Aug 20 20:33:53 br1-7 kernel: RIP: 0010:[<ffffffff8128e532>]  [<ffffffff8128e532>] memmove+0x42/0x1a0
  13. Aug 20 20:33:53 br1-7 kernel: RSP: 0018:ffff8800282e3608  EFLAGS: 00010202
  14. Aug 20 20:33:53 br1-7 kernel: RAX: ffff8800cf405017 RBX: ffff880126770980 RCX: 0000000000000000
  15. Aug 20 20:33:53 br1-7 kernel: RDX: 00000000fd2ae4fb RSI: ffff8800cf678fe4 RDI: ffff8800cf678fd7
  16. Aug 20 20:33:53 br1-7 kernel: RBP: ffff8800282e3650 R08: 3d4e49203a524544 R09: 7031703d4e495359
  17. Aug 20 20:33:53 br1-7 kernel: R10: 485020313531312e R11: 316d653d54554f20 R12: 000000000000000d
  18. Aug 20 20:33:53 br1-7 kernel: R13: 0000000000000000 R14: 0000000002addfbf R15: ffff8800cc927058
  19. Aug 20 20:33:53 br1-7 kernel: FS:  0000000000000000(0000) GS:ffff8800282e0000(0000) knlGS:0000000000000000
  20. Aug 20 20:33:53 br1-7 kernel: CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
  21. Aug 20 20:33:53 br1-7 kernel: CR2: ffff8800cf679000 CR3: 000000020b691000 CR4: 00000000000007e0
  22. Aug 20 20:33:53 br1-7 kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
  23. Aug 20 20:33:53 br1-7 kernel: DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
  24. Aug 20 20:33:53 br1-7 kernel: Process swapper (pid: 0, threadinfo ffff88012e2ae000, task ffff88022e12a080)
  25. Aug 20 20:33:53 br1-7 kernel: Stack:
  26. Aug 20 20:33:53 br1-7 kernel: ffffffffa0213781 ffffffffa06d97d0 0000000000000000 ffff8800282e3640
  27. Aug 20 20:33:53 br1-7 kernel: <d> ffff880126770980 ffff8800cc927030 ffff8800ca93fb98 ffff8800cc927044
  28. Aug 20 20:33:53 br1-7 kernel: <d> 000000000000000d ffff8800282e36d0 ffffffffa0213c6b 000000000000000d
  29. Aug 20 20:33:53 br1-7 kernel: Call Trace:
  30. Aug 20 20:33:53 br1-7 kernel: <IRQ>
  31. Aug 20 20:33:53 br1-7 kernel: [<ffffffffa0213781>] ? mangle_contents+0x81/0x1d0 [nf_nat]
  32. Aug 20 20:33:53 br1-7 kernel: [<ffffffffa0213c6b>] nf_nat_mangle_tcp_packet+0xbb/0x550 [nf_nat]
  33. Aug 20 20:33:53 br1-7 kernel: [<ffffffffa02d4eab>] myhook_func+0x7cb/0x930 [httpcontentchange]
  34. Aug 20 20:33:53 br1-7 kernel: [<ffffffff814893a9>] nf_iterate+0x69/0xb0
  35. Aug 20 20:33:53 br1-7 kernel: [<ffffffffa029aba0>] ? br_nf_forward_finish+0x0/0x140 [bridge]
  36. Aug 20 20:33:53 br1-7 kernel: [<ffffffff81489566>] nf_hook_slow+0x76/0x120
  37. Aug 20 20:33:53 br1-7 kernel: [<ffffffffa029aba0>] ? br_nf_forward_finish+0x0/0x140 [bridge]
  38. Aug 20 20:33:53 br1-7 kernel: [<ffffffffa029b126>] br_nf_forward_ip+0x1d6/0x360 [bridge]
  39. Aug 20 20:33:53 br1-7 kernel: [<ffffffff814893a9>] nf_iterate+0x69/0xb0
  40. Aug 20 20:33:53 br1-7 kernel: [<ffffffffa02948d0>] ? br_forward_finish+0x0/0x60 [bridge]
  41. Aug 20 20:33:53 br1-7 kernel: [<ffffffff81489566>] nf_hook_slow+0x76/0x120
  42. Aug 20 20:33:53 br1-7 kernel: [<ffffffffa02948d0>] ? br_forward_finish+0x0/0x60 [bridge]
  43. Aug 20 20:33:53 br1-7 kernel: [<ffffffffa02949ae>] __br_forward+0x7e/0xd0 [bridge]
  44. Aug 20 20:33:53 br1-7 kernel: [<ffffffff81489566>] ? nf_hook_slow+0x76/0x120
  45. Aug 20 20:33:53 br1-7 kernel: [<ffffffffa0294a5d>] br_forward+0x5d/0x70 [bridge]
  46. Aug 20 20:33:53 br1-7 kernel: [<ffffffffa0295a6b>] br_handle_frame_finish+0x17b/0x2a0 [bridge]
  47. Aug 20 20:33:53 br1-7 kernel: [<ffffffffa029b938>] br_nf_pre_routing_finish+0x238/0x350 [bridge]
  48. Aug 20 20:33:53 br1-7 kernel: [<ffffffffa029bedb>] br_nf_pre_routing+0x48b/0x7b0 [bridge]
  49. Aug 20 20:33:53 br1-7 kernel: [<ffffffff814893a9>] nf_iterate+0x69/0xb0
  50. Aug 20 20:33:53 br1-7 kernel: [<ffffffffa02958f0>] ? br_handle_frame_finish+0x0/0x2a0 [bridge]
  51. Aug 20 20:33:53 br1-7 kernel: [<ffffffff81489566>] nf_hook_slow+0x76/0x120
  52. Aug 20 20:33:53 br1-7 kernel: [<ffffffffa02958f0>] ? br_handle_frame_finish+0x0/0x2a0 [bridge]
  53. Aug 20 20:33:53 br1-7 kernel: [<ffffffffa0295d1c>] br_handle_frame+0x18c/0x250 [bridge]
  54. Aug 20 20:33:53 br1-7 kernel: [<ffffffff81500220>] ? vlan_hwaccel_do_receive+0x70/0x130
  55. Aug 20 20:33:53 br1-7 kernel: [<ffffffff8145b5c9>] __netif_receive_skb+0x529/0x750
  56. Aug 20 20:33:53 br1-7 kernel: [<ffffffff8145f1b8>] netif_receive_skb+0x58/0x60
  57. Aug 20 20:33:53 br1-7 kernel: [<ffffffff8145f3a8>] napi_gro_complete+0xc8/0x150
  58. Aug 20 20:33:53 br1-7 kernel: [<ffffffff8145f652>] dev_gro_receive+0x222/0x350
  59. Aug 20 20:33:53 br1-7 kernel: [<ffffffff815006e0>] vlan_gro_common+0x190/0x260
  60. Aug 20 20:33:53 br1-7 kernel: [<ffffffff8150098a>] vlan_gro_receive+0x7a/0xa0
  61. Aug 20 20:33:53 br1-7 kernel: [<ffffffffa013ae68>] ixgbe_poll+0xce8/0x12c0 [ixgbe]
  62. Aug 20 20:33:53 br1-7 kernel: [<ffffffffa0295d1c>] ? br_handle_frame+0x18c/0x250 [bridge]
  63. Aug 20 20:33:53 br1-7 kernel: [<ffffffff81500220>] ? vlan_hwaccel_do_receive+0x70/0x130
  64. Aug 20 20:33:53 br1-7 kernel: [<ffffffff81460b43>] net_rx_action+0x103/0x2f0
  65. Aug 20 20:33:53 br1-7 kernel: [<ffffffff8107a8e1>] __do_softirq+0xc1/0x1e0
  66. Aug 20 20:33:53 br1-7 kernel: [<ffffffff810e6ec0>] ? handle_IRQ_event+0x60/0x170
  67. Aug 20 20:33:53 br1-7 kernel: [<ffffffff8100c30c>] call_softirq+0x1c/0x30
  68. Aug 20 20:33:53 br1-7 kernel: [<ffffffff8100fa75>] do_softirq+0x65/0xa0
  69. Aug 20 20:33:53 br1-7 kernel: [<ffffffff8107a795>] irq_exit+0x85/0x90
  70. Aug 20 20:33:53 br1-7 kernel: [<ffffffff81530fe5>] do_IRQ+0x75/0xf0
  71. Aug 20 20:33:53 br1-7 kernel: [<ffffffff8100b9d3>] ret_from_intr+0x0/0x11
  72. Aug 20 20:33:53 br1-7 kernel: <EOI>
  73. Aug 20 20:33:53 br1-7 kernel: [<ffffffff812e09be>] ? intel_idle+0xde/0x170
  74. Aug 20 20:33:53 br1-7 kernel: [<ffffffff812e09a1>] ? intel_idle+0xc1/0x170
  75. Aug 20 20:33:53 br1-7 kernel: [<ffffffff814266f7>] cpuidle_idle_call+0xa7/0x140
  76. Aug 20 20:33:53 br1-7 kernel: [<ffffffff81009fc6>] cpu_idle+0xb6/0x110
  77. Aug 20 20:33:53 br1-7 kernel: [<ffffffff81520e13>] start_secondary+0x2ac/0x2ef
  78. Aug 20 20:33:53 br1-7 kernel: Code: d0 49 39 f8 0f 8f 9f 00 00 00 48 81 fa a8 02 00 00 72 05 40 38 fe 74 41 48 83 ea 20 48 83 ea 20 4c 8b 1e 4c 8b 56 08 4c 8b 4e 10 <4c> 8b 46 18 48 8d 76 20 4c 89 1f 4c 89 57 08 4c 89 4f 10 4c 89
  79. Aug 20 20:33:53 br1-7 kernel: RIP  [<ffffffff8128e532>] memmove+0x42/0x1a0
  80. Aug 20 20:33:53 br1-7 kernel: RSP <ffff8800282e3608>
  81. Aug 20 20:33:53 br1-7 kernel: CR2: ffff8800cf679000
  82. Aug 20 20:33:53 br1-7 kernel: BUG: scheduling while atomic: swapper/0/0x10000100
  83. Aug 20 20:33:53 br1-7 kernel: Modules linked in: ebtable_filter iptable_raw httpcontentchange(U) xt_state xt_physdev iptable_mangle xt_MARK ebt_redirect ebt_ip ebtable_nat ebtables bridge ipt_LOG act_police cls_u32 sch_ingress sch_prio sch_sfq sch_htb ipip tunnel4 ip_gre ip_tunnel xt_TCPMSS xt_tcpmss nf_nat_ftp nf_conntrack_ftp iptable_nat iptable_filter ip_tables nf_nat_pptp nf_conntrack_pptp nf_conntrack_proto_gre nf_nat_proto_gre nf_nat nf_conntrack_ipv4 nf_conntrack nf_defrag_ipv4 8021q garp stp llc ipv6 dm_mod power_meter iTCO_wdt iTCO_vendor_support dcdbas serio_raw lpc_ich mfd_core ixgbe dca ptp pps_core mdio i7core_edac edac_core sg bnx2 ext4 jbd2 mbcache sd_mod crc_t10dif pata_acpi ata_generic ata_piix mptsas mptscsih mptbase scsi_transport_sas [last unloaded: scsi_wait_scan]
  84. Aug 20 20:33:53 br1-7 kernel: CPU 15
  85. Aug 20 20:33:53 br1-7 kernel: Modules linked in: ebtable_filter iptable_raw httpcontentchange(U) xt_state xt_physdev iptable_mangle xt_MARK ebt_redirect ebt_ip ebtable_nat ebtables bridge ipt_LOG act_police cls_u32 sch_ingress sch_prio sch_sfq sch_htb ipip tunnel4 ip_gre ip_tunnel xt_TCPMSS xt_tcpmss nf_nat_ftp nf_conntrack_ftp iptable_nat iptable_filter ip_tables nf_nat_pptp nf_conntrack_pptp nf_conntrack_proto_gre nf_nat_proto_gre nf_nat nf_conntrack_ipv4 nf_conntrack nf_defrag_ipv4 8021q garp stp llc ipv6 dm_mod power_meter iTCO_wdt iTCO_vendor_support dcdbas serio_raw lpc_ich mfd_core ixgbe dca ptp pps_core mdio i7core_edac edac_core sg bnx2 ext4 jbd2 mbcache sd_mod crc_t10dif pata_acpi ata_generic ata_piix mptsas mptscsih mptbase scsi_transport_sas [last unloaded: scsi_wait_scan]
  86. Aug 20 20:33:53 br1-7 kernel:
  87. Aug 20 20:33:53 br1-7 kernel: Pid: 0, comm: swapper Not tainted 2.6.32-431.el6.x86_64 #1 Dell Inc. PowerEdge R410/0N83VF
  88. Aug 20 20:33:53 br1-7 kernel: RIP: 0010:[<ffffffff812e09be>]  [<ffffffff812e09be>] intel_idle+0xde/0x170
  89. Aug 20 20:33:53 br1-7 kernel: RSP: 0018:ffff88012e2afe68  EFLAGS: 00000202
  90. Aug 20 20:33:53 br1-7 kernel: RAX: 0000000000000000 RBX: ffff88012e2afed8 RCX: 0000000000000000
  91. Aug 20 20:33:53 br1-7 kernel: RDX: 000000000000006d RSI: 0000000000000000 RDI: 000000000001aa57
  92. Aug 20 20:33:53 br1-7 kernel: RBP: ffffffff8100b9ce R08: 0000000000000002 R09: 0000000000000050
  93. Aug 20 20:33:53 br1-7 kernel: R10: 000010906c507ee3 R11: 0000000000000000 R12: 0000000000000086
  94. Aug 20 20:33:53 br1-7 kernel: R13: ffff88012e2afdd8 R14: ffff8800282f15e0 R15: 0000000000000000
  95. Aug 20 20:33:53 br1-7 kernel: FS:  0000000000000000(0000) GS:ffff8800282e0000(0000) knlGS:0000000000000000
  96. Aug 20 20:33:53 br1-7 kernel: CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
  97. Aug 20 20:33:53 br1-7 kernel: CR2: ffff8800cf679000 CR3: 000000020b691000 CR4: 00000000000007e0
  98. Aug 20 20:33:53 br1-7 kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
  99. Aug 20 20:33:53 br1-7 kernel: DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
  100. Aug 20 20:33:53 br1-7 kernel: Process swapper (pid: 0, threadinfo ffff88012e2ae000, task ffff88022e12a080)
  101. Aug 20 20:33:53 br1-7 kernel: Stack:
  102. Aug 20 20:33:53 br1-7 kernel: ffff8800282ee100 0000000000000282 0000000000000000 000000000000006d
  103. Aug 20 20:33:53 br1-7 kernel: <d> 0000000000000000 000000000000006d 0000000000000000 0000000f00cb791a
  104. Aug 20 20:33:53 br1-7 kernel: <d> 0000000000000000 ffff8800282fe040 ffff8800282fe0b0 0000000000000000
  105. Aug 20 20:33:53 br1-7 kernel: Call Trace:
  106. Aug 20 20:33:53 br1-7 kernel: [<ffffffff814266f7>] ? cpuidle_idle_call+0xa7/0x140
  107. Aug 20 20:33:53 br1-7 kernel: [<ffffffff81009fc6>] ? cpu_idle+0xb6/0x110
  108. Aug 20 20:33:53 br1-7 kernel: [<ffffffff81520e13>] ? start_secondary+0x2ac/0x2ef
  109. Aug 20 20:33:53 br1-7 kernel: Code: 58 dc ff 4c 29 e8 48 89 c7 e8 bf 88 d9 ff 49 89 c4 49 89 d5 48 89 45 a0 48 89 55 a8 48 89 45 b0 48 89 55 b8 fb 66 0f 1f 44 00 00 <85> 1d 24 57 81 00 75 0e 48 8d 75 cc bf 05 00 00 00 e8 1c a7 dc
  110. Aug 20 20:33:53 br1-7 kernel: Call Trace:
  111. Aug 20 20:33:53 br1-7 kernel: [<ffffffff812e09a1>] ? intel_idle+0xc1/0x170
  112. Aug 20 20:33:53 br1-7 kernel: [<ffffffff814266f7>] ? cpuidle_idle_call+0xa7/0x140
  113. Aug 20 20:33:53 br1-7 kernel: [<ffffffff81009fc6>] ? cpu_idle+0xb6/0x110
  114. Aug 20 20:33:53 br1-7 kernel: [<ffffffff81520e13>] ? start_secondary+0x2ac/0x2ef
  115. Aug 20 20:33:53 br1-7 kernel: Clocksource tsc unstable (delta = -8589919981 ns).  Enable clocksource failover by adding clocksource_failover kernel parameter.
  116. Aug 20 20:35:02 br1-7 kernel: ------------[ cut here ]------------
  117. Aug 20 20:35:02 br1-7 kernel: WARNING: at net/sched/sch_generic.c:261 dev_watchdog+0x26b/0x280() (Not tainted)
  118. Aug 20 20:35:02 br1-7 kernel: Hardware name: PowerEdge R410
  119. Aug 20 20:35:02 br1-7 kernel: NETDEV WATCHDOG: p1p1 (ixgbe): transmit queue 22 timed out
  120. Aug 20 20:35:02 br1-7 kernel: Modules linked in: ebtable_filter iptable_raw httpcontentchange(U) xt_state xt_physdev iptable_mangle xt_MARK ebt_redirect ebt_ip ebtable_nat ebtables bridge ipt_LOG act_police cls_u32 sch_ingress sch_prio sch_sfq sch_htb ipip tunnel4 ip_gre ip_tunnel xt_TCPMSS xt_tcpmss nf_nat_ftp nf_conntrack_ftp iptable_nat iptable_filter ip_tables nf_nat_pptp nf_conntrack_pptp nf_conntrack_proto_gre nf_nat_proto_gre nf_nat nf_conntrack_ipv4 nf_conntrack nf_defrag_ipv4 8021q garp stp llc ipv6 dm_mod power_meter iTCO_wdt iTCO_vendor_support dcdbas serio_raw lpc_ich mfd_core ixgbe dca ptp pps_core mdio i7core_edac edac_core sg bnx2 ext4 jbd2 mbcache sd_mod crc_t10dif pata_acpi ata_generic ata_piix mptsas mptscsih mptbase scsi_transport_sas [last unloaded: scsi_wait_scan]
  121. Aug 20 20:35:02 br1-7 kernel: Pid: 0, comm: swapper Not tainted 2.6.32-431.el6.x86_64 #1
  122. Aug 20 20:35:02 br1-7 kernel: Call Trace:
  123. Aug 20 20:35:02 br1-7 kernel: <IRQ>  [<ffffffff81071e27>] ? warn_slowpath_common+0x87/0xc0
  124. Aug 20 20:35:02 br1-7 kernel: [<ffffffff81071f16>] ? warn_slowpath_fmt+0x46/0x50
  125. Aug 20 20:35:02 br1-7 kernel: [<ffffffff8147b74b>] ? dev_watchdog+0x26b/0x280
  126. Aug 20 20:35:02 br1-7 kernel: [<ffffffff813c6160>] ? rh_timer_func+0x0/0x10
  127. Aug 20 20:35:02 br1-7 kernel: [<ffffffff813c5890>] ? usb_hcd_poll_rh_status+0x140/0x180
  128. Aug 20 20:35:02 br1-7 kernel: [<ffffffff8105dd5c>] ? scheduler_tick+0xcc/0x260
  129. Aug 20 20:35:02 br1-7 kernel: [<ffffffff8147b4e0>] ? dev_watchdog+0x0/0x280
  130. Aug 20 20:35:02 br1-7 kernel: [<ffffffff81084b07>] ? run_timer_softirq+0x197/0x340
  131. Aug 20 20:35:02 br1-7 kernel: [<ffffffff810ac8f5>] ? tick_dev_program_event+0x65/0xc0
  132. Aug 20 20:35:02 br1-7 kernel: [<ffffffff8107a8e1>] ? __do_softirq+0xc1/0x1e0
  133. Aug 20 20:35:02 br1-7 kernel: [<ffffffff810ac9ca>] ? tick_program_event+0x2a/0x30
  134. Aug 20 20:35:02 br1-7 kernel: [<ffffffff8100c30c>] ? call_softirq+0x1c/0x30
  135. Aug 20 20:35:02 br1-7 kernel: [<ffffffff8100fa75>] ? do_softirq+0x65/0xa0
  136. Aug 20 20:35:02 br1-7 kernel: [<ffffffff8107a795>] ? irq_exit+0x85/0x90
  137. Aug 20 20:35:02 br1-7 kernel: [<ffffffff815310aa>] ? smp_apic_timer_interrupt+0x4a/0x60
  138. Aug 20 20:35:02 br1-7 kernel: [<ffffffff8100bb93>] ? apic_timer_interrupt+0x13/0x20
  139. Aug 20 20:35:02 br1-7 kernel: <EOI>  [<ffffffff812e09be>] ? intel_idle+0xde/0x170
  140. Aug 20 20:35:02 br1-7 kernel: [<ffffffff812e09a1>] ? intel_idle+0xc1/0x170
  141. Aug 20 20:35:02 br1-7 kernel: [<ffffffff814266f7>] ? cpuidle_idle_call+0xa7/0x140
  142. Aug 20 20:35:02 br1-7 kernel: [<ffffffff81009fc6>] ? cpu_idle+0xb6/0x110
  143. Aug 20 20:35:02 br1-7 kernel: [<ffffffff8150cbea>] ? rest_init+0x7a/0x80
  144. Aug 20 20:35:02 br1-7 kernel: [<ffffffff81c26f8f>] ? start_kernel+0x424/0x430
  145. Aug 20 20:35:02 br1-7 kernel: [<ffffffff81c2633a>] ? x86_64_start_reservations+0x125/0x129
  146. Aug 20 20:35:02 br1-7 kernel: [<ffffffff81c26453>] ? x86_64_start_kernel+0x115/0x124
  147. Aug 20 20:35:02 br1-7 kernel: ---[ end trace c8c3564c120a86fd ]---
  148. Aug 20 20:35:02 br1-7 kernel: ixgbe 0000:03:00.0: p1p1: initiating reset due to tx timeout
  149. Aug 20 20:35:36 br1-7 kernel: ixgbe 0000:03:00.0: p1p1: initiating reset due to tx timeout
  150. Aug 20 20:35:49 br1-7 kernel: ixgbe 0000:03:00.0: p1p1: Reset adapter
  151. Aug 20 20:36:57 br1-7 kernel: BUG: soft lockup - CPU#5 stuck for 71s! [ksoftirqd/5:25]
  152. Aug 20 20:36:57 br1-7 kernel: Modules linked in: ebtable_filter iptable_raw httpcontentchange(U) xt_state xt_physdev iptable_mangle xt_MARK ebt_redirect ebt_ip ebtable_nat ebtables bridge ipt_LOG act_police cls_u32 sch_ingress sch_prio sch_sfq sch_htb ipip tunnel4 ip_gre ip_tunnel xt_TCPMSS xt_tcpmss nf_nat_ftp nf_conntrack_ftp iptable_nat iptable_filter ip_tables nf_nat_pptp nf_conntrack_pptp nf_conntrack_proto_gre nf_nat_proto_gre nf_nat nf_conntrack_ipv4 nf_conntrack nf_defrag_ipv4 8021q garp stp llc ipv6 dm_mod power_meter iTCO_wdt iTCO_vendor_support dcdbas serio_raw lpc_ich mfd_core ixgbe dca ptp pps_core mdio i7core_edac edac_core sg bnx2 ext4 jbd2 mbcache sd_mod crc_t10dif pata_acpi ata_generic ata_piix mptsas mptscsih mptbase scsi_transport_sas [last unloaded: scsi_wait_scan]
  153. Aug 20 20:36:57 br1-7 kernel: CPU 5
  154. Aug 20 20:36:57 br1-7 kernel: Modules linked in: ebtable_filter iptable_raw httpcontentchange(U) xt_state xt_physdev iptable_mangle xt_MARK ebt_redirect ebt_ip ebtable_nat ebtables bridge ipt_LOG act_police cls_u32 sch_ingress sch_prio sch_sfq sch_htb ipip tunnel4 ip_gre ip_tunnel xt_TCPMSS xt_tcpmss nf_nat_ftp nf_conntrack_ftp iptable_nat iptable_filter ip_tables nf_nat_pptp nf_conntrack_pptp nf_conntrack_proto_gre nf_nat_proto_gre nf_nat nf_conntrack_ipv4 nf_conntrack nf_defrag_ipv4 8021q garp stp llc ipv6 dm_mod power_meter iTCO_wdt iTCO_vendor_support dcdbas serio_raw lpc_ich mfd_core ixgbe dca ptp pps_core mdio i7core_edac edac_core sg bnx2 ext4 jbd2 mbcache sd_mod crc_t10dif pata_acpi ata_generic ata_piix mptsas mptscsih mptbase scsi_transport_sas [last unloaded: scsi_wait_scan]
  155. Aug 20 20:36:57 br1-7 kernel:
  156. Aug 20 20:36:57 br1-7 kernel: Pid: 25, comm: ksoftirqd/5 Tainted: G        W  ---------------    2.6.32-431.el6.x86_64 #1 Dell Inc. PowerEdge R410/0N83VF
  157. Aug 20 20:36:57 br1-7 kernel: RIP: 0010:[<ffffffff8152a42b>]  [<ffffffff8152a42b>] _spin_lock_bh+0x2b/0x40
  158. Aug 20 20:36:57 br1-7 kernel: RSP: 0018:ffff880028243598  EFLAGS: 00000293
  159. Aug 20 20:36:57 br1-7 kernel: RAX: 0000000000001544 RBX: ffff8800282435a8 RCX: 0000000000000000
  160. Aug 20 20:36:57 br1-7 kernel: RDX: 0000000000001542 RSI: 0000000000000004 RDI: ffffffffa028f430
  161. Aug 20 20:36:57 br1-7 kernel: RBP: ffffffff8100bb93 R08: ffff88022a4f2020 R09: ffff880028243608
  162. Aug 20 20:36:57 br1-7 kernel: R10: ffff88010aba61e0 R11: ffff88012619a020 R12: ffff880028243510
  163. Aug 20 20:36:57 br1-7 kernel: R13: ffffffffa028f430 R14: ffff880028243500 R15: ffffffff815310a5
  164. Aug 20 20:36:57 br1-7 kernel: FS:  0000000000000000(0000) GS:ffff880028240000(0000) knlGS:0000000000000000
  165. Aug 20 20:36:57 br1-7 kernel: CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
  166. Aug 20 20:36:57 br1-7 kernel: CR2: 0000000000be0e80 CR3: 000000020b691000 CR4: 00000000000007e0
  167. Aug 20 20:36:57 br1-7 kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
  168. Aug 20 20:36:57 br1-7 kernel: DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
  169. Aug 20 20:36:57 br1-7 kernel: Process ksoftirqd/5 (pid: 25, threadinfo ffff88022e7fe000, task ffff88022e7f8aa0)
  170. Aug 20 20:36:57 br1-7 kernel: Stack:
  171. Aug 20 20:36:57 br1-7 kernel: 12bd146f00022168 ffff88022a4f2020 ffff8800282435e8 ffffffffa028e9f7
  172. Aug 20 20:36:57 br1-7 kernel: <d> ffff88012e1cc000 ffff88010aba6170 ffff8800cd077380 ffff880028243708
  173. Aug 20 20:36:57 br1-7 kernel: <d> ffff8800ca253430 ffff88010aba6370 ffff880028243618 ffffffffa028ebca
  174. Aug 20 20:36:57 br1-7 kernel: Call Trace:
  175. Aug 20 20:36:57 br1-7 kernel: <IRQ>
  176. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa028e9f7>] ? ipt_log_packet+0x47/0x1d0 [ipt_LOG]
  177. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa028ebca>] ? log_tg+0x4a/0x54 [ipt_LOG]
  178. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa023220b>] ? ipt_do_table+0x3cb/0x678 [ip_tables]
  179. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8144f912>] ? kfree_skb+0x42/0x90
  180. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa02320d5>] ? ipt_do_table+0x295/0x678 [ip_tables]
  181. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa023c224>] ? nf_nat_rule_find+0x24/0x80 [iptable_nat]
  182. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa023c4c1>] ? nf_nat_fn+0x111/0x260 [iptable_nat]
  183. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa023c738>] ? nf_nat_out+0x48/0xd0 [iptable_nat]
  184. Aug 20 20:36:57 br1-7 kernel: [<ffffffff814893a9>] ? nf_iterate+0x69/0xb0
  185. Aug 20 20:36:57 br1-7 kernel: [<ffffffff81499f90>] ? ip_finish_output+0x0/0x310
  186. Aug 20 20:36:57 br1-7 kernel: [<ffffffff81489566>] ? nf_hook_slow+0x76/0x120
  187. Aug 20 20:36:57 br1-7 kernel: [<ffffffff81499f90>] ? ip_finish_output+0x0/0x310
  188. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8149a344>] ? ip_output+0xa4/0xc0
  189. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8149562f>] ? ip_forward_finish+0x4f/0x60
  190. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8149583c>] ? ip_forward+0x1fc/0x430
  191. Aug 20 20:36:57 br1-7 kernel: [<ffffffff814939cd>] ? ip_rcv_finish+0x12d/0x440
  192. Aug 20 20:36:57 br1-7 kernel: [<ffffffff81493f55>] ? ip_rcv+0x275/0x350
  193. Aug 20 20:36:57 br1-7 kernel: [<ffffffff814893a9>] ? nf_iterate+0x69/0xb0
  194. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8145b54b>] ? __netif_receive_skb+0x4ab/0x750
  195. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8145f160>] ? netif_receive_skb+0x0/0x60
  196. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8145f1b8>] ? netif_receive_skb+0x58/0x60
  197. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa0295ad8>] ? br_handle_frame_finish+0x1e8/0x2a0 [bridge]
  198. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa029b938>] ? br_nf_pre_routing_finish+0x238/0x350 [bridge]
  199. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa029bedb>] ? br_nf_pre_routing+0x48b/0x7b0 [bridge]
  200. Aug 20 20:36:57 br1-7 kernel: [<ffffffff814893a9>] ? nf_iterate+0x69/0xb0
  201. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa02958f0>] ? br_handle_frame_finish+0x0/0x2a0 [bridge]
  202. Aug 20 20:36:57 br1-7 kernel: [<ffffffff81489566>] ? nf_hook_slow+0x76/0x120
  203. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa02958f0>] ? br_handle_frame_finish+0x0/0x2a0 [bridge]
  204. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa0295d1c>] ? br_handle_frame+0x18c/0x250 [bridge]
  205. Aug 20 20:36:57 br1-7 kernel: [<ffffffff81500220>] ? vlan_hwaccel_do_receive+0x70/0x130
  206. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8145b5c9>] ? __netif_receive_skb+0x529/0x750
  207. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8145f1b8>] ? netif_receive_skb+0x58/0x60
  208. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8145f2c0>] ? napi_skb_finish+0x50/0x70
  209. Aug 20 20:36:57 br1-7 kernel: [<ffffffff81500994>] ? vlan_gro_receive+0x84/0xa0
  210. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa013ae68>] ? ixgbe_poll+0xce8/0x12c0 [ixgbe]
  211. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa01ecbe9>] ? nf_conntrack_free+0x59/0x70 [nf_conntrack]
  212. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa01ed876>] ? destroy_conntrack+0xd6/0x150 [nf_conntrack]
  213. Aug 20 20:36:57 br1-7 kernel: [<ffffffff81460b43>] ? net_rx_action+0x103/0x2f0
  214. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8107a8e1>] ? __do_softirq+0xc1/0x1e0
  215. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8100c30c>] ? call_softirq+0x1c/0x30
  216. Aug 20 20:36:57 br1-7 kernel: <EOI>
  217. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8100fa75>] ? do_softirq+0x65/0xa0
  218. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8107a4a0>] ? ksoftirqd+0x80/0x110
  219. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8107a420>] ? ksoftirqd+0x0/0x110
  220. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8109aef6>] ? kthread+0x96/0xa0
  221. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8100c20a>] ? child_rip+0xa/0x20
  222. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8109ae60>] ? kthread+0x0/0xa0
  223. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8100c200>] ? child_rip+0x0/0x20
  224. Aug 20 20:36:57 br1-7 kernel: Code: 55 48 89 e5 53 48 83 ec 08 0f 1f 44 00 00 48 89 fb e8 8a f8 b4 ff b8 00 00 01 00 f0 0f c1 03 0f b7 d0 c1 e8 10 39 c2 74 0e f3 90 <0f> b7 13 eb f5 83 3b 00 75 f4 eb df 48 83 c4 08 5b c9 c3 66 90
  225. Aug 20 20:36:57 br1-7 kernel: Call Trace:
  226. Aug 20 20:36:57 br1-7 kernel: <IRQ>  [<ffffffff8152a416>] ? _spin_lock_bh+0x16/0x40
  227. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa028e9f7>] ? ipt_log_packet+0x47/0x1d0 [ipt_LOG]
  228. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa028ebca>] ? log_tg+0x4a/0x54 [ipt_LOG]
  229. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa023220b>] ? ipt_do_table+0x3cb/0x678 [ip_tables]
  230. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8144f912>] ? kfree_skb+0x42/0x90
  231. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa02320d5>] ? ipt_do_table+0x295/0x678 [ip_tables]
  232. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa023c224>] ? nf_nat_rule_find+0x24/0x80 [iptable_nat]
  233. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa023c4c1>] ? nf_nat_fn+0x111/0x260 [iptable_nat]
  234. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa023c738>] ? nf_nat_out+0x48/0xd0 [iptable_nat]
  235. Aug 20 20:36:57 br1-7 kernel: [<ffffffff814893a9>] ? nf_iterate+0x69/0xb0
  236. Aug 20 20:36:57 br1-7 kernel: [<ffffffff81499f90>] ? ip_finish_output+0x0/0x310
  237. Aug 20 20:36:57 br1-7 kernel: [<ffffffff81489566>] ? nf_hook_slow+0x76/0x120
  238. Aug 20 20:36:57 br1-7 kernel: [<ffffffff81499f90>] ? ip_finish_output+0x0/0x310
  239. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8149a344>] ? ip_output+0xa4/0xc0
  240. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8149562f>] ? ip_forward_finish+0x4f/0x60
  241. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8149583c>] ? ip_forward+0x1fc/0x430
  242. Aug 20 20:36:57 br1-7 kernel: [<ffffffff814939cd>] ? ip_rcv_finish+0x12d/0x440
  243. Aug 20 20:36:57 br1-7 kernel: [<ffffffff81493f55>] ? ip_rcv+0x275/0x350
  244. Aug 20 20:36:57 br1-7 kernel: [<ffffffff814893a9>] ? nf_iterate+0x69/0xb0
  245. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8145b54b>] ? __netif_receive_skb+0x4ab/0x750
  246. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8145f160>] ? netif_receive_skb+0x0/0x60
  247. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8145f1b8>] ? netif_receive_skb+0x58/0x60
  248. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa0295ad8>] ? br_handle_frame_finish+0x1e8/0x2a0 [bridge]
  249. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa029b938>] ? br_nf_pre_routing_finish+0x238/0x350 [bridge]
  250. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa029bedb>] ? br_nf_pre_routing+0x48b/0x7b0 [bridge]
  251. Aug 20 20:36:57 br1-7 kernel: [<ffffffff814893a9>] ? nf_iterate+0x69/0xb0
  252. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa02958f0>] ? br_handle_frame_finish+0x0/0x2a0 [bridge]
  253. Aug 20 20:36:57 br1-7 kernel: [<ffffffff81489566>] ? nf_hook_slow+0x76/0x120
  254. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa02958f0>] ? br_handle_frame_finish+0x0/0x2a0 [bridge]
  255. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa0295d1c>] ? br_handle_frame+0x18c/0x250 [bridge]
  256. Aug 20 20:36:57 br1-7 kernel: [<ffffffff81500220>] ? vlan_hwaccel_do_receive+0x70/0x130
  257. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8145b5c9>] ? __netif_receive_skb+0x529/0x750
  258. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8145f1b8>] ? netif_receive_skb+0x58/0x60
  259. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8145f2c0>] ? napi_skb_finish+0x50/0x70
  260. Aug 20 20:36:57 br1-7 kernel: [<ffffffff81500994>] ? vlan_gro_receive+0x84/0xa0
  261. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa013ae68>] ? ixgbe_poll+0xce8/0x12c0 [ixgbe]
  262. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa01ecbe9>] ? nf_conntrack_free+0x59/0x70 [nf_conntrack]
  263. Aug 20 20:36:57 br1-7 kernel: [<ffffffffa01ed876>] ? destroy_conntrack+0xd6/0x150 [nf_conntrack]
  264. Aug 20 20:36:57 br1-7 kernel: [<ffffffff81460b43>] ? net_rx_action+0x103/0x2f0
  265. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8107a8e1>] ? __do_softirq+0xc1/0x1e0
  266. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8100c30c>] ? call_softirq+0x1c/0x30
  267. Aug 20 20:36:57 br1-7 kernel: <EOI>  [<ffffffff8100fa75>] ? do_softirq+0x65/0xa0
  268. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8107a4a0>] ? ksoftirqd+0x80/0x110
  269. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8107a420>] ? ksoftirqd+0x0/0x110
  270. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8109aef6>] ? kthread+0x96/0xa0
  271. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8100c20a>] ? child_rip+0xa/0x20
  272. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8109ae60>] ? kthread+0x0/0xa0
  273. Aug 20 20:36:57 br1-7 kernel: [<ffffffff8100c200>] ? child_rip+0x0/0x20
  274. Aug 20 20:36:57 br1-7 kernel: RES=0x00 SYN URGP=0 MARK=0xa
  275. Aug 20 20:37:04 br1-7 kernel: Clocksource tsc unstable (delta = -8589922803 ns).  Enable clocksource failover by adding clocksource_failover kernel parameter.
  276. Aug 20 20:37:04 br1-7 kernel: PHYSIN=p1p2.1017 SRC=106.74.24.238 DST=58.251.139.210 LEN=64 TOS=0x00 PREC=0x00 TTL=56 ID=44707 DF PROTO=TCP SPT=51061 DPT=443 WINDOW=65535 RES=0x00 SYN URGP=0 MARK=0xa
  277. Aug 20 20:37:18 br1-7 kernel: Clocksource tsc unstable (delta = -8589923406 ns).  Enable clocksource failover by adding clocksource_failover kernel parameter.
  278. Aug 20 20:37:18 br1-7 kernel: PHYSIN=p1p2.1017 SRC=106.74.24.250 DST=1.28.145.96 LEN=116 TOS=0x00 PREC=0x00 TTL=120 ID=65088 PROTO=UDP SPT=19107 DPT=17788 LEN=96 MARK=0xa
  279. Aug 20 20:37:57 br1-7 kernel: BUG: soft lockup - CPU#8 stuck for 65s! [ksoftirqd/8:37]
  280. Aug 20 20:37:57 br1-7 kernel: Modules linked in: ebtable_filter iptable_raw httpcontentchange(U) xt_state xt_physdev iptable_mangle xt_MARK ebt_redirect ebt_ip ebtable_nat ebtables bridge ipt_LOG act_police cls_u32 sch_ingress sch_prio sch_sfq sch_htb ipip tunnel4 ip_gre ip_tunnel xt_TCPMSS xt_tcpmss nf_nat_ftp nf_conntrack_ftp iptable_nat iptable_filter ip_tables nf_nat_pptp nf_conntrack_pptp nf_conntrack_proto_gre nf_nat_proto_gre nf_nat nf_conntrack_ipv4 nf_conntrack nf_defrag_ipv4 8021q garp stp llc ipv6 dm_mod power_meter iTCO_wdt iTCO_vendor_support dcdbas serio_raw lpc_ich mfd_core ixgbe dca ptp pps_core mdio i7core_edac edac_core sg bnx2 ext4 jbd2 mbcache sd_mod crc_t10dif pata_acpi ata_generic ata_piix mptsas mptscsih mptbase scsi_transport_sas [last unloaded: scsi_wait_scan]
  281. Aug 20 20:37:57 br1-7 kernel: CPU 8
  282. Aug 20 20:37:57 br1-7 kernel: Modules linked in: ebtable_filter iptable_raw httpcontentchange(U) xt_state xt_physdev iptable_mangle xt_MARK ebt_redirect ebt_ip ebtable_nat ebtables bridge ipt_LOG act_police cls_u32 sch_ingress sch_prio sch_sfq sch_htb ipip tunnel4 ip_gre ip_tunnel xt_TCPMSS xt_tcpmss nf_nat_ftp nf_conntrack_ftp iptable_nat iptable_filter ip_tables nf_nat_pptp nf_conntrack_pptp nf_conntrack_proto_gre nf_nat_proto_gre nf_nat nf_conntrack_ipv4 nf_conntrack nf_defrag_ipv4 8021q garp stp llc ipv6 dm_mod power_meter iTCO_wdt iTCO_vendor_support dcdbas serio_raw lpc_ich mfd_core ixgbe dca ptp pps_core mdio i7core_edac edac_core sg bnx2 ext4 jbd2 mbcache sd_mod crc_t10dif pata_acpi ata_generic ata_piix mptsas mptscsih mptbase scsi_transport_sas [last unloaded: scsi_wait_scan]
  283. Aug 20 20:37:57 br1-7 kernel:
  284. Aug 20 20:37:57 br1-7 kernel: Pid: 37, comm: ksoftirqd/8 Tainted: G        W  ---------------    2.6.32-431.el6.x86_64 #1 Dell Inc. PowerEdge R410/0N83VF
  285. Aug 20 20:37:57 br1-7 kernel: RIP: 0010:[<ffffffff8152a42b>]  [<ffffffff8152a42b>] _spin_lock_bh+0x2b/0x40
  286. Aug 20 20:37:57 br1-7 kernel: RSP: 0018:ffff880133c83598  EFLAGS: 00000297
  287. Aug 20 20:37:57 br1-7 kernel: RAX: 00000000000017c3 RBX: ffff880133c835a8 RCX: 0000000000000000
  288. Aug 20 20:37:57 br1-7 kernel: RDX: 00000000000017c2 RSI: 0000000000000004 RDI: ffffffffa028f430
  289. Aug 20 20:37:57 br1-7 kernel: RBP: ffffffff8100bb93 R08: ffff88022a4f2020 R09: ffff880133c83608
  290. Aug 20 20:37:57 br1-7 kernel: R10: ffff88020c4049e0 R11: ffff88012619a020 R12: ffff880133c83510
  291. Aug 20 20:37:57 br1-7 kernel: R13: ffffffffa028f430 R14: ffff880133c83500 R15: ffffffff815310a5
  292. Aug 20 20:37:57 br1-7 kernel: FS:  0000000000000000(0000) GS:ffff880133c80000(0000) knlGS:0000000000000000
  293. Aug 20 20:37:57 br1-7 kernel: CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
  294. Aug 20 20:37:57 br1-7 kernel: CR2: 00007fee4063fc7f CR3: 000000022adf0000 CR4: 00000000000007e0
  295. Aug 20 20:37:57 br1-7 kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
  296. Aug 20 20:37:57 br1-7 kernel: DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
  297. Aug 20 20:37:57 br1-7 kernel: Process ksoftirqd/8 (pid: 37, threadinfo ffff88022e074000, task ffff88022e073540)
  298. Aug 20 20:37:57 br1-7 kernel: Stack:
  299. Aug 20 20:37:57 br1-7 kernel: ffff880133c83608 ffff88022a4f2020 ffff880133c835e8 ffffffffa028e9f7
  300. Aug 20 20:37:57 br1-7 kernel: <d> ffff880133c83628 ffff88020c404970 ffff88020d123e80 ffff880133c83708
  301. Aug 20 20:37:57 br1-7 kernel: <d> ffff8801f3194030 ffff88020c404b70 ffff880133c83618 ffffffffa028ebca
  302. Aug 20 20:37:57 br1-7 kernel: Call Trace:
  303. Aug 20 20:37:57 br1-7 kernel: <IRQ>
  304. Aug 20 20:37:57 br1-7 kernel: [<ffffffffa028e9f7>] ? ipt_log_packet+0x47/0x1d0 [ipt_LOG]
  305. Aug 20 20:37:57 br1-7 kernel: [<ffffffffa028ebca>] ? log_tg+0x4a/0x54 [ipt_LOG]
  306. Aug 20 20:37:57 br1-7 kernel: [<ffffffffa023220b>] ? ipt_do_table+0x3cb/0x678 [ip_tables]
  307. Aug 20 20:37:57 br1-7 kernel: [<ffffffff8144f7f7>] ? __kfree_skb+0x47/0xa0
  308. Aug 20 20:37:57 br1-7 kernel: [<ffffffff8144f912>] ? kfree_skb+0x42/0x90
  309. Aug 20 20:37:57 br1-7 kernel: [<ffffffff8147bdaf>] ? __qdisc_run+0x3f/0xe0
  310. Aug 20 20:37:57 br1-7 kernel: [<ffffffffa02320d5>] ? ipt_do_table+0x295/0x678 [ip_tables]
  311. Aug 20 20:37:57 br1-7 kernel: [<ffffffffa023c224>] ? nf_nat_rule_find+0x24/0x80 [iptable_nat]
  312. Aug 20 20:37:57 br1-7 kernel: [<ffffffffa023c4c1>] ? nf_nat_fn+0x111/0x260 [iptable_nat]
  313. Aug 20 20:37:57 br1-7 kernel: [<ffffffffa023c738>] ? nf_nat_out+0x48/0xd0 [iptable_nat]
  314. Aug 20 20:37:57 br1-7 kernel: [<ffffffff814893a9>] ? nf_iterate+0x69/0xb0
  315. Aug 20 20:37:57 br1-7 kernel: [<ffffffff81499f90>] ? ip_finish_output+0x0/0x310
  316. Aug 20 20:37:57 br1-7 kernel: [<ffffffff81489566>] ? nf_hook_slow+0x76/0x120
  317. Aug 20 20:37:57 br1-7 kernel: [<ffffffff81499f90>] ? ip_finish_output+0x0/0x310
  318. Aug 20 20:37:57 br1-7 kernel: [<ffffffff8149a344>] ? ip_output+0xa4/0xc0
  319. Aug 20 20:37:57 br1-7 kernel: [<ffffffff8149562f>] ? ip_forward_finish+0x4f/0x60
  320. Aug 20 20:37:57 br1-7 kernel: [<ffffffff8149583c>] ? ip_forward+0x1fc/0x430
  321. Aug 20 20:37:57 br1-7 kernel: [<ffffffff814939cd>] ? ip_rcv_finish+0x12d/0x440
  322. Aug 20 20:37:57 br1-7 kernel: [<ffffffff81493f55>] ? ip_rcv+0x275/0x350
  323. Aug 20 20:37:57 br1-7 kernel: [<ffffffff814893a9>] ? nf_iterate+0x69/0xb0
  324. Aug 20 20:37:57 br1-7 kernel: [<ffffffff8145b54b>] ? __netif_receive_skb+0x4ab/0x750
  325. Aug 20 20:37:57 br1-7 kernel: [<ffffffff8145f160>] ? netif_receive_skb+0x0/0x60
  326. Aug 20 20:37:57 br1-7 kernel: [<ffffffff8145f1b8>] ? netif_receive_skb+0x58/0x60
  327. Aug 20 20:37:57 br1-7 kernel: [<ffffffffa0295ad8>] ? br_handle_frame_finish+0x1e8/0x2a0 [bridge]
  328. Aug 20 20:37:57 br1-7 kernel: [<ffffffffa029b938>] ? br_nf_pre_routing_finish+0x238/0x350 [bridge]
  329. Aug 20 20:37:57 br1-7 kernel: [<ffffffffa029bedb>] ? br_nf_pre_routing+0x48b/0x7b0 [bridge]
  330. Aug 20 20:37:57 br1-7 kernel: [<ffffffff814893a9>] ? nf_iterate+0x69/0xb0
  331. Aug 20 20:37:57 br1-7 kernel: [<ffffffffa02958f0>] ? br_handle_frame_finish+0x0/0x2a0 [bridge]
  332. Aug 20 20:37:57 br1-7 kernel: [<ffffffff81489566>] ? nf_hook_slow+0x76/0x120
  333. Aug 20 20:37:57 br1-7 kernel: [<ffffffffa02958f0>] ? br_handle_frame_finish+0x0/0x2a0 [bridge]
  334. Aug 20 20:37:57 br1-7 kernel: [<ffffffffa0295d1c>] ? br_handle_frame+0x18c/0x250 [bridge]
  335. Aug 20 20:37:57 br1-7 kernel: [<ffffffff81500220>] ? vlan_hwaccel_do_receive+0x70/0x130
  336. Aug 20 20:37:57 br1-7 kernel: [<ffffffff8145b5c9>] ? __netif_receive_skb+0x529/0x750
  337. Aug 20 20:37:57 br1-7 kernel: [<ffffffff8145f1b8>] ? netif_receive_skb+0x58/0x60
  338. Aug 20 20:37:57 br1-7 kernel: [<ffffffff8145f2c0>] ? napi_skb_finish+0x50/0x70
  339. Aug 20 20:37:57 br1-7 kernel: [<ffffffff81500994>] ? vlan_gro_receive+0x84/0xa0
  340. Aug 20 20:37:57 br1-7 kernel: [<ffffffffa013ae68>] ? ixgbe_poll+0xce8/0x12c0 [ixgbe]
  341. Aug 20 20:37:57 br1-7 kernel: [<ffffffff8145b5c9>] ? __netif_receive_skb+0x529/0x750
  342. Aug 20 20:37:57 br1-7 kernel: [<ffffffff81460b43>] ? net_rx_action+0x103/0x2f0
  343. Aug 20 20:37:57 br1-7 kernel: [<ffffffff8107a8e1>] ? __do_softirq+0xc1/0x1e0
  344. Aug 20 20:37:57 br1-7 kernel: [<ffffffff8100c30c>] ? call_softirq+0x1c/0x30
  345. Aug 20 20:37:57 br1-7 kernel: <EOI>
  346. Aug 20 20:37:57 br1-7 kernel: [<ffffffff8100fa75>] ? do_softirq+0x65/0xa0
  347. Aug 20 20:37:57 br1-7 kernel: [<ffffffff8107a4a0>] ? ksoftirqd+0x80/0x110
  348. Aug 20 20:37:57 br1-7 kernel: [<ffffffff8107a420>] ? ksoftirqd+0x0/0x110
  349. Aug 20 20:37:57 br1-7 kernel: [<ffffffff8109aef6>] ? kthread+0x96/0xa0
  350. Aug 20 20:37:57 br1-7 kernel: [<ffffffff8100c20a>] ? child_rip+0xa/0x20
  351. Aug 20 20:37:57 br1-7 kernel: [<ffffffff8109ae60>] ? kthread+0x0/0xa0
  352. Aug 20 20:37:57 br1-7 kernel: [<ffffffff8100c200>] ? child_rip+0x0/0x20
  353. Aug 20 20:37:57 br1-7 kernel: Code: 55 48 89 e5 53 48 83 ec 08 0f 1f 44 00 00 48 89 fb e8 8a f8 b4 ff b8 00 00 01 00 f0 0f c1 03 0f b7 d0 c1 e8 10 39 c2 74 0e f3 90 <0f> b7 13 eb f5 83 3b 00 75 f4 eb df 48 83 c4 08 5b c9 c3 66 90


复制代码

论坛徽章:
1
金牛座
日期:2014-05-29 15:55:47
发表于 2015-08-21 13:30 |显示全部楼层
完整错误信息见附件。

系统错误信息.zip

31.93 KB, 下载次数: 7

论坛徽章:
1
2017金鸡报晓
日期:2017-01-10 15:13:29
发表于 2015-08-21 16:44 |显示全部楼层
哇,跟我现在做的东西一样

论坛徽章:
1
2017金鸡报晓
日期:2017-01-10 15:13:29
发表于 2015-08-31 15:22 |显示全部楼层
我不能回复站内信息,你贴出来的死机信息是一次的死机信息,还是很多次的,内核是什么版本的回复 2# iceblood


   

论坛徽章:
0
发表于 2015-10-09 21:51 |显示全部楼层
本帖最后由 jhl19880722 于 2015-10-09 22:29 编辑

nf_nat_mangle_tcp_packet,里面有没有可能收到的skb不是线性的数据,但是在nf_nat_mangle_tcp_packet和mangle_contents中都有判断线性的bug_on,不知道内核中有没有把debug打开,瞎猜的。
您需要登录后才可以回帖 登录 | 注册

本版积分规则 发表回复

基于案例的 SQL 优化实战训练营

讲师:中电福富特级专家梁敬彬,参与本次课程培训,你将收获:
1. 能编写出较为高效的 SQL;
2. 能解决70%以上的数据库常见优化问题;
3. 能得到老师提供的高效的相关工具和解决方案;
4. 能举一反三,收获不仅仅是 SQL 优化。
现在购票享受8.8折优惠!
----------------------------------------
优惠时间:2019年3月20日前

大会官网>>
  

北京盛拓优讯信息技术有限公司. 版权所有 16024965号-6 北京市公安局海淀分局网监中心备案编号:11010802020122
中国互联网协会会员  联系我们:huangweiwei@it168.com
感谢所有关心和支持过ChinaUnix的朋友们 转载本站内容请注明原作者名及出处

清除 Cookies - ChinaUnix - Archiver - WAP - TOP