apache和php的环境，最近出现out of memory的问题

zhsh87

下面是报错是message日志

Jan 15 21:16:31 CentOS5-cms-vm2 kernel: Mem-info:
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: DMA per-cpu:
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 0 hot: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 0 cold: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 1 hot: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 1 cold: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 2 hot: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 2 cold: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 3 hot: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 3 cold: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 4 hot: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 4 cold: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 5 hot: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 5 cold: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 6 hot: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 6 cold: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 7 hot: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 7 cold: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 8 hot: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 8 cold: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 9 hot: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 9 cold: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 10 hot: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 10 cold: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 11 hot: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 11 cold: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 12 hot: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 12 cold: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 13 hot: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 13 cold: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 14 hot: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 14 cold: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 15 hot: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 15 cold: high 0, batch 1 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: DMA32 per-cpu: empty
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: Normal per-cpu:
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 0 hot: high 186, batch 31 used:80
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 0 cold: high 62, batch 15 used:54
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 1 hot: high 186, batch 31 used:155
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 1 cold: high 62, batch 15 used:48
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 2 hot: high 186, batch 31 used:156
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 2 cold: high 62, batch 15 used:60
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 3 hot: high 186, batch 31 used:70
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 3 cold: high 62, batch 15 used:55
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 4 hot: high 186, batch 31 used:171
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 4 cold: high 62, batch 15 used:54
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 5 hot: high 186, batch 31 used:56
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 5 cold: high 62, batch 15 used:57
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 6 hot: high 186, batch 31 used:93
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 6 cold: high 62, batch 15 used:51
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 7 hot: high 186, batch 31 used:182
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 7 cold: high 62, batch 15 used:61
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 8 hot: high 186, batch 31 used:147
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 8 cold: high 62, batch 15 used:51
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 9 hot: high 186, batch 31 used:52
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 9 cold: high 62, batch 15 used:54
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 10 hot: high 186, batch 31 used:184
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 10 cold: high 62, batch 15 used:59
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 11 hot: high 186, batch 31 used:30
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 11 cold: high 62, batch 15 used:52
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 12 hot: high 186, batch 31 used:30
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 12 cold: high 62, batch 15 used:59
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 13 hot: high 186, batch 31 used:161
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 13 cold: high 62, batch 15 used:54
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 14 hot: high 186, batch 31 used:35
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 14 cold: high 62, batch 15 used:58
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 15 hot: high 186, batch 31 used:43
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 15 cold: high 62, batch 15 used:55
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: HighMem per-cpu:
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 0 hot: high 186, batch 31 used:179
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 0 cold: high 62, batch 15 used:9
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 1 hot: high 186, batch 31 used:152
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 1 cold: high 62, batch 15 used:6
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 2 hot: high 186, batch 31 used:147
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 2 cold: high 62, batch 15 used:10
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 3 hot: high 186, batch 31 used:185
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 3 cold: high 62, batch 15 used:8
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 4 hot: high 186, batch 31 used:162
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 4 cold: high 62, batch 15 used:3
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 5 hot: high 186, batch 31 used:170
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 5 cold: high 62, batch 15 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 6 hot: high 186, batch 31 used:18
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 6 cold: high 62, batch 15 used:12
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 7 hot: high 186, batch 31 used:160
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 7 cold: high 62, batch 15 used:2
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 8 hot: high 186, batch 31 used:163
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 8 cold: high 62, batch 15 used:1
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 9 hot: high 186, batch 31 used:170
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 9 cold: high 62, batch 15 used:7
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 10 hot: high 186, batch 31 used:184
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 10 cold: high 62, batch 15 used:5
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 11 hot: high 186, batch 31 used:80
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 11 cold: high 62, batch 15 used:5
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 12 hot: high 186, batch 31 used:62
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 12 cold: high 62, batch 15 used:8
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 13 hot: high 186, batch 31 used:147
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 13 cold: high 62, batch 15 used:9
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 14 hot: high 186, batch 31 used:33
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 14 cold: high 62, batch 15 used:5
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 15 hot: high 186, batch 31 used:178
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: cpu 15 cold: high 62, batch 15 used:0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: Free pages:      398252kB (392000kB HighMem)
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: Active:355818 inactive:928781 dirty:2 writeback:0 unstable:0 free:99563 slab:164979 mapped-file:4564 mapped-anon:19692 pagetables:841
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: DMA free:2916kB min:72kB low:88kB high:108kB active:12kB inactive:0kB present:16384kB pages_scanned:76 all_unreclaimable? yes
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: lowmem_reserve[]: 0 0 711 6136
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: DMA32 free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: lowmem_reserve[]: 0 0 711 6136
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: Normal free:3336kB min:3376kB low:4220kB high:5064kB active:180kB inactive:136kB present:729080kB pages_scanned:1282 all_unreclaimable? yes
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: lowmem_reserve[]: 0 0 0 43392
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: HighMem free:392000kB min:512kB low:6940kB high:13368kB active:1423080kB inactive:3714988kB present:5554184kB pages_scanned:0 all_unreclaimable? no
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: lowmem_reserve[]: 0 0 0 0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: DMA: 1*4kB 0*8kB 0*16kB 1*32kB 1*64kB 0*128kB 1*256kB 1*512kB 0*1024kB 1*2048kB 0*4096kB = 2916kB
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: DMA32: empty
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: Normal: 16*4kB 5*8kB 12*16kB 3*32kB 0*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 1*2048kB 0*4096kB = 3336kB
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: HighMem: 42222*4kB 20247*8kB 2909*16kB 186*32kB 21*64kB 5*128kB 2*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 392000kB
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: 1264941 pagecache pages
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: Swap cache: add 12, delete 0, find 0/0, race 0+0
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: Free swap  = 8385840kB
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: Total swap = 8385888kB
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: Free swap:       8385840kB
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: 1574912 pages of RAM
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: 1388546 pages of HIGHMEM
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: 15630 reserved pages
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: 63347 pages shared
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: 12 pages swap cached
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: 0 pages dirty
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: 0 pages writeback
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: 4564 pages mapped
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: 164979 pages slab
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: 841 pages pagetables
Jan 15 21:16:31 CentOS5-cms-vm2 kernel: Out of memory: Killed process 2371, UID 99, (httpd).
Jan 15 21:37:16 CentOS5-cms-vm2 kernel: INFO: task httpd:4438 blocked for more than 120 seconds.
Jan 15 21:37:16 CentOS5-cms-vm2 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 15 21:37:16 CentOS5-cms-vm2 kernel: httpd         D 00D0D3B1  3384  4438   2531          4502  4342 (NOTLB)
Jan 15 21:37:16 CentOS5-cms-vm2 kernel:        cf56df0c 00200286 8c2290a4 00d0d3b1 00000000 0000000a c4ae0aa0 8c22b6b9
Jan 15 21:37:16 CentOS5-cms-vm2 kernel:        00d0d3b1 00002615 c4ae0bac c103a108 e9ad13c0 c062121c ffffffff 00d0d3b1
Jan 15 21:37:16 CentOS5-cms-vm2 kernel:        c0434770 0000000a c113e550 50882486 00000000 00000000 e9ad13f8 e9ad13f8
Jan 15 21:37:16 CentOS5-cms-vm2 kernel: Call Trace:
Jan 15 21:37:16 CentOS5-cms-vm2 kernel:  [<c062121c>] schedule+0x7c0/0x84d
Jan 15 21:37:16 CentOS5-cms-vm2 kernel:  [<c0434770>] ktime_get_ts+0x16/0x44
Jan 15 21:37:16 CentOS5-cms-vm2 kernel:  [<c06226e7>] rwsem_down_read_failed+0x12c/0x147
Jan 15 21:37:16 CentOS5-cms-vm2 kernel:  [<c0434439>] lock_hrtimer_base+0x19/0x35
Jan 15 21:37:16 CentOS5-cms-vm2 kernel:  [<c0434b17>] .text.lock.rwsem+0x35/0x3a
Jan 15 21:37:16 CentOS5-cms-vm2 kernel:  [<c0623f13>] do_page_fault+0x636/0xc29
Jan 15 21:37:16 CentOS5-cms-vm2 kernel:  [<c0434621>] hrtimer_nanosleep+0x50/0x106
Jan 15 21:37:16 CentOS5-cms-vm2 kernel:  [<c042b307>] do_sigaction+0x14d/0x15d
Jan 15 21:37:16 CentOS5-cms-vm2 kernel:  [<c0434408>] hrtimer_wakeup+0x0/0x18
Jan 15 21:37:16 CentOS5-cms-vm2 kernel:  [<c0429e34>] sigprocmask+0xcc/0xd2
Jan 15 21:37:16 CentOS5-cms-vm2 kernel:  [<c06238dd>] do_page_fault+0x0/0xc29
Jan 15 21:37:16 CentOS5-cms-vm2 kernel:  [<c04055e7>] error_code+0x2b/0x30
Jan 15 21:37:16 CentOS5-cms-vm2 kernel:  =======================

openspace

服务器上跑了其他应用？
内存被用的太多，httpd被干掉了

zhengwei_zw

Out of memory: Killed process 2371 OOM了。加内存吧，或者把php的内存限制小一点咯。

shang2010

插件的事情，没给足钱请好劳动力