task bash:10434 blocked for more than 120 seconds

microsoft_fly

系统日志如下，不知道是不是哪里不正常？！

May 26 05:09:13 appsrv kernel:  [<ffffffff88050511>] :ext3:ext3_ordered_writepage+0x0/0x19c
May 26 05:09:52 appsrv kernel:  [<ffffffff8005a878>] do_writepages+0x29/0x2f
May 26 05:09:57 appsrv kernel:  [<ffffffff8002f95c>] __writeback_single_inode+0x1a2/0x31c
May 26 05:10:01 appsrv kernel:  [<ffffffff8804d98d>] :ext3:ext3_mark_iloc_dirty+0x300/0x368
May 26 05:10:23 appsrv kernel:  [<ffffffff80021035>] sync_sb_inodes+0x1b7/0x271
May 26 05:10:29 appsrv kernel:  [<ffffffff80050cda>] writeback_inodes+0x82/0xd8
May 26 05:10:35 appsrv kernel:  [<ffffffff800ccb75>] balance_dirty_pages_ratelimited_nr+0x16d/0x27a
May 26 05:10:42 appsrv kernel:  [<ffffffff8000ff1a>] generic_file_buffered_write+0x20b/0x6a9
May 26 05:10:46 appsrv kernel:  [<ffffffff880317be>] :srv:journal_stop+0x1f7/0x203
May 26 05:10:52 appsrv kernel:  [<ffffffff80016755>] __generic_file_aio_write_nolock+0x369/0x3b6
May 26 05:10:55 appsrv kernel:  [<ffffffff80063833>] schedule_timeout+0x1e/0xad
May 26 05:11:00 appsrv kernel:  [<ffffffff800218b1>] generic_file_aio_write+0x67/0xc3
May 26 05:11:04 appsrv kernel:  [<ffffffff8804c1c2>] :ext3:ext3_file_write+0x16/0x91
May 26 05:11:15 appsrv kernel:  [<ffffffff800183e0>] do_sync_write+0xc7/0x104
May 26 05:11:19 appsrv kernel:  [<ffffffff800a3444>] autoremove_wake_function+0x0/0x2e
May 26 05:11:25 appsrv kernel:  [<ffffffff800e37df>] sys_fstatfs+0x57/0x68
May 26 05:11:29 appsrv kernel:  [<ffffffff80016b5d>] vfs_write+0xce/0x174
May 26 05:11:33 appsrv kernel:  [<ffffffff80017426>] sys_write+0x45/0x6e
May 26 05:11:37 appsrv kernel:  [<ffffffff8005d116>] system_call+0x7e/0x83
May 26 05:11:42 appsrv kernel:
May 26 05:11:46 appsrv kernel: INFO: task auditd:6608 blocked for more than 120 seconds.
May 26 05:11:49 appsrv kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 26 05:11:52 appsrv kernel: auditd        D ffffffff80156347     0  6608      1          6628  6607 (NOTLB)
May 26 05:11:57 appsrv kernel:  ffff81102c6f37b8 0000000000000082 ffff810659b21cf0 ffffffff8804d98d
May 26 05:12:00 appsrv kernel:  ffff81102c6f3758 000000000000000a ffff81102de0d7e0 ffff81102fd55040
May 26 05:12:05 appsrv kernel:  00006e76d9743aac 00000000000077ab ffff81102de0d9c8 000000108000b478
May 26 05:12:14 appsrv kernel: Call Trace:
May 26 05:12:19 appsrv kernel:  [<ffffffff8804d98d>] :ext3:ext3_mark_iloc_dirty+0x300/0x368
May 26 05:12:32 appsrv kernel:  [<ffffffff8804ddc2>] :ext3:ext3_mark_inode_dirty+0x33/0x3c
May 26 05:12:56 appsrv kernel:  [<ffffffff80063c63>] __mutex_lock_slowpath+0x60/0x9b
May 26 05:13:29 appsrv kernel:  [<ffffffff80063cad>] .text.lock.mutex+0xf/0x14
May 26 05:15:34 appsrv kernel:  [<ffffffff8804d98d>] :ext3:ext3_mark_iloc_dirty+0x300/0x368
May 26 05:19:45 appsrv kernel:  [<ffffffff8803596b>] :srv:__log_wait_for_space+0x53/0xac
May 26 05:21:33 appsrv kernel:  [<ffffffff88032046>] :srv:start_this_handle+0x327/0x370
May 26 05:22:57 appsrv kernel:  [<ffffffff88032ee5>] :srv:journal_dirty_metadata+0x1bf/0x1ee
May 26 05:24:36 appsrv kernel:  [<ffffffff8803215a>] :srv:journal_start+0xcb/0x102
May 26 05:25:10 appsrv kernel:  [<ffffffff88050590>] :ext3:ext3_ordered_writepage+0x7f/0x19c
May 26 05:25:49 appsrv kernel:  [<ffffffff8001d0c3>] mpage_writepages+0x1bf/0x37d
May 26 05:26:01 appsrv kernel:  [<ffffffff88050511>] :ext3:ext3_ordered_writepage+0x0/0x19c
May 26 05:26:29 appsrv kernel:  [<ffffffff8005a878>] do_writepages+0x29/0x2f
May 26 05:26:41 appsrv kernel:  [<ffffffff8002f95c>] __writeback_single_inode+0x1a2/0x31c
May 26 05:26:47 appsrv kernel:  [<ffffffff8804d98d>] :ext3:ext3_mark_iloc_dirty+0x300/0x368
May 26 05:27:01 appsrv kernel:  [<ffffffff80021035>] sync_sb_inodes+0x1b7/0x271
May 26 05:27:34 appsrv kernel:  [<ffffffff80050cda>] writeback_inodes+0x82/0xd8
May 26 05:28:20 appsrv kernel:  [<ffffffff800ccb75>] balance_dirty_pages_ratelimited_nr+0x16d/0x27a
May 26 05:29:07 appsrv kernel:  [<ffffffff8000ff1a>] generic_file_buffered_write+0x20b/0x6a9
May 26 05:30:58 appsrv kernel:  [<ffffffff880317be>] :srv:journal_stop+0x1f7/0x203
May 26 05:32:43 appsrv kernel:  [<ffffffff80016755>] __generic_file_aio_write_nolock+0x369/0x3b6
May 26 05:34:35 appsrv kernel:  [<ffffffff80063833>] schedule_timeout+0x1e/0xad
May 26 05:36:06 appsrv kernel:  [<ffffffff800218b1>] generic_file_aio_write+0x67/0xc3
May 26 05:37:28 appsrv kernel:  [<ffffffff8804c1c2>] :ext3:ext3_file_write+0x16/0x91
May 26 05:38:04 appsrv kernel:  [<ffffffff800183e0>] do_sync_write+0xc7/0x104
May 26 05:39:07 appsrv kernel:  [<ffffffff800a3444>] autoremove_wake_function+0x0/0x2e
May 26 05:40:00 appsrv kernel:  [<ffffffff800e37df>] sys_fstatfs+0x57/0x68
May 26 05:40:17 appsrv kernel:  [<ffffffff80016b5d>] vfs_write+0xce/0x174
May 26 05:40:39 appsrv kernel:  [<ffffffff80017426>] sys_write+0x45/0x6e
May 26 05:40:45 appsrv kernel:  [<ffffffff8005d116>] system_call+0x7e/0x83
May 26 05:40:48 appsrv kernel:
May 26 05:40:51 appsrv kernel: INFO: task auditd:6608 blocked for more than 120 seconds.
May 26 05:40:53 appsrv kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 26 05:40:57 appsrv kernel: auditd        D ffffffff80156347     0  6608      1          6628  6607 (NOTLB)
May 26 05:40:59 appsrv kernel:  ffff81102c6f37b8 0000000000000082 ffff810659b21cf0 ffffffff8804d98d
May 26 05:41:02 appsrv kernel:  ffff81102c6f3758 000000000000000a ffff81102de0d7e0 ffff81102fd55040
May 26 05:41:10 appsrv kernel:  00006e76d9743aac 00000000000077ab ffff81102de0d9c8 000000108000b478
May 26 05:41:14 appsrv kernel: Call Trace:
May 26 05:41:23 appsrv kernel:  [<ffffffff8804d98d>] :ext3:ext3_mark_iloc_dirty+0x300/0x368
May 26 05:41:38 appsrv kernel:  [<ffffffff8804ddc2>] :ext3:ext3_mark_inode_dirty+0x33/0x3c
May 26 05:41:49 appsrv kernel:  [<ffffffff80063c63>] __mutex_lock_slowpath+0x60/0x9b
May 26 05:42:10 appsrv kernel:  [<ffffffff80063cad>] .text.lock.mutex+0xf/0x14
May 26 05:42:48 appsrv kernel:  [<ffffffff8804d98d>] :ext3:ext3_mark_iloc_dirty+0x300/0x368
May 26 05:43:17 appsrv kernel:  [<ffffffff8803596b>] :srv:__log_wait_for_space+0x53/0xac
May 26 05:44:34 appsrv kernel:  [<ffffffff88032046>] :srv:start_this_handle+0x327/0x370
May 26 05:45:13 appsrv kernel:  [<ffffffff88032ee5>] :srv:journal_dirty_metadata+0x1bf/0x1ee
May 26 05:46:28 appsrv kernel:  [<ffffffff8803215a>] :srv:journal_start+0xcb/0x102
May 26 05:47:09 appsrv kernel:  [<ffffffff88050590>] :ext3:ext3_ordered_writepage+0x7f/0x19c
May 26 05:47:58 appsrv kernel:  [<ffffffff8001d0c3>] mpage_writepages+0x1bf/0x37d
May 26 05:48:09 appsrv kernel:  [<ffffffff88050511>] :ext3:ext3_ordered_writepage+0x0/0x19c
May 26 05:48:20 appsrv kernel:  [<ffffffff8005a878>] do_writepages+0x29/0x2f
May 26 05:48:25 appsrv kernel:  [<ffffffff8002f95c>] __writeback_single_inode+0x1a2/0x31c
May 26 05:48:28 appsrv kernel:  [<ffffffff8804d98d>] :ext3:ext3_mark_iloc_dirty+0x300/0x368
May 26 05:48:33 appsrv kernel:  [<ffffffff80021035>] sync_sb_inodes+0x1b7/0x271
May 26 05:48:36 appsrv kernel:  [<ffffffff80050cda>] writeback_inodes+0x82/0xd8
May 26 05:48:38 appsrv kernel:  [<ffffffff800ccb75>] balance_dirty_pages_ratelimited_nr+0x16d/0x27a
May 26 05:48:42 appsrv kernel:  [<ffffffff8000ff1a>] generic_file_buffered_write+0x20b/0x6a9
May 26 05:48:45 appsrv kernel:  [<ffffffff880317be>] :srv:journal_stop+0x1f7/0x203
May 26 05:48:48 appsrv kernel:  [<ffffffff80016755>] __generic_file_aio_write_nolock+0x369/0x3b6
May 26 05:48:51 appsrv kernel:  [<ffffffff80063833>] schedule_timeout+0x1e/0xad
May 26 05:48:54 appsrv kernel:  [<ffffffff800218b1>] generic_file_aio_write+0x67/0xc3
May 26 05:48:57 appsrv kernel:  [<ffffffff8804c1c2>] :ext3:ext3_file_write+0x16/0x91
May 26 05:49:01 appsrv kernel:  [<ffffffff800183e0>] do_sync_write+0xc7/0x104
May 26 05:49:14 appsrv kernel:  [<ffffffff800a3444>] autoremove_wake_function+0x0/0x2e
May 26 05:49:52 appsrv kernel:  [<ffffffff800e37df>] sys_fstatfs+0x57/0x68
May 26 05:50:18 appsrv kernel:  [<ffffffff80016b5d>] vfs_write+0xce/0x174
May 26 05:51:57 appsrv kernel:  [<ffffffff80017426>] sys_write+0x45/0x6e
May 26 05:52:56 appsrv kernel:  [<ffffffff8005d116>] system_call+0x7e/0x83
May 26 05:53:49 appsrv kernel:
May 26 05:54:56 appsrv kernel: INFO: task auditd:6608 blocked for more than 120 seconds.
May 26 05:55:53 appsrv kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 26 05:57:02 appsrv kernel: auditd        D ffffffff80156347     0  6608      1          6628  6607 (NOTLB)
May 26 05:58:32 appsrv kernel:  ffff81102c6f37b8 0000000000000082 ffff810659b21cf0 ffffffff8804d98d
May 26 05:59:27 appsrv kernel:  ffff81102c6f3758 000000000000000a ffff81102de0d7e0 ffff81102fd55040
May 26 06:00:04 appsrv kernel:  00006e76d9743aac 00000000000077ab ffff81102de0d9c8 000000108000b478
May 26 06:01:05 appsrv kernel: Call Trace:
May 26 06:01:58 appsrv kernel:  [<ffffffff8804d98d>] :ext3:ext3_mark_iloc_dirty+0x300/0x368
May 26 06:02:08 appsrv kernel:  [<ffffffff8804ddc2>] :ext3:ext3_mark_inode_dirty+0x33/0x3c
May 26 06:02:59 appsrv kernel:  [<ffffffff80063c63>] __mutex_lock_slowpath+0x60/0x9b
May 26 06:03:12 appsrv kernel:  [<ffffffff80063cad>] .text.lock.mutex+0xf/0x14
May 26 06:04:03 appsrv kernel:  [<ffffffff8804d98d>] :ext3:ext3_mark_iloc_dirty+0x300/0x368
May 26 06:04:33 appsrv kernel:  [<ffffffff8803596b>] :srv:__log_wait_for_space+0x53/0xac
May 26 06:04:58 appsrv kernel:  [<ffffffff88032046>] :srv:start_this_handle+0x327/0x370
May 26 06:05:25 appsrv kernel:  [<ffffffff88032ee5>] :srv:journal_dirty_metadata+0x1bf/0x1ee
May 26 06:06:34 appsrv kernel:  [<ffffffff8803215a>] :srv:journal_start+0xcb/0x102
May 26 06:07:55 appsrv kernel:  [<ffffffff88050590>] :ext3:ext3_ordered_writepage+0x7f/0x19c
May 26 06:09:13 appsrv kernel:  [<ffffffff8001d0c3>] mpage_writepages+0x1bf/0x37d
May 26 06:11:30 appsrv kernel:  [<ffffffff88050511>] :ext3:ext3_ordered_writepage+0x0/0x19c
May 26 06:13:35 appsrv kernel:  [<ffffffff8005a878>] do_writepages+0x29/0x2f
May 26 06:14:43 appsrv kernel:  [<ffffffff8002f95c>] __writeback_single_inode+0x1a2/0x31c
May 26 06:15:12 appsrv kernel:  [<ffffffff8804d98d>] :ext3:ext3_mark_iloc_dirty+0x300/0x368
May 26 06:15:44 appsrv kernel:  [<ffffffff80021035>] sync_sb_inodes+0x1b7/0x271
May 26 06:15:49 appsrv kernel:  [<ffffffff80050cda>] writeback_inodes+0x82/0xd8
May 26 06:15:53 appsrv kernel:  [<ffffffff800ccb75>] balance_dirty_pages_ratelimited_nr+0x16d/0x27a
May 26 06:15:58 appsrv kernel:  [<ffffffff8000ff1a>] generic_file_buffered_write+0x20b/0x6a9
May 26 06:16:02 appsrv kernel:  [<ffffffff880317be>] :srv:journal_stop+0x1f7/0x203
May 26 06:16:18 appsrv kernel:  [<ffffffff80016755>] __generic_file_aio_write_nolock+0x369/0x3b6
May 26 06:16:34 appsrv kernel:  [<ffffffff80063833>] schedule_timeout+0x1e/0xad
May 26 06:16:49 appsrv kernel:  [<ffffffff800218b1>] generic_file_aio_write+0x67/0xc3
May 26 06:17:04 appsrv kernel:  [<ffffffff8804c1c2>] :ext3:ext3_file_write+0x16/0x91
May 26 06:18:06 appsrv kernel:  [<ffffffff800183e0>] do_sync_write+0xc7/0x104
May 26 06:19:33 appsrv kernel:  [<ffffffff800a3444>] autoremove_wake_function+0x0/0x2e
May 26 06:20:24 appsrv kernel:  [<ffffffff800e37df>] sys_fstatfs+0x57/0x68
May 26 06:22:03 appsrv kernel:  [<ffffffff80016b5d>] vfs_write+0xce/0x174
May 26 06:24:15 appsrv kernel:  [<ffffffff80017426>] sys_write+0x45/0x6e
May 26 06:25:53 appsrv kernel:  [<ffffffff8005d116>] system_call+0x7e/0x83
May 26 06:26:04 appsrv kernel:
May 26 08:14:10 appsrv kernel: INFO: task bash:10434 blocked for more than 120 seconds.
May 26 08:14:10 appsrv kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 26 08:14:10 appsrv kernel: bash          D ffffffff80156347     0 10434  10433                     (NOTLB)
May 26 08:14:10 appsrv kernel:  ffff8101cb2add58 0000000000000086 0000000000000246 ffff810b47ddf060
May 26 08:14:10 appsrv kernel:  ffff8105bddeee50 000000000000000a ffff8108269180c0 ffff81084c3430c0
May 26 08:14:10 appsrv kernel:  0000797e1f8f1f29 000000000000c953 ffff8108269182a8 000000068804bc8d
May 26 08:14:10 appsrv kernel: Call Trace:
May 26 08:14:10 appsrv kernel:  [<ffffffff80063c63>] __mutex_lock_slowpath+0x60/0x9b
May 26 08:14:10 appsrv kernel:  [<ffffffff80063cad>] .text.lock.mutex+0xf/0x14
May 26 08:14:10 appsrv kernel:  [<ffffffff8803596b>] :srv:__log_wait_for_space+0x53/0xac
May 26 08:14:10 appsrv kernel:  [<ffffffff8002593b>] filldir+0x0/0xb7
May 26 08:14:10 appsrv kernel:  [<ffffffff88032046>] :srv:start_this_handle+0x327/0x370
May 26 08:14:45 appsrv kernel:  [<ffffffff8005bd55>] cache_alloc_refill+0x108/0x188
May 26 08:15:19 appsrv kernel:  [<ffffffff8803215a>] :srv:journal_start+0xcb/0x102
May 26 08:18:20 appsrv kernel:  [<ffffffff88050cfa>] :ext3:ext3_dirty_inode+0x28/0x7b
May 26 08:20:48 appsrv kernel:  [<ffffffff80013d87>] __mark_inode_dirty+0x29/0x16e