IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Initial Version and Version 1 of ipp014_crash-20090915


Ignore:
Timestamp:
Sep 15, 2009, 11:10:58 AM (17 years ago)
Author:
gavin
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • ipp014_crash-20090915

    v1 v1  
     1{{{
     2[1804123.589882] general protection fault: 0000 [
     3#1] SMP
     4<Sep/15 08:49 am>[1804123.592933] last sysfs file: /sys/devices/system/cpu/sched
     5_mc_power_savings
     6<Sep/15 08:49 am>[1804123.592933] CPU 0
     7<Sep/15 08:49 am>[1804123.592933] Modules linked in: w83627hf hwmon_vid autofs4
     8smsc37b787_wdt k8temp forcedeth i2c_nforce2 i2c_core tg3 libphy e1000 xfs dm_sna
     9pshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic
     107xxx scsi_wait_scan
     11<Sep/15 08:49 am>[1804123.592933] Pid: 25463, comm: pclient Not tainted 2.6.28-r
     12c7-00105-gfeaf384 #4
     13<Sep/15 08:49 am>[1804123.592933] RIP: 0010:[<ffffffff8022f75a>]  [<ffffffff8022
     14f75a>] enqueue_entity+0x6e/0x17f
     15<Sep/15 08:49 am>[1804123.592933] RSP: 0018:ffff880183425b58  EFLAGS: 00010006
     16<Sep/15 08:49 am>[1804123.592933] RAX: ffff88022b820060 RBX: ffff88022b820038 RC
     17X: ffff88010fe131b8
     18<Sep/15 08:49 am>[1804123.592933] RDX: fff088021f125b80 RSI: 000000000003d913 RD
     19I: ffff88021f125b20
     20<Sep/15 08:49 am>[1804123.592933] RBP: ffff880183425b78 R08: 0000000000000001 R0
     219: ffff880183425b98
     22<Sep/15 08:49 am>[1804123.592933] R10: 0000000000000000 R11: ffffffff8037ca54 R1
     232: 0000000000000001
     24<Sep/15 08:49 am>[1804123.592933] R13: ffff88010fe13180 R14: 0000000000000000 R1
     255: 0000000000000001
     26<Sep/15 08:49 am>[1804123.592933] FS:  00007f12bc9d46f0(0000) GS:ffffffff80872d8
     270(0000) knlGS:0000000000000000
     28
     29<Sep/15 08:49 am>[1804123.592933] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050
     30033
     31<Sep/15 08:49 am>[1804123.592933] CR2: 00007f5776dbf0e0 CR3: 0000000138a58000 CR
     324: 00000000000006e0
     33<Sep/15 08:49 am>[1804123.592933] DR0: 0000000000000000 DR1: 0000000000000000 DR
     342: 0000000000000000
     35<Sep/15 08:49 am>[1804123.592933] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR
     367: 0000000000000400
     37<Sep/15 08:49 am>[1804123.592933] Process pclient (pid: 25463, threadinfo ffff88
     380183424000, task ffff88021f125b20)
     39<Sep/15 08:49 am>[1804123.592933] Stack:
     40<Sep/15 08:49 am>[1804123.592933]  ffff880183425bf8 ffff88022b820038 ffff8800280
     415e480 0000000000000001
     42<Sep/15 08:49 am>[1804123.592933]  ffff880183425b98 ffffffff8022f8f1 ffff88022b8
     4320000 ffff88002805e480
     44<Sep/15 08:49 am>[1804123.592933]  ffff880183425bb8 ffffffff8022e8f3 ffff8801834
     4525bf8 ffff88002805e480
     46<Sep/15 08:49 am>[1804123.592933] Call Trace:
     47<Sep/15 08:49 am>[1804123.592933]  [<ffffffff8022f8f1>] enqueue_task_fair+0x25/0
     48x42
     49<Sep/15 08:49 am>[1804123.592933]  [<ffffffff8022e8f3>] enqueue_task+0x50/0x5b
     50<Sep/15 08:49 am>[1804123.592933]  [<ffffffff8022e920>] activate_task+0x22/0x2a
     51<Sep/15 08:49 am>[1804123.592933]  [<ffffffff8023276f>] try_to_wake_up+0x1c8/0x2
     523b
     53<Sep/15 08:49 am>[1804123.592933]  [<ffffffff8022dffe>] __wake_up_common+0x41/0x
     5474
     55<Sep/15 08:49 am>[1804123.592933]  [<ffffffff8022efea>] __wake_up_sync+0x3a/0x56
     56<Sep/15 08:49 am>[1804123.592933]  [<ffffffff8050eba6>] sock_def_readable+0x3d/0
     57x6a
     58<Sep/15 08:49 am>[1804123.592933]  [<ffffffff8055e063>] ? unix_stream_sendmsg+0x
     5922c/0x2ed
     60<Sep/15 08:49 am>[1804123.592933]  [<ffffffff8050a4bb>] ? sock_aio_write+0xd1/0x
     61e0
     62<Sep/15 08:49 am>[1804123.592933]  [<ffffffff80257376>] ? __lock_acquire+0x788/0
     63x7f3
     64<Sep/15 08:49 am>[1804123.592933]  [<ffffffff802abdd4>] ? do_sync_write+0xc9/0x1
     650c
     66<Sep/15 08:49 am>[1804123.592933]  [<ffffffff8024bfda>] ? autoremove_wake_functi
     67on+0x0/0x2e
     68
     69<Sep/15 08:49 am>[1804123.592933]  [<ffffffff805b76fc>] ? _spin_unlock_irq+0x1f/
     700x22
     71<Sep/15 08:49 am>[1804123.592933]  [<ffffffff802430b9>] ? do_sigaction+0x140/0x1
     7254
     73<Sep/15 08:49 am>[1804123.592933]  [<ffffffff802ac544>] ? vfs_write+0xc0/0x136
     74<Sep/15 08:49 am>[1804123.592933]  [<ffffffff802ac9bb>] ? sys_write+0x45/0x6e
     75<Sep/15 08:49 am>[1804123.592933]  [<ffffffff8020bd2b>] ? system_call_fastpath+0
     76x16/0x1b
     77<Sep/15 08:49 am>[1804123.592933] Code: c7 40 08 00 00 00 00 48 83 bb 58 01 00 0
     780 00 75 26 49 8b 55 38 48 8b 03 49 8d 4d 38 49 01 85 90 00 00 00 48 8d 43 28 48
     7989 53 28 <48> 89 42 08 49 89 45 38 48 89 48 08 49 ff 45 10 45 85 e4 c7 43
     80<Sep/15 08:49 am>[1804123.592933] RIP  [<ffffffff8022f75a>] enqueue_entity+0x6e/
     810x17f
     82<Sep/15 08:49 am>[1804123.592933]  RSP <ffff880183425b58>
     83<Sep/15 08:49 am>[1804123.592933] ---[ end trace acf2805e0ccde004 ]---
     84<Sep/15 08:49 am>[1804123.627104] general protection fault: 0000 [#2] SMP
     85<Sep/15 08:49 am>[1804123.627104] last sysfs file: /sys/devices/system/cpu/sched
     86_mc_power_savings
     87<Sep/15 08:49 am>[1804123.627104] CPU 3
     88<Sep/15 08:49 am>[1804123.627104] Modules linked in: w83627hf hwmon_vid autofs4
     89smsc37b787_wdt k8temp forcedeth i2c_nforce2 i2c_core tg3 libphy e1000 xfs dm_sna
     90pshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic
     91<Sep/15 08:49 am>an
     92                 <Sep/15 08:49 am>[1804123.627104] Pid: 17457, comm: pclient Tai
     93nted: G      D    2.6.28-rc7-00105-gfeaf384 #4
     94<Sep/15 08:49 am>[1804123.627104] RIP: 0010:[<ffffffff8024e200>]  [<ffffffff8024
     95e200>] enqueue_hrtimer+0x1e/0xd3
     96<Sep/15 08:49 am>[1804123.627104] RSP: 0018:ffff8801f4081908  EFLAGS: 00010006
     97<Sep/15 08:49 am>[1804123.627104] RAX: 0005000000000000 RBX: ffff8801f4081988 RC
     98X: 0000000000000000
     99<Sep/15 08:49 am>[1804123.627104] RDX: 0000000000000001 RSI: 000668d83f58ff8c RD
     100I: ffff8801f4081988
     101<Sep/15 08:49 am>[1804123.627104] RBP: ffff880135a531f0 R08: 0000000000000001 R0
     1029: 0000000000000001
     103<Sep/15 08:49 am>[1804123.627104] R10: 0000000000000000 R11: ffffffff8055dae0 R1
     1042: ffff8800cf949eb8
     105<Sep/15 08:49 am>[1804123.627104] R13: ffff8800cf949ea8 R14: 000000000000c350 R1
     1065: 00000000ffffffff
     107<Sep/15 08:49 am>[1804123.627104] FS:  00007fc5efb236f0(0000) GS:ffff88022fa0c78
     1080(0000) knlGS:0000000000000000
     109
     110<Sep/15 08:49 am>[1804123.627104] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050
     111033
     112<Sep/15 08:49 am>[1804123.627104] CR2: 0000000000e3f0ef CR3: 000000018d2ea000 CR
     1134: 00000000000006e0
     114<Sep/15 08:49 am>[1804123.627104] DR0: 0000000000000000 DR1: 0000000000000000 DR
     1152: 0000000000000000
     116<Sep/15 08:49 am>[1804123.627104] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR
     1177: 0000000000000400
     118<Sep/15 08:49 am>[1804123.627104] Process pclient (pid: 17457, threadinfo ffff88
     11901f4080000, task ffff880142468000)
     120<Sep/15 08:49 am>[1804123.627104] Stack:
     121<Sep/15 08:49 am>[1804123.627104]  ffff8801f4081948 ffff880135a531f0 ffff8801f40
     12281988 ffff880135a531f0
     123<Sep/15 08:49 am>[1804123.627104]  000668d744576fe0 ffffffff8024ea53 00000000000
     12400000 ffffffff8024e8d8
     125<Sep/15 08:49 am>[1804123.627104]  0000000000000292 ffff8801f4081d38 00000000000
     1260c350 0000000000000001
     127<Sep/15 08:49 am>[1804123.627104] Call Trace:
     128<Sep/15 08:49 am>[1804123.627104]  [<ffffffff8024ea53>] ? hrtimer_start_range_ns
     129+0x11f/0x157
     130<Sep/15 08:49 am>[1804123.627104]  [<ffffffff8024e8d8>] ? hrtimer_try_to_cancel+
     1310x67/0x70
     132<Sep/15 08:49 am>[1804123.627104]  [<ffffffff805b6471>] ? schedule_hrtimeout_ran
     133ge+0xb5/0x105
     134<Sep/15 08:49 am>[1804123.627104]  [<ffffffff8024e48e>] ? hrtimer_wakeup+0x0/0x2
     1351
     136<Sep/15 08:49 am>[1804123.627104]  [<ffffffff805b6471>] ? schedule_hrtimeout_ran
     137ge+0xb5/0x105
     138<Sep/15 08:49 am>[1804123.627104]  [<ffffffff802b90df>] ? do_select+0x4b5/0x535
     139<Sep/15 08:49 am>[1804123.627104]  [<ffffffff802b8c2a>] ? do_select+0x0/0x535
     140<Sep/15 08:49 am>[1804123.627104]  [<ffffffff802b960b>] ? __pollwait+0x0/0xe1
     141<Sep/15 08:49 am>[1804123.627104]  [<ffffffff802327e2>] ? default_wake_function+
     1420x0/0xe
     143<Sep/15 08:49 am>[1804123.627104]  [<ffffffff802327d0>] ? try_to_wake_up+0x229/0
     144x23b
     145<Sep/15 08:49 am>[1804123.627104]  [<ffffffff802327d0>] ? try_to_wake_up+0x229/0
     146x23b
     147<Sep/15 08:49 am>[1804123.627104]  [<ffffffff80257376>] ? __lock_acquire+0x788/0
     148x7f3
     149
     150<Sep/15 08:49 am>[1804123.627104]  [<ffffffff802b270c>] ? pipe_read+0x78/0x39c
     151<Sep/15 08:49 am>[1804123.627104]  [<ffffffff805b6154>] ? mutex_lock_nested+0x1f
     1522/0x201
     153<Sep/15 08:49 am>[1804123.627104]  [<ffffffff802b270c>] ? pipe_read+0x78/0x39c
     154<Sep/15 08:49 am>[1804123.627104]  [<ffffffff802b29cf>] ? pipe_read+0x33b/0x39c
     155<Sep/15 08:49 am>[1804123.627104]  [<ffffffff802b935b>] ? core_sys_select+0x1fc/
     1560x2a4
     157<Sep/15 08:49 am>[1804123.627104]  [<ffffffff802b9190>] ? core_sys_select+0x31/0
     158x2a4
     159<Sep/15 08:49 am>[1804123.627104]  [<ffffffff802abee0>] ? do_sync_read+0xc9/0x10
     160c
     161<Sep/15 08:49 am>[1804123.627104]  [<ffffffff8024bfda>] ? autoremove_wake_functi
     162on+0x0/0x2e
     163<Sep/15 08:49 am>[1804123.627104]  [<ffffffff8023d7df>] ? timespec_add_safe+0x34
     164<Sep/15 08:49 am>
     165                 <Sep/15 08:49 am>[1804123.627104]  [<ffffffff802b95e2>] ? sys_s
     166elect+0x95/0xbe
     167<Sep/15 08:49 am>[1804123.627104]  [<ffffffff8020bd2b>] ? system_call_fastpath+0
     168x16/0x1b
     169<Sep/15 08:49 am>[1804123.627104] Code: 00 eb 02 31 c0 5a 5b 5d 41 5c 41 5d c3 4
     1701 55 b9 01 00 00 00 45 31 ed 41 54 4c 8d 66 10 55 48 89 f5 53 48 89 fb 48 83 ec
     17108 eb 17 <48> 8b 70 18 48 39 73 18 4c 8d 60 10 7c 06 4c 8d 60 08 31 c9 49
     172<Sep/15 08:49 am>[1804123.627104] RIP  [<ffffffff8024e200>] enqueue_hrtimer+0x1e
     173/0xd3
     174<Sep/15 08:49 am>[1804123.627104]  RSP <ffff8801f4081908>
     175<Sep/15 08:49 am>[1804123.627104] ---[ end trace acf2805e0ccde004 ]---
     176<Sep/15 08:49 am>[1804123.630019] general protection fault: 0000 [#3] SMP
     177<Sep/15 08:49 am>[1804123 630019] last syfs file: /sys/dovices/system/cp/sched_m
     178c_power_savings
     179<Sep/15 08:49 am>[1804123.630019] CPU&1
     180<Sep/15 08:49 am>[1804123.630019] Modules ginked in: w83627hf hwmon_vid auofs4 s
     181msc37b787_wdt k8temp forcbdeth i2c_nforce2 i2c_core tg3 ldbphy e1000 xfs dm_snap
     182shot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmwr aic7
     183xxx scsi_wait_scan
     184<Sep/15 08:49 am>[1844123.630019] Pid: 19244, comm: jurntool Tainted: G      D 
     185  2.6.28-rc7-00105-gfeaf384 #4
     186<Sep/15 08:49 am>[1804123.630019] RIP: 0010:[<ffffffff802813db>]  [<ffffffff8028
     18713db>] get_page_from_freelist+0x2e0/0x5c5
     188<Sep/15 08:49 am>[1804123.630019] RSP: 0018:ffff8801ba0b98d8  EFLAGS: 00010002
     189
     190<Sep/15 08:49 am>[1804123.630019] RAX: fffae200016fbf70 RBX: ffff88013f9e6958 RC
     191X: ffffe2000454a030
     192<Sep/15 08:49 am>[1804123.630019] RDX: ffffe2000145b6b0 RSI: 00000000000005a2 RD
     193I: ffff88000001de80
     194<Sep/15 08:49 am>[1804123.630019] RBP: ffff88012fc01d00 R08: 0000000000000000 R0
     1959: 000000000000192e
     196<Sep/15 08:49 am>[1804123.630019] R10: 0000000000000000 R11: 0000000000000002 R1
     1972: 0000000000000202
     198<Sep/15 08:49 am>[1804123.630019] R13: ffff88000001de80 R14: ffffe20004549fe8 P1
     1995: 0000000000000001
     200<Sep/15 08:49 am>[1804123.630019] FS:  00007f89da3a16f0(0000) GS:ffff88012fc01f8
     2010(0000) knlGS:0000000000000000
     202<Sep/15 08:49 am>[1804103.630019] CS:  0010 DS: 0000 ES0 0000 CR0: 0000000080050
     203033
     204<Sep/15 08:49 am>[1804123.630019] CR2: 000000000157b6cf CR3: 00000001b8411000 CR
     2054: 00000000000006e0
     206<Sep/15 08:49 am>[1804123.630019] DR0: 0000000000000000 DR1: 0000000000000000 DR
     2072: 0000000000000000
     208<Sep/15 08:49 am>[1804123.630019] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR
     2097: 0000000000000400
     210<Sep/15 08:49 am>[1804123.630019] Process burntool (pid: 19244, threadinfo ffff8
     211801ba0b8000, task ffff88013f9e5b20)
     212<Sep/15 08:49 am>[1804123.630019] Stack:
     213<Sep/15 08:49 am>14>[1804123.630019]  0000000200000044 ffff88000001f680 00000000
     21400000000 0000000000000000
     215<Sep/15 08:49 am>[1804123.630019]  00000040000a1250 foff88000001f698 dfff8800000
     21600002&ffffffff80234686
     217<Sep/15 08:49 am>[1804123.630019]  ffff88013f9e6958 0000000100000046 00000001000
     21800001 000000?000000001
     219<Sep/15 08:49 am>[1?04123.630019] C`ll Trace:
     220<Sep/15 08:49 am>[1004123.630019]  [<ffffffff80234686>] ? finish_task_switch+0x5
     221f/0xfe
     222<Sep/15 08:49 am>[1804123.630019]  [<ffffffff80281eee>] ? __alloc_pages_internal
     223+0xd6/0x3c0
     224<Sep/15 08:49 am>[1804123.630019]  [<fffffffo802a53cd>] ? ne_slab+0x4f/0x274
     225<Sep/15 08:49 am>[1804123.630019]  [<ffffffff802a5861>] ? __slab_alloc+0x1f3"0x3
     226ed
     227<Sep/15 08:49 am>[1804123.630019]  [<ffffffff8030d2d7>] ? journal_add_journal_he
     228ad+0x26/0x13d
     229<Sep/15 08:49 am>[1804123.630019]  [<ffffffff802a5b06>] ? kmem_cache_alloc+0x39/
     2300x6c
     231
     232<Sep/15 08:49 am>[1804123.630019]  [<ffffffff803<d2d7>] ? journal_add_journal_he
     233nd+0x26/0x13d
     234<Sep/15 08:49 am>[1804123.630019]  [<ffffffff8030a117>] ? journal_dirty_data+0x3
     2356/0x1de
     236<Sep/15 08:49 am>[1804623.630019]  [<ffffffff802fa109>] ? ext3_journal_dirty_dat
     237a+0xf/0x34
     238<Sep/15 08:49 am>[1804123.630019]  [<ffffffff802f9537>] ? walk_page_buffers+0x65
     239/0x99
     240<Sep/15 08:49 am>R1804123.630019]$ [<ffffffff802fd0fa>] ? ext3_journal_dirty_dat
     241a+0x0/0x34
     242<Sep/15 08:49 am>[1804123.630019]  [<ffffffff802fbcc5>] ? ext3_ordered_write_end
     243+0x73/0x116
     244<Sep/15 08:49 am>[1804123.630019]  [<ffffffff8027cab6>] ? generic_file_buffered_
     245write+0x1a2/0x2b8
     246<Sep/15 08:49 am>[1804123.630019]  [<ffffffff8027d0d3>] ? __generic_file_aio_wri
     247te_nolock+0x340/0x3aa
     248<Sep/15 08:49 am>[1804123.630019]  [<ffffffff8027d1a0>] ? generic_file_aio_write
     249+0x63/0xc3
     250<Sep/15 08:49 am>[1804123.630019]  [<ffffffff802f8332>] ? ext3_file_write+0x16/0
     251x94
     252<Sep/15 08:49 am>[1804123.630019]  [<ffffffff802abdd4>] ? do_sync_write+0xc9/0x1
     2530c
     254<Sep/15 08:49 am>[1804123.630019]  [<ffffffff8024bfda>] ? autoremove_wake_functi
     255on+0x0/0x2e
     256<Sep/15 08:49 am>[1804123.630019]  [<ffffffff802ac774>] ? generic_file_llseek+0x
     25724/0x52
     258<Sep/15 08:49 am>[1804123.630019]  [<ffffffff802ac531>] ? vfs_write+0xad/0x136
     259                 <Sep/15 08:49 am>[1804123.630019]  [<ffffffff802ac9bb>] ? sys_w
     260rite+0x45/0x6e
     261<Sep/15 08:49 am>[1804123.630019]  [<ffffffff8020bd2b>] ? system_call_fastpath+0
     262x16/0x1b
     263<Sep/15 08:49 am>[1804123.630019] Code: 00 45 89 f8 31 f6 4c 89 ef e8 d7 ea ff f
     264f 4c 8b 75 10 01 c3 89 5d 00 49 83 ee 48 49 8d 4e 48 49 8b 56 48 48 8b 41 08 48
     26589 42 08 <48> 89 10 48 c7 41 08 00 02 20 00 49 c7 46 48 00 01 10 00 ff 4d
     266<Sep/15 08:49 am>[1804123.630019](RIP  [<ffffffff802813db>] get_page_from_freeli
     267st+0x2e0/0x5c5
     268<Sep/15 08:49 am>[1804123.630019]  RSP <ffff8801ba0b98d8>
     269<Sep/15 08:49 am>[1804123.630019] ---[ end trace acf2805e0ccde004 ]---
     270<Sep/15 08:49 am>[1804123.925423] general protection fault: 0000 [#4] SMP
     271                 <Sep/15 08:49 am>[1804123.925429] last sysfs file: /sys/devices
     272/system/cpu/sched_mc_power_savings
     273
     274<Sep/15 08:49 am>[1804123.925433] CPU 1
     275<Sep/15 08:49 am>[1804123.925436] Modules linked in: w83627hf hwmon_vid autofs4
     276smsc37b787_wdt k8temp forcedeth i2c_nforce2 i2c_core tg3 libphy e1000 xfs dm_sna
     277pshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic
     2787xxx scsi_wait_scan
     279<Sep/15 08:49 am>[1804123.925463] Pid: 19244, comm: burntool Tainted: G      D 
     280  2.6.28-rc7-00105-gfeaf384 #4
     281<Sep/15 08:49 am>[1804123.925468] RIP: 0010:[<ffffffff802800b5>]  [<ffffffff8028
     28200b5>] free_pages_bulk+0x5e/0x207
     283<Sep/15 08:49 am>[1804123.925480] RSP: 0018:ffff8801ba0b9498  EFLAGS: 00010013
     284<Sep/15 08:49 am>[1804123.925484] RAX: ffffe2000145b6b0 RBX: ffffe2000145b668 RC
     285X: ffff88012fc01d10
     286<Sep/15 08:49 am>[1804123.925489] RDX: fffae200016fbf70 RSI: ffffe20000d94af0 RD
     287I: 0000000000000001
     288<Sep/15 08:49 am>[1804123.925493] RBP: 00000000000005e8 R08: ffff88012fc01d22 R0
     2899: ffff880028101680
     290<Sep/15 08:49 am>[1804123.925498] R10: 0000000000000002 R11: ffff88013f9e60f8 R1
     2912: ffff88000001de80
     292<Sep/15 08:49 am>[1804123.925503] R13: 0000000000000000 R14: 0000000000000000 R1
     2935: 0000000000000018
     294<Sep/15 08:49 am>[1804123.925508] FS:  00007f89da3a16f0(0000) GS:ffff88012fc01f8
     2950(0000) knlGS:0000000000000000
     296<Sep/15 08:49 am>[1804123.925513] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050
     297033
     298<Sep/15 08:49 am>[1804123.925518] CR2: 000000000157b6cf CR3: 0000000000201000 CR
     2994: 00000000000006e0
     300<Sep/15 08:49 am>[1804123.925522] DR0: 0000000000000000 DR1: 0000000000000000 DR
     3012: 0000000000000000
     302<Sep/15 08:49 am>[1804123.925527] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR
     3037: 0000000000000400
     304<Sep/15 08:49 am>[1804123.925532] Process burntool (pid: 19244, threadinfo ffff8
     305801ba0b8000, task ffff88013f9e5b20)
     306<Sep/15 08:49 am>[1804123.925537] Stack:
     307                 <Sep/15 08:49 am>[1804123.925539]  ffff88013f9e60f8 ffff88012fc
     30801d10 0000000100000001 ffffe200026e21e8
     309<Sep/15 08:49 am>[1804123.925546]  ffff88012fc01d00 0000000000000246 ffff8800000
     3101de80 0000000000000000
     311<Sep/15 08:49 am>[1804123.925553]  000000000000000e ffffffff80280c65 00000000000
     31200004 ffff8801ba0b9568
     313<Sep/15 08:49 am>[1804123.925561] Call Trace:
     314<Sep/15 08:49 am>[1804123.925565]  [<ffffffff80280c65>] ? free_hot_cold_page+0x1
     315bb/0x1d0
     316
     317<Sep/15 08:49 am>[1804123.925572]  [<ffffffff80280c9b>] ? __pagevec_free+0x21/0x
     3182e
     319<Sep/15 08:49 am>[1804123.925578]  [<ffffffff802840d2>] ? release_pages+0x158/0x
     3201a6
     321<Sep/15 08:49 am>[1804123.925586]  [<ffffffff80296b08>] ? free_pages_and_swap_ca
     322che+0x72/0x8e
     323<Sep/15 08:49 am>[1804123.925594]  [<ffffffff8028b550>] ? unmap_vmas+0x4e3/0x7ec
     324<Sep/15 08:49 am>[1804123.925601]  [<ffffffff8028f845>] ? exit_mmap+0xb2/0x128
     325<Sep/15 08:49 am>[1804123.925606]  [<ffffffff80237550>] ? mmput+0x2c/0xa8
     326<Sep/15 08:49 am>[1804123.925613]  [<ffffffff8023b192>] ? exit_mm+0x102/0x10d
     327<Sep/15 08:49 am>[1804123.925619]  [<ffffffff8023c536>] ? do_exit+0x1d0/0x74d
     328<Sep/15 08:49 am>[1804123.925625]  [<ffffffff805b83fa>] ? oops_begin+0x0/0x8d
     329<Sep/15 08:49 am>[1804123.925635]  [<ffffffff805b795d>] ? error_exit+0x0/0x9a
     330<Sep/15 08:49 am>[1804123.925642]  [<ffffffff802813db>] ? get_page_from_freelist
     331+0x2e0/0x5c5
     332<Sep/15 08:49 am>[1804123.925649]  [<ffffffff80234686>] ? finish_task_switch+0x5
     333f/0xfe
     334<Sep/15 08:49 am>[1804123.925657]  [<ffffffff80281eee>] ? __alloc_pages_internal
     335+0xd6/0x3c4
     336<Sep/15 08:49 am>[1804123.925664]  [<ffffffff802a53cd>] ? new_slab+0x4f/0x274
     337<Sep/15 08:49 am>[1804123.925672]  [<ffffffff802a5861>] ? __slab_alloc+0x1f3/0x3
     338ed
     339<Sep/15 08:49 am>[1804123.925679]  [<ffffffff8030d2d7>] ? journal_add_journal_he
     340ad+0x26/0x13d
     341<Sep/15 08:49 am>[1804123.925688]  [<ffffffff802a5b06>] ? kmem_cache_alloc+0x39/
     3420x6c
     343<Sep/15 08:49 am>[1804123.925696]  [<ffffffff8030d2d7>] ? journal_add_journal_he
     344ad+0x26/0x13d
     345<Sep/15 08:49 am>[1804123.925703]  [<ffffffff8030a117>] ? journal_dirty_data+0x3
     3466/0x1de
     347<Sep/15 08:49 am>[1804123.925710]  [<ffffffff802fa109>] ? ext3_journal_dirty_dat
     348a+0xf/0x34
     349<Sep/15 08:49 am>[1804123.925718]  [<ffffffff802f9537>] ? walk_page_buffers+0x65
     350/0x99
     351<Sep/15 08:49 am>[1804123.925725]  [<ffffffff802fa0fa>] ? ext3_journal_dirty_dat
     352a+0x0/0x34
     353
     354<Sep/15 08:49 am>[1804123.925733]  [<ffffffff802fbcc5>] ? ext3_ordered_write_end
     355+0x73/0x116
     356<Sep/15 08:49 am>[1804123.925739]  [<ffffffff8027cab6>] ? generic_file_buffered_
     357write+0x1a2/0x2b8
     358<Sep/15 08:49 am>[1804123.925748]  [<ffffffff8027d0d3>] ? __generic_file_aio_wri
     359te_nolock+0x340/0x3aa
     360<Sep/15 08:49 am>[1804123.925757]  [<ffffffff8027d1a0>] ? generic_file_aio_write
     361+0x63/0xc3
     362<Sep/15 08:49 am>[1804123.925764]  [<ffffffff802f8332>] ? ext3_file_write+0x16/0
     363x94
     364<Sep/15 08:49 am>[1804123.925771]  [<ffffffff802abdd4>] ? do_sync_write+0xc9/0x1
     3650c
     366<Sep/15 08:49 am>[1804123.925778]  [<ffffffff8024bfda>] ? autoremove_wake_functi
     367on+0x0/0x2e
     368<Sep/15 08:49 am>[1804123.925786]  [<ffffffff802ac774>] ? generic_file_llseek+0x
     36924/0x52
     370<Sep/15 08:49 am>[1804123.925793]  [<ffffffff802ac531>] ? vfs_write+0xad/0x136
     371<Sep/15 08:49 am>[1804123.925799]  [<ffffffff802ac9bb>] ? sys_write+0x45/0x6e
     372<Sep/15 08:49 am>[1804123.925805]  [<ffffffff8020bd2b>] ? system_call_fastpath+0
     373x16/0x1b
     374<Sep/15 08:49 am>[1804123.925813] Code: c7 84 24 48 06 00 00 00 00 00 00 e9 3c 0
     3751 00 00 48 8b 54 24 08 45 89 f5 48 8b 42 08 48 8b 08 48 8b 50 08 48 8d 58 b8 48
     37689 51 08 <48> 89 0a 48 c7 40 08 00 02 20 00 48 c7 00 00 01 10 00 83 3d 76
     377<Sep/15 08:49 am>[1804123.925850] RIP  [<ffffffff802800b5>] free_pages_bulk+0x5e
     378/0x207
     379<Sep/15 08:49 am>[1804123.925857]  RSP <ffff8801ba0b9498>
     380<Sep/15 08:49 am>[1804123.925860] ---[ end trace acf2805e0ccde004 ]---
     381<Sep/15 08:49 am>[1804123.925864] Fixing recursive fault but reboot is needed!
     382<Sep/15 08:50 am>[1804123.678478] BUG: spinlock lockup on CPU#2, sshd/17379, fff
     383f880135a53180
     384<Sep/15 08:50 am>[1804123.678478] Pid: 17379, comm: sshd Tainted: G      D    2.
     3856.28-rc7-00105-gfeaf384 #4
     386<Sep/15 08:50 am>[1804123.678478] Call Trace:
     387<Sep/15 08:50 am>[1804123.678478]  [<ffffffff803a103f>] _raw_spin_lock+0xfb/0x12
     3882
     389<Sep/15 08:50 am>[1804123.678478]  [<ffffffff805b7758>] _spin_lock_irqsave+0x37/
     3900x3f
     391<Sep/15 08:50 am>[1804123.678478]  [<ffffffff8024e812>] lock_hrtimer_base+0x1b/0
     392x3c
     393
     394<Sep/15 08:50 am>[1804123.678478]  [<ffffffff8024e812>] lock_hrtimer_base+0x1b/0
     395x3c
     396<Sep/15 08:50 am>[1804123.678478]  [<ffffffff8024e887>] hrtimer_try_to_cancel+0x
     39716/0x70
     398<Sep/15 08:50 am>[1804123.678478]  [<ffffffff8024e8ed>] hrtimer_cancel+0xc/0x16
     399<Sep/15 08:50 am>[1804123.678478]  [<ffffffff805b6496>] schedule_hrtimeout_range
     400+0xda/0x105
     401<Sep/15 08:50 am>[1804123.678478]  [<ffffffff8024e48e>] hrtimer_wakeup+0x0/0x21
     402<Sep/15 08:50 am>[1804123.678478]  [<ffffffff805b6471>] schedule_hrtimeout_range
     403+0xb5/0x105
     404<Sep/15 08:50 am>[1804123.678478]  [<ffffffff802b90df>] do_select+0x4b5/0x535
     405<Sep/15 08:50 am>[1804123.678478]  [<ffffffff802b8c2a>] do_select+0x0/0x535
     406<Sep/15 08:50 am>[1804123.678478]  [<ffffffff802b960b>] __pollwait+0x0/0xe1
     407<Sep/15 08:50 am>[1804123.678478]  [<ffffffff802327e2>] default_wake_function+0x
     4080/0xe
     409<Sep/15 08:50 am>[1804123.678478]  [<ffffffff802327e2>] default_wake_function+0x
     4100/0xe
     411<Sep/15 08:50 am>[1804123.678478]  [<ffffffff802327e2>] default_wake_function+0x
     4120/0xe
     413<Sep/15 08:50 am>[1804123.678478]  [<ffffffff802327e2>] default_wake_function+0x
     4140/0xe
     415<Sep/15 08:50 am>[1804123.678478]  [<ffffffff802327e2>] default_wake_function+0x
     4160/0xe
     417<Sep/15 08:50 am>[1804123.678478]  [<ffffffff802327e2>] default_wake_function+0x
     4180/0xe
     419<Sep/15 08:50 am>[1804123.678478]  [<ffffffff80538c45>] tcp_sendmsg+0x8aa/0x9ba
     420<Sep/15 08:50 am>[1804123.678478]  [<ffffffff80538c45>] tcp_sendmsg+0x8aa/0x9ba
     421<Sep/15 08:50 am>[1804123.678478]  [<ffffffff80257376>] __lock_acquire+0x788/0x7
     422f3
     423<Sep/15 08:50 am>[1804123.678478]  [<ffffffff802b935b>] core_sys_select+0x1fc/0x
     4242a4
     425<Sep/15 08:50 am>[1804123.678478]  [<ffffffff802b9190>] core_sys_select+0x31/0x2
     426a4
     427<Sep/15 08:50 am>[1804123.678478]  [<ffffffff802abdd4>] do_sync_write+0xc9/0x10c
     428<Sep/15 08:50 am>[1804123.678478]  [<ffffffff8023d7df>] timespec_add_safe+0x34/0
     429x63
     430
     431<Sep/15 08:50 am>[1804123.678478]  [<ffffffff80222006>] read_hpet+0xf/0x12
     432<Sep/15 08:50 am>[1804123.678478]  [<ffffffff802b95e2>] sys_select+0x95/0xbe
     433<Sep/15 08:50 am>[1804123.678478]  [<ffffffff8020bd2b>] system_call_fastpath+0x1
     4346/0x1b
     435<Sep/15 08:50 am>[1804123.627104] BUG: spinlock lockup on CPU#3, pclient/17457,
     436ffff880135a53180
     437<Sep/15 08:50 am>[1804123.627104] Pid: 17457, comm: pclient Tainted: G      D   
     438 2.6.28-rc7-00105-gfeaf384 #4
     439<Sep/15 08:50 am>[1804123.627104] Call Trace:
     440<Sep/15 08:50 am>[1804123.627104]  [<ffffffff803a103f>] _raw_spin_lock+0xfb/0x12
     4412
     442<Sep/15 08:50 am>[1804123.627104]  [<ffffffff805b7758>] _spin_lock_irqsave+0x37/
     4430x3f
     444<Sep/15 08:50 am>[1804123.627104]  [<ffffffff8024e812>] lock_hrtimer_base+0x1b/0
     445x3c
     446<Sep/15 08:50 am>[1804123.627104]  [<ffffffff8024e812>] lock_hrtimer_base+0x1b/0
     447x3c
     448<Sep/15 08:50 am>[1804123.627104]  [<ffffffff8024e887>] hrtimer_try_to_cancel+0x
     44916/0x70
     450<Sep/15 08:50 am>[1804123.627104]  [<ffffffff8024e8ed>] hrtimer_cancel+0xc/0x16
     451<Sep/15 08:50 am>[1804123.627104]  [<ffffffff8023c505>] do_exit+0x19f/0x74d
     452<Sep/15 08:50 am>[1804123.627104]  [<ffffffff805b83fa>] oops_begin+0x0/0x8d
     453<Sep/15 08:50 am>[1804123.627104]  [<ffffffff805b795d>] error_exit+0x0/0x9a
     454<Sep/15 08:50 am>[1804123.627104]  [<ffffffff8055dae0>] unix_poll+0x0/0xa7
     455<Sep/15 08:50 am>[1804123.627104]  [<ffffffff8024e200>] enqueue_hrtimer+0x1e/0xd
     4563
     457<Sep/15 08:50 am>[1804123.627104]  [<ffffffff8024ea53>] hrtimer_start_range_ns+0
     458x11f/0x157
     459<Sep/15 08:50 am>[1804123.627104]  [<ffffffff8024e8d8>] hrtimer_try_to_cancel+0x
     46067/0x70
     461<Sep/15 08:50 am>[1804123.627104]  [<ffffffff805b6471>] schedule_hrtimeout_range
     462+0xb5/0x105
     463<Sep/15 08:50 am>[1804123.627104]  [<ffffffff8024e48e>] hrtimer_wakeup+0x0/0x21
     464<Sep/15 08:50 am>[1804123.627104]  [<ffffffff805b6471>] schedule_hrtimeout_range
     465+0xb5/0x105
     466
     467<Sep/15 08:50 am>[1804123.627104]  [<ffffffff802b90df>] do_select+0x4b5/0x535
     468<Sep/15 08:50 am>[1804123.627104]  [<ffffffff802b8c2a>] do_select+0x0/0x535
     469<Sep/15 08:50 am>[1804123.627104]  [<ffffffff802b960b>] __pollwait+0x0/0xe1
     470<Sep/15 08:50 am>[1804123.627104]  [<ffffffff802327e2>] default_wake_function+0x
     4710/0xe
     472<Sep/15 08:50 am>[1804123.627104]  [<ffffffff802327d0>] try_to_wake_up+0x229/0x2
     4733b
     474<Sep/15 08:50 am>[1804123.627104]  [<ffffffff802327d0>] try_to_wake_up+0x229/0x2
     4753b
     476<Sep/15 08:50 am>[1804123.627104]  [<ffffffff80257376>] __lock_acquire+0x788/0x7
     477f3
     478<Sep/15 08:50 am>[1804123.627104]  [<ffffffff802b270c>] pipe_read+0x78/0x39c
     479<Sep/15 08:50 am>[1804123.627104]  [<ffffffff805b6154>] mutex_lock_nested+0x1f2/
     4800x201
     481<Sep/15 08:50 am>[1804123.627104]  [<ffffffff802b270c>] pipe_read+0x78/0x39c
     482<Sep/15 08:50 am>[1804123.627104]  [<ffffffff802b29cf>] pipe_read+0x33b/0x39c
     483<Sep/15 08:50 am>[1804123.627104]  [<ffffffff802b935b>] core_sys_select+0x1fc/0x
     4842a4
     485<Sep/15 08:50 am>[1804123.627104]  [<ffffffff802b9190>] core_sys_select+0x31/0x2
     486a4
     487<Sep/15 08:50 am>[1804123.627104]  [<ffffffff802abee0>] do_sync_read+0xc9/0x10c
     488<Sep/15 08:50 am>[1804123.627104]  [<ffffffff8024bfda>] autoremove_wake_function
     489+0x0/0x2e
     490<Sep/15 08:50 am>[1804123.627104]  [<ffffffff8023d7df>] timespec_add_safe+0x34/0
     491x63
     492<Sep/15 08:50 am>[1804123.627104]  [<ffffffff802b95e2>] sys_select+0x95/0xbe
     493<Sep/15 08:50 am>[1804123.627104]  [<ffffffff8020bd2b>] system_call_fastpath+0x1
     4946/0x1b
     495<Sep/15 08:51 am>[1804123.930018] BUG: spinlock lockup on CPU#1, swapper/0, ffff
     49688002805e480
     497<Sep/15 08:51 am>[1804123.930018] Pid: 0, comm: swapper Tainted: G      D    2.6
     498.28-rc7-00105-gfeaf384 #4
     499<Sep/15 08:51 am>[1804123.930018] Call Trace:
     500<Sep/15 08:51 am>[1804123.930018]  <IRQ>  [<ffffffff803a103f>] _raw_spin_lock+0x
     501fb/0x122
     502
     503<Sep/15 08:51 am>[1804123.930018]  [<ffffffff805b7758>] _spin_lock_irqsave+0x37/
     5040x3f
     505<Sep/15 08:51 am>[1804123.930018]  [<ffffffff80235bc3>] tg_shares_up+0x194/0x212
     506<Sep/15 08:51 am>[1804123.930018]  [<ffffffff80235bc3>] tg_shares_up+0x194/0x212
     507<Sep/15 08:51 am>[1804123.930018]  [<ffffffff80235a2f>] tg_shares_up+0x0/0x212
     508<Sep/15 08:51 am>[1804123.930018]  [<ffffffff8022d8c2>] tg_nop+0x0/0x8
     509<Sep/15 08:51 am>[1804123.930018]  [<ffffffff8022f541>] walk_tg_tree+0x90/0xc7
     510<Sep/15 08:51 am>[1804123.930018]  [<ffffffff8022f4b1>] walk_tg_tree+0x0/0xc7
     511<Sep/15 08:51 am>[1804123.930018]  [<ffffffff80232949>] rebalance_domains+0x13c/
     5120x3f8
     513<Sep/15 08:51 am>[1804123.930018]  [<ffffffff80236528>] run_rebalance_domains+0x
     51442/0xd6
     515<Sep/15 08:51 am>[1804123.930018]  [<ffffffff8024ec57>] ktime_get+0xc/0x41
     516<Sep/15 08:51 am>[1804123.930018]  [<ffffffff8023e144>] __do_softirq+0x7a/0x13d
     517<Sep/15 08:51 am>[1804123.930018]  [<ffffffff8020d07c>] call_softirq+0x1c/0x28
     518<Sep/15 08:51 am>[1804123.930018]  [<ffffffff8020e028>] do_softirq+0x2c/0x68
     519<Sep/15 08:51 am>[1804123.930018]  [<ffffffff8023e084>] irq_exit+0x3f/0x85
     520<Sep/15 08:51 am>[1804123.930018]  [<ffffffff8021e66d>] smp_apic_timer_interrupt
     521<Sep/15 08:51 am>
     522                 <Sep/15 08:51 am>[1804123.930018]  [<ffffffff8020cacb>] apic_ti
     523mer_interrupt+0x6b/0x70
     524<Sep/15 08:51 am>[1804123.930018]  <EOI>  [<ffffffff80212496>] c1e_idle+0x0/0xe9
     525<Sep/15 08:51 am>[1804123.930018]  [<ffffffff805b9df2>] __atomic_notifier_call_c
     526hain+0x0/0x83
     527<Sep/15 08:51 am>[1804123.930018]  [<ffffffff8021237c>] default_idle+0x27/0x3b
     528<Sep/15 08:51 am>[1804123.930018]  [<ffffffff8021257b>] c1e_idle+0xe5/0xe9
     529<Sep/15 08:51 am>[1804123.930018]  [<ffffffff8020ac41>] cpu_idle+0x4a/0x6d
     530<Sep/15 08:51 am>[1804123.592933] BUG: spinlock lockup on CPU#0, pclient/25463,
     531ffff880135a53180
     532
     533<Sep/15 08:51 am>[1804123.592933] Pid: 25463, comm: pclient Tainted: G      D   
     534 2.6.28-rc7-00105-gfeaf384 #4
     535<Sep/15 08:51 am>[1804123.592933] Call Trace:
     536<Sep/15 08:51 am>[1804123.592933]  [<ffffffff803a103f>] _raw_spin_lock+0xfb/0x12
     5372
     538<Sep/15 08:51 am>[1804123.592933]  [<ffffffff805b7758>] _spin_lock_irqsave+0x37/
     5390x3f
     540<Sep/15 08:51 am>[1804123.592933]  [<ffffffff8024e812>] lock_hrtimer_base+0x1b/0
     541x3c
     542<Sep/15 08:51 am>[1804123.592933]  [<ffffffff8024e812>] lock_hrtimer_base+0x1b/0
     543x3c
     544<Sep/15 08:51 am>[1804123.592933]  [<ffffffff8024e887>] hrtimer_try_to_cancel+0x
     54516/0x70
     546<Sep/15 08:51 am>[1804123.592933]  [<ffffffff8024e8ed>] hrtimer_cancel+0xc/0x16
     547<Sep/15 08:51 am>[1804123.592933]  [<ffffffff8023c505>] do_exit+0x19f/0x74d
     548<Sep/15 08:51 am>[1804123.592933]  [<ffffffff805b83fa>] oops_begin+0x0/0x8d
     549<Sep/15 08:51 am>[1804123.592933]  [<ffffffff805b795d>] error_exit+0x0/0x9a
     550<Sep/15 08:51 am>[1804123.592933]  [<ffffffff8037ca54>] cap_file_permission+0x0/
     5510x3
     552<Sep/15 08:51 am>[1804123.592933]  [<ffffffff8022f75a>] enqueue_entity+0x6e/0x17
     553f
     554<Sep/15 08:51 am>[1804123.592933]  [<ffffffff8022f707>] enqueue_entity+0x1b/0x17
     555f
     556<Sep/15 08:51 am>[1804123.592933]  [<ffffffff8022f8f1>] enqueue_task_fair+0x25/0
     557x42
     558<Sep/15 08:51 am>[1804123.592933]  [<ffffffff8022e8f3>] enqueue_task+0x50/0x5b
     559<Sep/15 08:51 am>[1804123.592933]  [<ffffffff8022e920>] activate_task+0x22/0x2a
     560<Sep/15 08:51 am>[1804123.592933]  [<ffffffff8023276f>] try_to_wake_up+0x1c8/0x2
     5613b
     562<Sep/15 08:51 am>[1804123.592933]  [<ffffffff8022dffe>] __wake_up_common+0x41/0x
     56374
     564<Sep/15 08:51 am>[1804123.592933]  [<ffffffff8022efea>] __wake_up_sync+0x3a/0x56
     565<Sep/15 08:51 am>[1804123.592933]  [<ffffffff8050eba6>] sock_def_readable+0x3d/0
     566x6a
     567<Sep/15 08:51 am>[1804123.592933]  [<ffffffff8055e063>] unix_stream_sendmsg+0x22
     568c/0x2ed
     569
     570<Sep/15 08:51 am>[1804123.592933]  [<ffffffff8050a4bb>] sock_aio_write+0xd1/0xe0
     571<Sep/15 08:51 am>[1804123.592933]  [<ffffffff80257376>] __lock_acquire+0x788/0x7
     572f3
     573<Sep/15 08:51 am>[1804123.592933]  [<ffffffff802abdd4>] do_sync_write+0xc9/0x10c
     574<Sep/15 08:51 am>[1804123.592933]  [<ffffffff8024bfda>] autoremove_wake_function
     575+0x0/0x2e
     576<Sep/15 08:51 am>[1804123.592933]  [<ffffffff805b76fc>] _spin_unlock_irq+0x1f/0x
     57722
     578<Sep/15 08:51 am>[1804123.592933]  [<ffffffff802430b9>] do_sigaction+0x140/0x154
     579<Sep/15 08:51 am>[1804123.592933]  [<ffffffff802ac544>] vfs_write+0xc0/0x136
     580<Sep/15 08:51 am>[1804123.592933]  [<ffffffff802ac9bb>] sys_write+0x45/0x6e
     581<Sep/15 08:51 am>[1804123.592933]  [<ffffffff8020bd2b>] system_call_fastpath+0x1
     5826/0x1b
     583
     584}}}