IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links
wiki:Ipp016-crash-20081103

<pre> <Nov/03 11:20 am>ipp016 login: <Nov/03 11:20 am> <Nov/03 11:20 am>This is ipp016.unknown_domain (Linux x86_64 2.6.27-rc8-00016-gd3a47e8) 12:46:12 <Nov/03 04:32 pm>ipp016 login: [18843.138574] divide error: 0000 [1] SMP <Nov/03 04:32 pm>[18843.141870] CPU 1 <Nov/03 04:32 pm>[18843.141870] Modules linked in: w83627hf hwmon_vid autofs4 smsc37b787_wdt k8temp i2c_nforce2 i2c_core forcedeth tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan <Nov/03 04:32 pm>[18843.141870] Pid: 0, comm: swapper Not tainted 2.6.27-rc8-00016-gd3a47e8 #1 <Nov/03 04:32 pm>[18843.141870] RIP: 0010:[<ffffffff80230df9>] [<ffffffff80230df9>] load_balance_fair+0xdb/0x223 <Nov/03 04:32 pm>[18843.141870] RSP: 0018:ffff88012fa87d30 EFLAGS: 00010046 <Nov/03 04:32 pm>[18843.141870] RAX: 000000000006a000 RBX: 0000000000000800 RCX: 0000000000000000 <Nov/03 04:32 pm>[18843.141870] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffffff807a1080 <Nov/03 04:32 pm>[18843.141870] RBP: ffff88012fa87dd0 R08: 0000000000000002 R09: 0000000000000001 <Nov/03 04:32 pm>[18843.141870] R10: 0000000000000000 R11: ffffffff8022ad25 R12: ffff88002806b100 <Nov/03 04:32 pm>[18843.141870] R13: ffff88022fa66cc0 R14: 0000000000000000 R15: ffff880217ac5120 <Nov/03 04:32 pm>[18843.141870] FS: 00007f9297d876f0(0000) GS:ffff88012fc02b00(0000) knlGS:0000000000000000 <Nov/03 04:32 pm>[18843.141870] CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b <Nov/03 04:32 pm>[18843.141870] CR2: 00007f05a2209618 CR3: 00000000655e2000 CR4: 00000000000006e0 <Nov/03 04:32 pm>[18843.141870] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 <Nov/03 04:32 pm>[18843.141870] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 <Nov/03 04:32 pm>[18843.141870] Process swapper (pid: 0, threadinfo ffff88022fa38000, task ffff88012fa88000) <Nov/03 04:32 pm>[18843.141870] Stack: ffffffff80230d1e 0000000000000000 000000002fa87e98 ffff880028065980 <Nov/03 04:32 pm>[18843.141870] 00000000000000d4 ffff88013624a100 000000012fa37000 ffff88002806b100 <Nov/03 04:32 pm>[18843.141870] 0000000000000010 00000000000000d4 007fffffffffffff 0000000000000800 <Nov/03 04:32 pm>[18843.141870] Call Trace: <Nov/03 04:32 pm>[18843.141870] <IRQ> [<ffffffff80230d1e>] ? load_balance_fair+0x0/0x223 <Nov/03 04:32 pm>[18843.141870] [<ffffffff80229c55>] move_tasks+0x67/0xa3 <Nov/03 04:32 pm>[18843.141870] [<ffffffff8024bdda>] ? sched_clock_cpu+0xe8/0x12b <Nov/03 04:32 pm>[18843.141870] [<ffffffff8022e75d>] rebalance_domains+0x1e8/0x3f7 <Nov/03 04:32 pm>[18843.141870] [<ffffffff80231990>] run_rebalance_domains+0x42/0xd8 <Nov/03 04:32 pm>[18843.141870] [<ffffffff80239d7a>] do_softirq+0x5e/0xcd <Nov/03 04:32 pm>[18843.141870] [<ffffffff8020d17c>] ? call_softirq+0x1c/0x28 <Nov/03 04:32 pm>[18843.141870] [<ffffffff8020e82a>] ? do_softirq+0x2c/0x68 <Nov/03 04:32 pm>[18843.141870] [<ffffffff80239cd6>] ? irq_exit+0x3f/0x85 <Nov/03 04:32 pm>[18843.141870] [<ffffffff8021c2a1>] ? smp_apic_timer_interrupt+0x8e/0xa9 <Nov/03 04:32 pm>[18843.141870] [<ffffffff8020cbc6>] ? apic_timer_interrupt+0x66/0x70 <Nov/03 04:32 pm>[18843.141870] <EOI> [<ffffffff802123da>] ? c1e_idle+0x0/0xe9<Nov/03 04:32 pm>[18843.141870] [<ffffffff805ca841>] ? atomic_notifier_call_chain+0x0/0x83 <Nov/03 04:32 pm>[18843.141870] [<ffffffff802122c5>] ? default_idle+0x27/0x3b <Nov/03 04:32 pm>[18843.141870] [<ffffffff802124bf>] ? c1e_idle+0xe5/0xe9 <Nov/03 04:32 pm>[18843.141870] [<ffffffff8020abde>] ? cpu_idle+0x88/0xae <Nov/03 04:32 pm>[18843.141870] <Nov/03 04:32 pm>[18843.141870] <Nov/03 04:32 pm>[18843.141870] Code: 90 00 00 00 00 0f 84 16 01 00 00 48 8b 45 a8 8b 55 b0 c7 45 d4 00 00 00 00 c7 45 c0 00 00 00 00 48 0f af c3 ff c2 48 89 d1 31 d2 <48> f7 f1 48 85 c0 49 89 c6 49 89 c4 0f 84 9a 00 00 00 4c 89 ef <Nov/03 04:32 pm>[18843.141870] RIP [<ffffffff80230df9>] load_balance_fair+0xdb/0x223 <Nov/03 04:32 pm>[18843.141870] RSP <ffff88012fa87d30> <Nov/03 04:32 pm>[18843.141870] ---[ end trace c68dd3e66fb0a79d ]--- <Nov/03 04:32 pm>[18843.141870] Kernel panic - not syncing: Aiee, killing interrupt handler! <Nov/03 04:32 pm>[18843.141870] ------------[ cut here ]------------ <Nov/03 04:32 pm>[18843.141870] WARNING: at kernel/smp.c:332 smp_call_function_mask+0x37/0x1d6() <Nov/03 04:32 pm>[18843.141870] Modules linked in: w83627hf hwmon_vid autofs4 smsc37b787_wdt k8temp i2c_nforce2 i2c_core forcedeth tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan <Nov/03 04:32 pm>[18843.141870] Pid: 0, comm: swapper Tainted: G D 2.6.27-rc8-00016-gd3a47e8 #1 <Nov/03 04:32 pm>[18843.141870]

<Nov/03 04:32 pm>[18843.141870] Call Trace:

<Nov/03 04:32 pm>[18843.141870] <IRQ> [<ffffffff80235505>] warn_on_slowpath+0x51/0x77 <Nov/03 04:32 pm>[18843.141870] [<ffffffff805ca8b5>] atomic_notifier_call_chain+0x74/0x83 <Nov/03 04:32 pm>[18843.141870] [<ffffffff80256c6b>] smp_call_function_mask+0x37/0x1d6 <Nov/03 04:32 pm>[18843.141870] [<ffffffff8025f3e7>] crash_kexec+0x17/0xef <Nov/03 04:32 pm>[18843.141870] [<ffffffff8025f4b6>] crash_kexec+0xe6/0xef <Nov/03 04:32 pm>[18843.141870] [<ffffffff8021b5f6>] native_smp_send_stop+0x1a/0x26 <Nov/03 04:32 pm>[18843.141870] [<ffffffff8023540a>] panic+0x95/0x13f <Nov/03 04:32 pm>[18843.141870] [<ffffffff8023609c>] printk+0x4e/0x56 <Nov/03 04:32 pm>[18843.141870] [<ffffffff803cc0ef>] vgacon_set_cursor_size+0x40/0x10b <Nov/03 04:32 pm>[18843.141870] [<ffffffff802380be>] do_exit+0x71/0x778 <Nov/03 04:32 pm>[18843.141870] [<ffffffff805c8851>] oops_begin+0x0/0x8c <Nov/03 04:32 pm>[18843.141870] [<ffffffff8020dcc0>] do_divide_error+0x81/0x8b <Nov/03 04:32 pm>[18843.141870] [<ffffffff80230df9>] load_balance_fair+0xdb/0x223 <Nov/03 04:32 pm>[18843.141870] [<ffffffff8024a6f7>] hrtimer_start+0x111/0x133 <Nov/03 04:32 pm>[18843.141870] [<ffffffff805c844d>] error_exit+0x0/0x9a <Nov/03 04:32 pm>[18843.141870] [<ffffffff8022ad25>] walk_tg_tree+0x0/0xbc <Nov/03 04:32 pm>[18843.141870] [<ffffffff80230df9>] load_balance_fair+0xdb/0x223 <Nov/03 04:32 pm>[18843.141870] [<ffffffff80230d1e>] load_balance_fair+0x0/0x223 <Nov/03 04:32 pm>[18843.141870] [<ffffffff80229c55>] move_tasks+0x67/0xa3 <Nov/03 04:32 pm>[18843.141870] [<ffffffff8024bdda>] sched_clock_cpu+0xe8/0x12b<Nov/03 04:32 pm>[18843.141870] [<ffffffff8022e75d>] rebalance_domains+0x1e8/0x3f7 <Nov/03 04:32 pm>[18843.141870] [<ffffffff80231990>] run_rebalance_domains+0x42/0xd8 <Nov/03 04:32 pm>[18843.141870] [<ffffffff80239d7a>] do_softirq+0x5e/0xcd <Nov/03 04:32 pm>[18843.141870] [<ffffffff8020d17c>] call_softirq+0x1c/0x28 <Nov/03 04:32 pm>[18843.141870] [<ffffffff8020e82a>] do_softirq+0x2c/0x68 <Nov/03 04:32 pm>[18843.141870] [<ffffffff80239cd6>] irq_exit+0x3f/0x85 <Nov/03 04:32 pm>[18843.141870] [<ffffffff8021c2a1>] smp_apic_timer_interrupt+0x8e/0xa9 <Nov/03 04:32 pm>[18843.141870] [<ffffffff8020cbc6>] apic_timer_interrupt+0x66/0x70 <Nov/03 04:32 pm>[18843.141870] <EOI> [<ffffffff802123da>] c1e_idle+0x0/0xe9 <Nov/03 04:32 pm>[18843.141870] [<ffffffff805ca841>] atomic_notifier_call_chain+0x0/0x83 <Nov/03 04:32 pm>[18843.141870] [<ffffffff802122c5>] default_idle+0x27/0x3b <Nov/03 04:32 pm>[18843.141870] [<ffffffff802124bf>] c1e_idle+0xe5/0xe9 <Nov/03 04:32 pm>[18843.141870] [<ffffffff8020abde>] cpu_idle+0x88/0xae <Nov/03 04:32 pm>[18843.141870] <Nov/03 04:32 pm>[18843.141870] ---[ end trace c68dd3e66fb0a79d ]--- <Nov/03 04:35 pm>[18843.142288] BUG: spinlock lockup on CPU#2, getshapes/3725, ffff88013624a100 <Nov/03 04:35 pm>[18843.142288] Pid: 3725, comm: getshapes Tainted: G D W 2.6.27-rc8-00016-gd3a47e8 #1 <Nov/03 04:35 pm>[18843.142288] <Nov/03 04:35 pm>[18843.142288] Call Trace: <Nov/03 04:35 pm>[18843.142288] <IRQ> [<ffffffff803be0c4>] _raw_spin_lock+0xf9/0x120 <Nov/03 04:35 pm>[18843.142288] [<ffffffff80232437>] scheduler_tick+0x47/0x1b8 <Nov/03 04:35 pm>[18843.142288] [<ffffffff8023e0b1>] update_process_times+0x3f/0x4b <Nov/03 04:35 pm>[18843.142288] [<ffffffff802506fa>] tick_sched_timer+0x76/0xa7<Nov/03 04:35 pm>[18843.142288] [<ffffffff80250684>] tick_sched_timer+0x0/0xa7 <Nov/03 04:35 pm>[18843.142288] [<ffffffff80249fce>] run_hrtimer+0x5a/0x97 <Nov/03 04:35 pm>[18843.142288] [<ffffffff8024a9fb>] hrtimer_interrupt+0xe3/0x15d <Nov/03 04:35 pm>[18843.142288] [<ffffffff8021c29c>] smp_apic_timer_interrupt+0x89/0xa9 <Nov/03 04:35 pm>[18843.142288] [<ffffffff8020cbc6>] apic_timer_interrupt+0x66/0x70 <Nov/03 04:35 pm>[18843.142288] <EOI> <Nov/03 04:35 pm>[18843.152708] BUG: spinlock lockup on CPU#3, ppStack/22786, ffff88013624a100 <Nov/03 04:35 pm>[18843.152708] Pid: 22786, comm: ppStack Tainted: G D W 2.6.27-rc8-00016-gd3a47e8 #1 <Nov/03 04:35 pm>[18843.152708] <Nov/03 04:35 pm>[18843.152708] Call Trace: <Nov/03 04:35 pm>[18843.152708] [<ffffffff803be0c4>] _raw_spin_lock+0xf9/0x120 <Nov/03 04:35 pm>[18843.152708] [<ffffffff805c8248>] _spin_lock_irqsave+0x37/0x3f <Nov/03 04:35 pm>[18843.152708] [<ffffffff80231d47>] tg_shares_up+0xcf/0x195 <Nov/03 04:35 pm>[18843.152708] [<ffffffff80231d47>] tg_shares_up+0xcf/0x195 <Nov/03 04:35 pm>[18843.152708] [<ffffffff80231c78>] tg_shares_up+0x0/0x195 <Nov/03 04:35 pm>[18843.152708] [<ffffffff802296d8>] tg_nop+0x0/0x6 <Nov/03 04:35 pm>[18843.152708] [<ffffffff8022adb5>] walk_tg_tree+0x90/0xbc <Nov/03 04:35 pm>[18843.152708] [<ffffffff8022ad25>] walk_tg_tree+0x0/0xbc <Nov/03 04:35 pm>[18843.152708] [<ffffffff8022e3c2>] try_to_wake_up+0xb0/0x238 <Nov/03 04:35 pm>[18843.152708] [<ffffffff80229d46>] wake_up_common+0x41/0x74<Nov/03 04:35 pm>[18843.152708] [<ffffffff8022a926>] wake_up+0x38/0x4f <Nov/03 04:35 pm>[18843.152708] [<ffffffff80254533>] wake_futex+0x1f/0x29 <Nov/03 04:35 pm>[18843.152708] [<ffffffff80254602>] futex_wake+0xc5/0x10a <Nov/03 04:35 pm>[18843.152708] [<ffffffff8025548d>] do_futex+0xa6/0x7a8 <Nov/03 04:35 pm>[18843.152708] [<ffffffff805c81ec>] _spin_unlock_irq+0x1f/0x22<Nov/03 04:35 pm>[18843.152708] [<ffffffff802303e7>] finish_task_switch+0x5f/0xfd <Nov/03 04:35 pm>[18843.152708] [<ffffffff80230388>] finish_task_switch+0x0/0xfd <Nov/03 04:35 pm>[18843.152708] [<ffffffff80255c8e>] sys_futex+0xff/0x11d <Nov/03 04:35 pm>[18843.152708] [<ffffffff8020be2b>] system_call_fastpath+0x16/0x1b <Nov/03 04:35 pm>[18843.152708] <Nov/03 04:35 pm>[18843.141453] BUG: spinlock lockup on CPU#0, acf/3719, ffff880<Nov/03 04:35 pm> <Nov/03 04:35 pm>[18843.141453] Pid: 3719, comm: acf Tainted: G D W 2.6.27-rc8-00016-gd3a47e8 #1 <Nov/03 04:35 pm>[18843.141453] <Nov/03 04:35 pm>[18843.141453] Call Trace: <Nov/03 04:35 pm>[18843.141453] <IRQ> [<ffffffff803be0c4>] _raw_spin_lock+0xf9/0x120 <Nov/03 04:35 pm>[18843.141453] [<ffffffff805c8248>] _spin_lock_irqsave+0x37/0x3f <Nov/03 04:35 pm>[18843.141453] [<ffffffff80231d47>] tg_shares_up+0xcf/0x195 <Nov/03 04:35 pm>[18843.141453] [<ffffffff80231d47>] tg_shares_up+0xcf/0x195 <Nov/03 04:35 pm>[18843.141453] [<ffffffff80231c78>] tg_shares_up+0x0/0x195 <Nov/03 04:35 pm>[18843.141453] [<ffffffff802296d8>] tg_nop+0x0/0x6 <Nov/03 04:35 pm>[18843.141453] [<ffffffff8022adb5>] walk_tg_tree+0x90/0xbc <Nov/03 04:35 pm>[18843.141453] [<ffffffff8022ad25>] walk_tg_tree+0x0/0xbc <Nov/03 04:35 pm>[18843.141453] [<ffffffff8022e3c2>] try_to_wake_up+0xb0/0x238 <Nov/03 04:35 pm>[18843.141453] [<ffffffff8024a1bc>] hrtimer_wakeup+0x0/0x21 <Nov/03 04:35 pm>[18843.141453] [<ffffffff8024a1d9>] hrtimer_wakeup+0x1d/0x21 <Nov/03 04:35 pm>[18843.141453] [<ffffffff80249fce>] run_hrtimer+0x5a/0x97 <Nov/03 04:35 pm>[18843.141453] [<ffffffff8024a9fb>] hrtimer_interrupt+0xe3/0x15d <Nov/03 04:35 pm>[18843.141453] [<ffffffff8021c29c>] smp_apic_timer_interrupt+0x89/0xa9 <Nov/03 04:35 pm>[18843.141453] [<ffffffff8020cbc6>] apic_timer_interrupt+0x66/0x70 <Nov/03 04:35 pm>[18843.141453] <EOI> <Nov/03 04:35 pm>[18843.694012] BUG: spinlock lockup on CPU#1, swapper/0, ffff88002806b100 <Nov/03 04:35 pm>[18843.694012] Pid: 0, comm: swapper Tainted: G D W 2.6.27-rc8-00016-gd3a47e8 #1 <Nov/03 04:35 pm>[18843.694012] <Nov/03 04:35 pm>[18843.694012] Call Trace: <Nov/03 04:35 pm>[18843.694012] <IRQ> [<ffffffff803be0c4>] _raw_spin_lock+0xf9/0x120 <Nov/03 04:35 pm>[18843.694012] [<ffffffff80232437>] scheduler_tick+0x47/0x1b8 <Nov/03 04:35 pm>[18843.694012] [<ffffffff8023e0b1>] update_process_times+0x3f/0x4b <Nov/03 04:35 pm>[18843.694012] [<ffffffff802506fa>] tick_sched_timer+0x76/0xa7<Nov/03 04:35 pm>[18843.694012] [<ffffffff80250684>] tick_sched_timer+0x0/0xa7 <Nov/03 04:35 pm>[18843.694012] [<ffffffff80249fce>] run_hrtimer+0x5a/0x97 <Nov/03 04:35 pm>[18843.694012] [<ffffffff8024a9fb>] hrtimer_interrupt+0xe3/0x15d <Nov/03 04:35 pm>[18843.694012] [<ffffffff8021c29c>] smp_apic_timer_interrupt+0x89/0xa9 <Nov/03 04:35 pm>[18843.694012] [<ffffffff8020cbc6>] apic_timer_interrupt+0x66/0x70 <Nov/03 04:35 pm>[18843.694012] [<ffffffff805ca841>] atomic_notifier_call_chain+0x0/0x83 <Nov/03 04:35 pm>[18843.694012] [<ffffffff804d8d8c>] i8042_panic_blink+0x0/0x14<Nov/03 04:35 pm>

<Nov/03 04:35 pm>[18843.694012] [<ffffffff805ca841>] atomic_notifier_call_chain+0x0/0x83

<Nov/03 04:35 pm>[18843.694012] [<ffffffff805ca841>] atomic_notifier_call_chain+0x0/0x83 <Nov/03 04:35 pm>[18843.694012] [<ffffffff80235492>] panic+0x11d/0x13f <Nov/03 04:35 pm>[18843.694012] [<ffffffff8023541f>] panic+0xaa/0x13f <Nov/03 04:35 pm>[18843.694012] [<ffffffff8023609c>] printk+0x4e/0x56 <Nov/03 04:35 pm>[18843.694012] [<ffffffff803cc0ef>] vgacon_set_cursor_size+0x40/0x10b <Nov/03 04:35 pm>[18843.694012] [<ffffffff802380be>] do_exit+0x71/0x778 <Nov/03 04:35 pm>[18843.694012] [<ffffffff805c8851>] oops_begin+0x0/0x8c <Nov/03 04:35 pm>[18843.694012] [<ffffffff8020dcc0>] do_divide_error+0x81/0x8b <Nov/03 04:35 pm>[18843.694012] [<ffffffff80230df9>] load_balance_fair+0xdb/0x223 <Nov/03 04:35 pm>[18843.694012] [<ffffffff8024a6f7>] hrtimer_start+0x111/0x133 <Nov/03 04:35 pm>[18843.694012] [<ffffffff805c844d>] error_exit+0x0/0x9a <Nov/03 04:35 pm>[18843.694012] [<ffffffff8022ad25>] walk_tg_tree+0x0/0xbc <Nov/03 04:35 pm>[18843.694012] [<ffffffff80230df9>] load_balance_fair+0xdb/0x223 <Nov/03 04:35 pm>[18843.694012] [<ffffffff80230d1e>] load_balance_fair+0x0/0x223 <Nov/03 04:35 pm>[18843.694012] [<ffffffff80229c55>] move_tasks+0x67/0xa3

<Nov/03 04:35 pm>[18843.694012] [<ffffffff8024bdda>] sched_clock_cpu+0xe8/0x12b

<Nov/03 04:35 pm>[18843.694012] [<ffffffff8022e75d>] rebalance_domains+0x1e8/0x3f7 <Nov/03 04:35 pm>[18843.694012] [<ffffffff80231990>] run_rebalance_domains+0x42<Nov/03 04:35 pm>

<Nov/03 04:35 pm>[18843.694012] [<ffffffff80239d7a>] do_softirq+0x5e/0xcd

<Nov/03 04:35 pm>[18843.694012] [<ffffffff8020d17c>] call_softirq+0x1c/0x28 <Nov/03 04:35 pm>[18843.694012] [<ffffffff8020e82a>] do_softirq+0x2c/0x68 <Nov/03 04:35 pm>[18843.694012] [<ffffffff80239cd6>] irq_exit+0x3f/0x85 <Nov/03 04:35 pm>[18843.694012] [<ffffffff8021c2a1>] smp_apic_timer_interrupt+0x8e/0xa9 <Nov/03 04:35 pm>[18843.694012] [<ffffffff8020cbc6>] apic_timer_interrupt+0x66/0x70 <Nov/03 04:35 pm>[18843.694012] <EOI> [<ffffffff802123da>] c1e_idle+0x0/0xe9 <Nov/03 04:35 pm>[18843.694012] [<ffffffff805ca841>] atomic_notifier_call_chain+0x0/0x83 <Nov/03 04:35 pm>[18843.694012] [<ffffffff802122c5>] default_idle+0x27/0x3b <Nov/03 04:35 pm>[18843.694012] [<ffffffff802124bf>] c1e_idle+0xe5/0xe9 <Nov/03 04:35 pm>[18843.694012] [<ffffffff8020abde>] cpu_idle+0x88/0xae <Nov/03 04:35 pm>[18843.694012] </pre>

Last modified 17 years ago Last modified on Feb 24, 2009, 4:23:56 PM
Note: See TracWiki for help on using the wiki.