<Oct/06 02:25 am>[648977.776368]  <EOI> <0>general protection fault: 0000 [#1] SMP
<Oct/06 02:25 am>[648977.863036] last sysfs file: /sys/devices/system/cpu/cpu2/cpufreq/scaling_cur_freq
<Oct/06 02:25 am>[648977.863036] CPU 3

<Oct/06 02:25 am>[648977.863036] Modules linked in: w83627hf hwmon_vid autofs4 smsc37b787_wdt k8temp i2c_nforce2 i2c_core forcedeth tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan
<Oct/06 02:25 am>[648977.863036] Pid: 25738, comm: pclient Not tainted 2.6.28-rc7-00105-gfeaf384 #4
<Oct/06 02:25 am>[648977.863036] RIP: 0010:[<ffffffff8020e159>]  [<ffffffff8020e159>] do_IRQ+0xf5/0x16c
<Oct/06 02:25 am>[648977.863036] RSP: 0000:ffff88012fac3f88  EFLAGS: 00010086
<Oct/06 02:25 am>[648977.863036] RAX: fff0ffff80278c2b RBX: ffff88020150ff58 RCX: 00007fff620396d0
<Oct/06 02:25 am>[648977.863036] RDX: ffffffff80928000 RSI: ffffffff8081b500 RDI: 0000000000000011
<Oct/06 02:25 am>[648977.863036] RBP: 0000000000000011 R08: 00007fe355d4d010 R09: 0000000000000000
<Oct/06 02:25 am>[648977.863036] R10: 0000000000000000 R11: 00007fe35886b124 R12: 0000000000000091
<Oct/06 02:25 am>[648977.863036] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
<Oct/06 02:25 am>[648977.863036] FS:  00007fe35a0146f0(0000) GS:ffff88022fa62780(0000) knlGS:0000000000000000
<Oct/06 02:25 am>[648977.863036] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<Oct/06 02:25 am>[648977.863036] CR2: 00007ff680724960 CR3: 00000002281a3000 CR4: 00000000000006e0
<Oct/06 02:25 am>[648977.863036] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
<Oct/06 02:25 am>[648977.863036] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
<Oct/06 02:25 am>[648977.863036] Process pclient (pid: 25738, threadinfo ffff88020150e000, task ffff8801d50aad90)
<Oct/06 02:25 am>[648977.863036] Stack:
<Oct/06 02:25 am>[648977.863036]  0000000000000000 00000000ffffffff ffff88020150ff80 00000000008be350
<Oct/06 02:25 am>[648977.863036]  0000000000000000 ffffffff8020c2f6 ffff88020150ff80 <EOI>  00007fe35886aaa8
<Oct/06 02:25 am>[648977.863036]  00007fe35886b124 0000000000000000 0000000000000000 00007fe355d4d010
<Oct/06 02:25 am>[648977.863036] Call Trace:
<Oct/06 02:25 am>[648977.863036]  <IRQ> <0> [<ffffffff8020c2f6>] ? ret_from_intr+0x0/0xa
<Oct/06 02:25 am>[648977.863036]  <EOI> <0>Code: 63 58 00 3b 2d 69 ed 59 00 73 2d 89 e8 48 c1 e0 08 48 89 c6 48 81 c6 00 a4 81 80 74 1b 48 8b 80 08 a4 81 80 48 85 c0 74 06 89 ef <ff> d0 eb 4c 89 ef e8 cf 91 06 00 eb 43 83 3d 43 c3 73 00 00 75

<Oct/06 02:25 am>[648977.863036] RIP  [<ffffffff8020e159>] do_IRQ+0xf5/0x16c
<Oct/06 02:25 am>[648977.863036]  RSP <ffff88012fac3f88>
<Oct/06 02:25 am>[648977.863036] Kernel panic - not syncing: Fatal exception in interrupt
<Oct/06 02:25 am>[648977.879282] general protection fault: 0000 [#2] SMP
<Oct/06 02:25 am>[648977.879282] last sysfs file: /sys/devices/system/cpu/cpu2/cpufreq/scaling_cur_freq
<Oct/06 02:25 am>[648977.879282] CPU 2
<Oct/06 02:25 am>[648977.879282] Modules linked in: w83627hf hwmon_vid autofs4 smsc37b787_wdt k8temp i2c_nforce2 i2c_core forcedeth tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan
<Oct/06 02:25 am>[648977.879282] Pid: 2524, comm: pclient Tainted: G      D    2.6.28-rc7-00105-gfeaf384 #4
<Oct/06 02:25 am>[648977.879282] RIP: 0010:[<ffffffff8042d89a>]  [<ffffffff8042d89a>] scsi_run_queue+0x13d/0x367
<Oct/06 02:25 am>[648977.879282] RSP: 0000:ffff88022fa8bdd0  EFLAGS: 00010087
<Oct/06 02:25 am>[648977.879282] RAX: ffff88022fa8bde0 RBX: ffff88022e509028 RCX: ffff88022fa8bde0
<Oct/06 02:25 am>[648977.879282] RDX: ffff88012e5d4068 RSI: fff088012e5d4068 RDI: ffff88012e5d4068
<Oct/06 02:25 am>[648977.879282] RBP: ffff88022e026168 R08: 0000000000000001 R09: 0000000000000001
<Oct/06 02:25 am>[648977.879282] R10: 0000000000000000 R11: ffffffff8027dff4 R12: ffff88012e5d4000
<Oct/06 02:25 am>[648977.879282] R13: 0000000000000282 R14: 0000000000000001 R15: ffff88022e026000
<Oct/06 02:25 am>[648977.879282] FS:  00007f51887ea6f0(0000) GS:ffff88022fa62300(0000) knlGS:0000000000000000
<Oct/06 02:25 am>[648977.879282] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<Oct/06 02:25 am>[648977.879282] CR2: 0000000000614e90 CR3: 00000000c58fc000 CR4: 00000000000006e0
<Oct/06 02:25 am>[648977.879282] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
<Oct/06 02:25 am>[648977.879282] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
<Oct/06 02:25 am>[648977.879282] Process pclient (pid: 2524, threadinfo ffff8800cbd4c000, task ffff8801d50acbf0)
<Oct/06 02:25 am>[648977.879282] Stack:

<Oct/06 02:25 am>[648977.879282]  ffff88012e520a28 ffff88022e509000 fff088012e5d4068 ffff88022fa8bde0
<Oct/06 02:25 am>[648977.879282]  ffff88012e520a28 ffff8801af9a5000 ffff88022e026168 ffff88012e520a28
<Oct/06 02:25 am>[648977.879282]  0000000000000000 0000000000000001 ffff88012e520a28 ffffffff8042e036
<Oct/06 02:25 am>[648977.879282] Call Trace:
<Oct/06 02:25 am>[648977.879282]  <IRQ> <0> [<ffffffff8042e036>] ? scsi_next_command+0x2d/0x39
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8042e26b>] ? scsi_end_request+0x86/0x97
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8042ee85>] ? scsi_io_completion+0x181/0x39f
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8038f583>] ? blk_done_softirq+0x5c/0x6d
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8021f2ab>] ? irq_complete_move+0xb/0x7e
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8023e144>] ? __do_softirq+0x7a/0x13d
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8020d07c>] ? call_softirq+0x1c/0x28
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8020e028>] ? do_softirq+0x2c/0x68
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8023e084>] ? irq_exit+0x3f/0x85
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8020e1ae>] ? do_IRQ+0x14a/0x16c
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8020c2f6>] ? ret_from_intr+0x0/0xa
<Oct/06 02:25 am>[648977.879282]  <EOI> <0>Code: 18 00 49 8b 74 24 68 49 8d 7c 24 68 49 89 c5 48 39 fe 0f 84 90 01 00 00 48 8b 4c 24 10 48 8b 57 08 48 8d 44 24 10 48 89 74 24 10 <48> 89 46 08 48 89 0a 48 89 51 08 49 89 7c 24 68 48 89 7f 08 e9
<Oct/06 02:25 am>[648977.879282] RIP  [<ffffffff8042d89a>] scsi_run_queue+0x13d/0x367
<Oct/06 02:25 am>[648977.879282]  RSP <ffff88022fa8bdd0>
<Oct/06 02:25 am>[648977.879282] Kernel panic - not syncing: Fatal exception in interrupt
<Oct/06 02:25 am>[648977.879282] ------------[ cut here ]------------
<Oct/06 02:25 am>[648977.879282] WARNING: at kernel/smp.c:333 smp_call_function_mask+0x37/0x1d7()
<Oct/06 02:25 am>[648977.879282] Modules linked in: w83627hf hwmon_vid autofs4 smsc37b787_wdt k8temp i2c_nforce2 i2c_core forcedeth tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan

<Oct/06 02:25 am>[648977.879282] Pid: 2524, comm: pclient Tainted: G      D    2.6.28-rc7-00105-gfeaf384 #4
<Oct/06 02:25 am>[648977.879282] Call Trace:
<Oct/06 02:25 am>[648977.879282]  <IRQ>  [<ffffffff802397db>] warn_on_slowpath+0x51/0x6d
<Oct/06 02:25 am>[648977.879282]  [<ffffffff805b7388>] _spin_unlock+0x17/0x20
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8024f65a>] down_trylock+0xe/0x2c
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8024f600>] cleanup_srcu_struct+0x4a/0x4f
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8025bc31>] smp_call_function_mask+0x37/0x1d7
<Oct/06 02:25 am>[648977.879282]  [<ffffffff80264013>] crash_kexec+0x17/0xef
<Oct/06 02:25 am>[648977.879282]  [<ffffffff802640e2>] crash_kexec+0xe6/0xef
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8021d53e>] native_smp_send_stop+0x1a/0x26
<Oct/06 02:25 am>[648977.879282]  [<ffffffff80239896>] panic+0x95/0x13f
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8024f65a>] down_trylock+0xe/0x2c
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8024f65a>] down_trylock+0xe/0x2c
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8023a475>] printk+0x4e/0x56
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8020e925>] show_registers+0x1eb/0x20e
<Oct/06 02:25 am>[648977.879282]  [<ffffffff803f0656>] do_unblank_screen+0xd/0x10d
<Oct/06 02:25 am>[648977.879282]  [<ffffffff805b83ed>] oops_end+0x7b/0x88
<Oct/06 02:25 am>[648977.879282]  [<ffffffff805b795d>] error_exit+0x0/0x9a
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8027dff4>] mempool_free_slab+0x0/0xe
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8042d89a>] scsi_run_queue+0x13d/0x367
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8042e036>] scsi_next_command+0x2d/0x39
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8042e26b>] scsi_end_request+0x86/0x97

<Oct/06 02:25 am>[648977.879282]  [<ffffffff8042ee85>] scsi_io_completion+0x181/0x39f
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8038f583>] blk_done_softirq+0x5c/0x6d
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8021f2ab>] irq_complete_move+0xb/0x7e
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8023e144>] __do_softirq+0x7a/0x13d
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8020d07c>] call_softirq+0x1c/0x28
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8020e028>] do_softirq+0x2c/0x68
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8023e084>] irq_exit+0x3f/0x85
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8020e1ae>] do_IRQ+0x14a/0x16c
<Oct/06 02:25 am>[648977.879282]  [<ffffffff8020c2f6>] ret_from_intr+0x0/0xa
<Oct/06 02:25 am>[648977.879282]  <EOI> <4>---[ end trace e80694d7bb2698b5 ]---
<Oct/06 02:25 am>[648977.863036] ------------[ cut here ]------------
<Oct/06 02:25 am>[648977.863036] WARNING: at kernel/smp.c:333 smp_call_function_mask+0x37/0x1d7()
<Oct/06 02:25 am>[648977.863036] Modules linked in: w83627hf hwmon_vid autofs4 smsc37b787_wdt k8temp i2c_nforce2 i2c_core forcedeth tg3 libphy e1000 xfs dm_snapshot dm_mirror dm_region_hash dm_log aacraid 3w_9xxx 3w_xxxx atp870u arcmsr aic7xxx scsi_wait_scan
<Oct/06 02:25 am>[648977.863036] Pid: 25738, comm: pclient Tainted: G      D W  2.6.28-rc7-00105-gfeaf384 #4
<Oct/06 02:25 am>[648977.863036] Call Trace:
<Oct/06 02:25 am>[648977.863036]  <IRQ>  [<ffffffff802397db>] warn_on_slowpath+0x51/0x6d
<Oct/06 02:25 am>[648977.863036]  [<ffffffff80239d00>] try_acquire_console_sem+0x12/0x31
<Oct/06 02:25 am>[648977.863036]  [<ffffffff80239ea9>] release_console_sem+0x18a/0x1a5
<Oct/06 02:25 am>[648977.863036]  [<ffffffff8025bc31>] smp_call_function_mask+0x37/0x1d7
<Oct/06 02:25 am>[648977.863036]  [<ffffffff80264013>] crash_kexec+0x17/0xef
<Oct/06 02:25 am>[648977.863036]  [<ffffffff802640e2>] crash_kexec+0xe6/0xef
<Oct/06 02:25 am>[648977.863036]  [<ffffffff8021d53e>] native_smp_send_stop+0x1a/0x26

<Oct/06 02:25 am>[648977.863036]  [<ffffffff80239896>] panic+0x95/0x13f
<Oct/06 02:25 am>[648977.863036]  [<ffffffff803af923>] vgacon_set_cursor_size+0x40/0x10b
<Oct/06 02:25 am>[648977.863036]  [<ffffffff805b83ed>] oops_end+0x7b/0x88
<Oct/06 02:25 am>[648977.863036]  [<ffffffff805b795d>] error_exit+0x0/0x9a
<Oct/06 02:25 am>[648977.863036]  [<ffffffff8020e159>] do_IRQ+0xf5/0x16c
<Oct/06 02:25 am>[648977.863036]  [<ffffffff8020e15b>] do_IRQ+0xf7/0x16c
<Oct/06 02:25 am>[648977.863036]  [<ffffffff8020c2f6>] ret_from_intr+0x0/0xa
<Oct/06 02:25 am>[648977.863036]  <EOI> <4>---[ end trace e80694d7bb2698b5 ]---