* 2008-10-21T11:36 power cycled by gavin [wiki:Ipp025-nfs-2008-10-20 BUG: soft lockup] * 2008-10-22T12:17 console hung message: [85568.599373] BUG: spinlock lockup on CPU#3, pswarp/14919, ffff88013624a100 power cycled by bills * 2008-10-22T14:16:36 console messages: [wiki:Ipp025-crash-2008-10-22 BUG: spinlock on CPU#2] * 2008-10-24T16:29:00 console hung: [wiki:Ipp025-crash-2008-10-24 ipp025-crash-2008-10-24] * 2008-10-24T16:29:00 console hung: [wiki:Ipp025-crash-20081026 ipp025-crash-20081026] * 2008-10-26T15:45 kernel panic [wiki:Ipp025-crash-20081026b ipp025-crash-20081026b] power cycled by bills * 2008-10-30T10:59:00 console hung, spinlock: [wiki:Ipp025-crash-20081030 ipp025-crash-20081030] * 2008-11-03T10:07 down (do_IRQ: 0.179 No irq handler for vector) during pap MD processing (ppStack 4 threads), power cycled by pap * Suspect [wiki:Ipp025-20081103 memory problems] * 2009-05-10T12:00 down [wiki:ipp025-crash-20090510 ipp025-crash-20090510] * 2009-06-07T15:49 went down while processing magic data. No response on console. power cycled by bills * 2009-08-20T13:52 down [wiki:ipp025-crash-20090820 ipp025-crash-20090820] * 2009-10-02T13:47:04 IDE Channel 22 Read Error (replaced) * 2010-05-28T10:00 Memory swap * 2010-07-07T09:30:38 IDE Channel 20 Timeout Count 121, Media Error Count 79 (replaced 2010-07-07T10:24:16) * 2010-07-09T00:13:41 IDE Channel 5 Reading Error (replaced 2010-07-09T10:07:57) * 2010-08-03T08:50:52 IDE Channel 17 Reading Error (replaced 2010-08-04T09:45:39) * 2010-08-07T08:38:17 high load, [wiki:ipp025-crash-20100807 ipp025-crash-20100807], power cycled by gavin (2010-08-07T13:24) * 2010-08-09T19:25:37 IDE Channel 5 Reading Error (replaced 2010-08-09T14:58:23) * 2010-08-09T14:58:51 IDE Channel !#17 Reading Error (replaced 2010-08-10T) * 2010-9-21 15:21:39 IDE Channel !#17 Reading Error replaced * 2010-09-22 20:40 Load skyrocketed. Inaccessible over nfs from several nodes. Console responsive. power cycled by bills * 2010-10-06T23:08:02 system unresponsive, console messages: [1212768.755001] do_IRQ: 2.179 No irq handler for vector, power cycled by gavin * 2011-01-07 load very high system responsive but panic message on console [wiki:ipp025-crash-20110107] * 2011-9-9 18:22:42 Controller#1(PCI) IDE Channel !#18 Reading Error - disk replaced * 2011-10-11 1:26:25 Controller # 1(PCI) IDE Channel !#22 Device Failed - disk replaced * 2011-25-11 ipp025 drive 22 failed REPLACED * 2012-03-10T13:07:32 IDE Channel 24 Reading Error (replaced 2012-03-10T16:29:46) * 2012-11-09 All RAID disks swapped with new 2TB disks. OS installed and all backed up data reloaded. * 2012-11-15 Disk5 had a reading error during RAID verification. It was replaced once verification completed. * 2013-04-15 23:50 system stalled for ~30 min, power cycled [wiki:ipp025-crash-20130415] * 2013-7-20 8:58:47 Controller#1(PCI) IDE Channel !#12 Reading Error (replaced 2013-07-20) * 2014-02-19 22:48 system unresponsive [wiki:ipp025-crash-20140219]