* 2008-07-10T00:42:03 IDE Channel 10 Device Failed(SMART)  
  * 2008-07-10T02:23:17 IDE Channel 10 Device Removed  
  * 2008-10-06T05:31    Machine became unresponsive. No message on console. Power cycled by bills 06:07
  * 2008-10-16T05:51 kernel panic [wiki:Ipp014_panic_1016 ipp014_panic_1016]
  * 2008-10-15T22:30 machine became unresponsive nothing on console power cyled by bills 8:52 10/16
  * 2008-10-20T20:49 kernel panic unable to handle kernel paging request [wiki:Ipp014_panic_1020 ipp014_panic_1020]
  * 2008-10-22T05:45 machine became unresponsive nothing on console power cycled by bills around 07:20
  * 2008-10-25T11:55:39 machine hung (spinlock) [wiki:Ipp014-crash-20081025 ipp014-crash-20081025]
  * 2008-10-25T11:55:39 machine hung (spinlock) [wiki:Ipp014-crash-20081026 ipp014-crash-20081026]
  * 2008-10-31T00:00:00 machine hung, no stack trace (a few segfault warnings only)
  * 2008-11-05T14:10:00 machine hung (spinlock) 
  * 2008-11-26T11:50 (approx) console unresponsive; [wiki:Ipp014-crash-2008-11-26 general protection fault] on console; power cycled by pap
  * 2008-11-26T11:00 (approx) console unresponsive; [wiki:Ipp014-crash-20081127 ipp014-crash-20081127]; power cycled by eam
  * 2008-12-05 crashed overnight, [wiki:Ipp014-crash-2008-12-04 multiple traces produced]; power cycled by pap
  * 2008-12-11T01:54 unresponsive no messages power cycled by bills around 08:55
  * 2009-03-02T17:00 (approx) console unresponsive; [wiki:ipp014-crash-20090302 ipp014-crash-20090302]; power cycled by eam
  * 2009-03-05T18:23 kernel panic [wiki:ipp014_crash-20090305 ipp014_crash-20090305]; power cycled by bills
  * 2009-03-11T06:00 kernel panic [wiki:ipp014_crash-20090311 ipp014_crash-20090311]; power cycled by eam
  * 2009-03-11T16:00 kernel panic [wiki:ipp014_crash-20090311b ipp014_crash-20090311b]; power cycled by eam
  * 2009-04-07T10:29 kernel panic [wiki:ipp014_crash20090407 ipp014_crash-20090407]; power cycled by bills  
  * 2009-08-25T07:54 kernel panic [wiki:ipp014_crash20090825 ipp014_crash-20090825]; power cycled by bills
  * 2009-08-25T13:42 root reported down, unresponsive, no messages, power cycled by cindy 
  * 2009-09-15T11:03:23 kernel panic [wiki:ipp014_crash-20090915 ipp014_crash-20090915]; power cycled gavin
  * 2009-09-25T23:14 kernel panic general protection fault: 0000 [#1] SMP [wiki:ipp_crash-20090925] power cycled by bills 2009009-26T04:12
  * Sept 26 07:31:24 HST 2009 host down not booting after repower
  * 2009-10-06T04:43:12 kernel panic [wiki:ipp014_crash-20091006 ipp014_crash-20091006]; power cycled gavin
  * 2009-10-12T15:35:24 kernel panic [wiki:ipp014_crash-20091012 ipp014_crash-20091012]; power cycled gavin 
  * 2009-10-16 ipp014 remains down since Mon. 2009-10-12. Cycled power, reseated power & serial cables, attached vga monitor/keyboard no response. Steph to go down to MHPCC on Fri. 2009-10-16 to investigate. Plan to export ipp014 raid set to ipp037 chassis (last resort).
  * 2009-10-19T10:38:11 IDE Channel 16 Device Degraded (replace 2009-10-19T18:00:15)
  * 2009-10-22T18:15:10 high load (134.20), unresponsive, no messages power cycled by gavin (2009-10-22T18:28)
  * 2009-10-29T09:46 unresponsive, <Oct/28 06:56 pm>ipp014 login: [527978.637814] journal commit I/O error ; power cycled by gavin
  * 2009-11-03T18:44 unresponsive, <Nov/03 03:38 pm>ipp014 login: [461020.846420] journal commit I/O error ; power cycled by gavin
  * 2009-11-03T18:51:13 IDE Channel 16 Device Failed (replace 2009-11-04T17:09:23)
  * 2009-11-06T09:25 unresponsive, console displays: INIT: Id "s0" respawning too fast: disabled for 5 minutes, Areca web interface unresponsive, /var/log/messages: Nov  6 03:29:04 ipp014 archttp64 WARNING ArecaRaidCtrl Event(WARNING) 2009-11-6  3:29:6 Controller#1(PCI) IDE Channel 16 Reading Error. power cycled by gavin
  * 2009-11-06T03:29:04 IDE Channel 16 Reading Error, requested to replace again 2009-11-06T09:42. (replaced 2009-11-06T10:49:31)
  * 2009-11-12T12:23  IDE Channel 16 Reading Error (2009-11-13T09:42:33)
  * 2009-11-17T13:35:51 [wiki:ipp014_crash-20091117 ipp014_io_error] , resuming scheduled array verification, power cycled by gavin
  * 2009-11-18T09:03 [wiki:ipp014_crash-20091118 ipp014_io_error], power cycled by cindy