• 2008-07-03T23:37:05 IDE Channel 21 Device Removed
• 2008-07-04T01:27:23 IDE Channel 3 Device Failed
• 2008-07-04T01:40:07 IDE Channel 3 Device Removed
• 2008-07-04T01:43:16 IDE Channel 4 Device Failed
• 2008-07-09T16:31:25 IDE Channel 7 Device Removed
• 2008-03-22T23:47:35 IDE Channel 7 Device Removed
• 2008-03-22T23:57:31 IDE Channel 7 Device Inserted
• 2008-3-22T23:47:35 IDE Channel 7 Device Removed
• 2008-3-22T23:57:31 IDE Channel 7 Device Inserted
• 2008-3-23T12:27:16 ARC-1280-VOL#00 Complete Rebuild 012:29:44
• 2008-07-09 ipp015 disk set moved into a wave #2 chassis (ipp025)
• 2009-04-24T08:00 ipp015 cannot access /data/ipp032.0
  

no umount command in ipp032:/var/log/messages until attempt by bills to umount by hand around 7:58 am
last mount from ipp015 Apr 22.
tried to reboot around 11am hung during shutdown trying to unmount /data/ipp032.0
power cycled by bills

• 2010-07-09T18:46:40 IDE Channel 19 Device Failed (replaced 2010-07-12T11:03:08)
• 2010-07-20T07:30 (approximately) Nagios reports system down. No response on console. Power cycled by bills at 09:07
• 2010-09-07 Replaced failed disk 17
• 2010-10-18 8:6:44 Channel 20 Device Failed - replaced = rebuilt
• 2010-10-20 6:28:44 10 Device Failed - replaced -rebuilt
• 2010-11-6 18:51:0 Channel 22 Device Failed replaced rebuilt
• 2010-11-12 20:27:28 Channel 16 Device Failed replaced rebuilt
• 2010-11-19 7:56:28 Channel # 5 Device Failed replaced rebuilt
• 2010-11-24 19:58:40 Controller#1(PCI) IDE Channel # 8 Device Failed
• 2010-11-25 11:52:11 Channel # 18 Device Failed replaced rebuilt
• 2010-12-03T14:43:26 system unresponsive, nothing on console, power cycled by gavin
• 2011-2-9 16:41:26 Controller # 1(PCI) IDE Channel # 24 Device Failed
• 2011-2-24 3:40:47 Controller # 1(PCI) IDE Channel # 23 Device Failed
• 2011-2-18 19:13:32 Controller # 1(PCI) IDE Channel # 6 Device Failed
• 2011-5-12 9:45:47 Controller # 1(PCI) IDE Channel # 2 Device Failed
• 2011-5-20 4:29:35 Controller # 1(PCI) IDE Channel # 13 Device Failed
• 2011-6-5 4:40:6 Controller # 1(PCI) IDE Channel # 1 Device Failed
• 2011-07-06T07:38:04 system unresponsive, nothing on console, power cycled by gavin (2011-07-06T09:05:16)
• 2011-07-06T11:26:04 system unresponsive, nothing on console, power cycled by gavin
• 2012-02-08T06:35:00 system unresponsive, nothing on console, power cycled by EAM
• 2012-03-13T04:49 system unresponsive, not booting after power cycled (MEH). console had couple burntool segfaults and many lockd server not responding entries ipp015-2012-03-13-crash. Didn't come back up after power cycle, unclear why. Initial confusion with possibly booting with wrong kernel but that wasn't the case. Maybe just wanted a couple day vacation.
• 2012-09-08T general protection fault ipp015.crash.20120908