= 2010 Production Node Work =

(Up to [wiki:Production_Cluster_Status Production Cluster Status])
== Sept 15 == 
 * Removed cable obstructing power supply fan in ippc11

== Sept 13 == 
 * Replaced CPUs (with new ones) and failed CPU fan in ipp014

== Aug 23 == 
 * Swapped Memory out of IPP14 

== Aug 6 == 
 * Swapped Memory out of IPP12 
 * Upgraded IPP006 and IPP007 with 2TB drives 

== Jun 22 == 
 * Swapped Memory out of IPP14 

== April 27 ==

 * ipp018
  * swapped memory -> continuous beeps
  * Brad noticed one row of the hard drive array did not light up with red lights
  * Reseated SATA cables to backplane and RAID card
  * Swapped in set of new memory

== April 26 ==

 * Swapped in larger RAID card memory module in ipp037
 * ipp018
  * reseated memory  -> still 2G memory
  * swapped CPUs -> still 2G memory showing
  * swapped in new set of memory (all 8 sticks) -> no boot rapid beeps

== April 16 ==

 * Swapped two new CPUs into ipp037 and booted it into .31 kernel

== April 8 ==

 * Swapped positions of ipp005 and ipp037 in rack
 * Attached ipp037 SATA cables to the RAID card so they're mapped properly
 * Noted fan warnings on nodes ipp014, 016, 008, 007, 004, 025, 024, and 045 (appear to be due to fan power board failures)

== April 1 ==

 * ipp008
  * Put back into rack
  * Still missing single HD array fan

 * ipp018
  * New motherboard; 2 new CPU fans (Sunon)
  * Put back in rack

 * ipp037
  * New motherboard; 2 new CPU fans (Sunon)
  * Put back in rack
  * Array cables not mapped to RAID card correctly

 * ipp014
  * Unsuccessfully attempted to get one of the HD array duo fans working
  * Appears to be an issue with the connector

== March 22 ==

 * ipp018
  * Boots but goes to A:\>
  * Pulled CMOS battery; reset MB w/ jumper; no help

 * ipp008
  * No boot
  * Rapid beeps
  * One pwr supply dead
  * Swapped in new MB
  * Replaced CPU fans with those taken from ipp037
  * Single HD array fan not working (appears to be module connector)


== February 22 ==

 * Confirmed light on ippc17 drive
 * Installed additional fan in ippc18 (small fan on right side)

== February 16 ==
 
 * ipp008
  * No boot
  * rapid beeps -> then 1 sec beep

 * ipp018
  * No boot
  * Both CPU fans not working - one has broken wire
  * No codes on MB
  * No lights on power supplies

 * ipp037
  * No RAID card
  * CPUs installed w/o paste

== February 11 ==

 * Installed an additional fan in ippc19 (small fan on right side)
 * Swapped CPUs
   * ipp018 -> ipp005
  * ipp037 -> ipp008
 * Notes: ipp018 had excessive paste, bent pins on CPU2 (on MB), and an apparently scorched heatsink

== NODE SWAPPING MAP ==
*Wave1 IPP17 died.  Its disks were swapped into Wave2 IPP37
 * So IPP17 is a Wave2 Machine.
*The broken Wave1 Machine (previously IPP17) was sent back. When it came back 
 * It had a different motherboard and was incomplete - missing fans.
 * A newly broken IPP14 disks were swapped in.
*So IPP14 became IPP37.
 * IPP14 ( Now IPP37 ) was out of warranty so we decided to swap the mother board and cpu's 
* Summary:
 * IPP14 is a Wave 1 ASA Machine with a different motherboard.
 * IPP17 Is a Wave 2 YMI Machine
 * IPP37 is a Wave 1 Machine