== PS1 IPP Czar Logs for the week 2015.04.06 - 2015.04.13 == 
[[PageOutline]]

(Up to [wiki:PS1_IPP_CzarLogs PS1 IPP Czar Logs])

=== Monday : 2015.04.06 ===
 * 15:30 MEH: starting the regular restart of nightly pantasks
 * 15:40 MEH: ippc0x apache servers low on disk space, restarting apache and purging old log
 * 15:50 Haydn reports ipp017 back up, put into neb-host repair
  * clearing old and then stalled WS diff distribution -- files got cleaned again.. so update again
 * 17:30 MEH: ipp088,090,093,095,097 all in repair -- put to neb-host up and see if past getting slammed since earlier storage nodes are red..
 * 19:50 MEH: slow processing, nightly nodes still on in PV3 diff
 * 20:50 MEH: reg fault backing up processing?
 * 22:55 MEH: killed long running thread db00

=== Tuesday : 2015.04.07 ===
 * 09:25 EAM : today, we are changing the nebulous database mysql master from ippdb00 (nearly full disk) to ippdb08 (new hardware).  Here are my notes on the process:
  * 09:25 EAM : stopping the various pantasks (~ipp/*, ~ipptest/pv3diff*, ~ipplanl)

=== Wednesday : YYYY.MM.DD ===

=== Thursday : YYYY.MM.DD ===

=== Friday : YYYY.MM.DD ===

=== Saturday : YYYY.MM.DD ===

=== Sunday : YYYY.MM.DD ===