== PS1 IPP Czar Logs for the week 2014.07.07 - 2014.07.13 == 
[[PageOutline]]

(Up to [wiki:PS1_IPP_CzarLogs PS1 IPP Czar Logs])

=== Monday : 2014.07.07 ===
  * 12:00 Bill: turned parser and finish tasks off in pstamp in prepartion for restart and cleanup of ps_ud labels
   * 12:04 all jobs waiting for updates have finished. Set chip, warp, and diff runs with label like ps_ud% to be cleaned
   * 12:23 pstamp pantasks restarted
  * 14:40 EAM : had a failing warp, set to bad quality: 
{{{
warptool -dbname gpc1 -updateskyfile -fault 0 -set_quality 3006 -warp_id 976390 -skycell_id skycell.0698.007
}}}
  * 20:40 CZW: issued "run" command to all pantasks to get them going for nightly processing.
=== Tuesday : 2014.07.08 ===

  * 07:50 EAM : the chiller at MRTC-B failed in the night and Haydn had to shut down the whole cluster.  machines are slowly coming back up now.  

  * 13:45 EAM : ipp059 just crashed: wiki:ipp059-20140708-crash.log

=== Wednesday : YYYY.MM.DD ===

=== Thursday : YYYY.MM.DD ===

=== Friday : YYYY.MM.DD ===

=== Saturday : YYYY.MM.DD ===

=== Sunday : YYYY.MM.DD ===