== PS1 IPP Czar Logs for the week 2013.03.04 - 2013.03.11 == 
[[PageOutline]]

(Up to [wiki:PS1_IPP_CzarLogs PS1 IPP Czar Logs])

=== Monday : 2013.03.04 ===
mark is czar
 * 07:20 MEH: chip.off to push remaining 3PI nightly warps through
 * 08:00 MEH: nightly science data through so do regular restart of stdscience
 * 10:40 Bill: Richard came by and was concerned that MOPS's postage stamp requests are behind. Lowered priority of MOPS.2 label. Restarted pstamp pantasks because there didn't seem to be enough jobs in the queues. pcontrol was spinning I think.
 * 14:20 MEH: something making stsci03 unhappy starting ~1400 driving load >100..
=== Tuesday : 2013.03.05 ===
 mark is czar
 * 09:00 MEH: with nightly science finished, time for regular restart of stdscience
 * 09:42 Bill: queued 8723 staticsky runs
 * 09:45 Bill: replaced corrupted instance of o5498g0622o.ota26.fits on ipp064 with it's replicant from ippb01.1
 * 17:20 MEH: large LAP warp buildup again, chip.off until nightly science starts to get some stacks queued
=== Wednesday : 2013.03.06 ===
 * 09:51 Bill: postage stamp server pantasks died around 9:30. It's been very busy. Restarted it.
=== Thursday : 2013.03.07 ===
 * 12:45 MEH: stopping processing to setup+build new tag ipp-20130307
 * 15:20 MEH: tag build finished, now testing
  * stopped stdscience, looks like it is redoing MD WSdiffs, query may need to be adjusted.. -- Chris found was from old warps that had missed being cleaned up. i will have to slowly go through and drop duplicates.


=== Friday : YYYY.MM.DD ===

=== Saturday : YYYY.MM.DD ===

=== Sunday : YYYY.MM.DD ===