== PS1 IPP Czar Logs for the week YYYY.MM.DD - YYYY.MM.DD == 
[[PageOutline]]

(Up to [wiki:PS1_IPP_CzarLogs PS1 IPP Czar Logs])

=== Monday : 2015.06.08 ===
  16:05 Bill: restarted pstamp pantasks. It was looking tired to me.
 * 17:50 MEH: will start using the ippxNNN nodes for MD night stacks until the nodes are needed for other things

=== Tuesday : 2015.06.09 ===
 * 06:35 EAM : rebooting ipp066 which crashed with no console messages

=== Wednesday : 2015.06.10 ===
 * 07:35 EAM : stdscience is way behind.  I'm stopping and restarting it.
 * 11:44 Bill: increased priority of label ps_ud_WEB to 500 (higher than nightly science) so that two chips can get processed for a MOPS postage stamp request. Once they are in the stdscience queue I will set it back.
 * 15:00 CZW: Reduced shuffle from -j 24 to -j 12 to half the load.
 * 16:30 CZW: Starting ipplanl/pv3shuffle pantasks which will execute neb-replicate commands for all the LANL stack products.  These are targeted onto the stsciXY.Z nodes.
  * 17:00 HAF restarting everything, will pull out the wave1s that are on the funky pdu - ipp004, ipp005, 006, 007, 009, 010, 011, 015, and ipp066 pulled out of pantasks for tonight.  
 * 22:20 EAM : removed ippc21, ippc55, ippc62 from processing lists -- not mounting home dirs?
 * 22:20 EAM : i've killed off all hung jobs and umount the cab2 machines from all hosts.  the cluster seems clear now.  I'm going to restart ipp pantaskses.

=== Thursday : 2015.06.11 ===
 * 05:36 Bill: changed label priority for ps_ud_MOPS to 500 which allow the small number (< 50 per day) of chip update jobs to be processed during nightly science processing.
 * 07:42 Bill: added gpc2 database to summitcopy pantasks and reg.add.date for gpc2 to registration. That removed the gpc1 date from the registration date list. I guess the operation has changed

=== Friday : YYYY.MM.DD ===

=== Saturday : YYYY.MM.DD ===

=== Sunday : YYYY.MM.DD ===