== PS1 IPP Czar Logs for the week 2017.01.02 - 2017.01.08 == 
[[PageOutline]]

(Up to [wiki:PS1_IPP_CzarLogs PS1 IPP Czar Logs])

=== Monday : 2017.01.02 ===
 * MEH: large number of 3PI WS diffs (ie diff_id 1471926) having issue with missing LAP.PV3 stack cmf product... the hack for using the warp cmf seems to be failing -- just setting quality fault 42 since no time to deal with now
 * MEH: looks like MD07 is back on the obsplan, adding back into nightly processing before regular restarting of pantasks today 
=== Tuesday : 2017.01.03 ===

=== Wednesday : 2017-01-04 ===

 * 16:00 HST CZW: Restarting IPP pantasks, as I seem to be listed as czar for today.
 * MEH: starting night for QUB targeted folllowup -- no changes to nightly processing should be made as per my email earlier in the day

=== Thursday : 2017.01.05 ===
 * MEH: QUB priority processing required the ipps nodes
 * 08:00 EAM : several ippx and stare nodes have crashed.  here is an example trace: [wiki:stare01.20170105.trace]
 * MEH: turning off x0 group in summitcopy, registration, distribution since they look to still be up while Haydn is restarting them and x1 with new kernel 
 * MEH: setting nightly processing up for another night of QUB targeted followup -- no changed should be made to nightly processing

=== Friday : YYYY.MM.DD ===
 * MEH: QUB targeted followup needs high ippx nodes in the AM
=== Saturday : YYYY.MM.DD ===

=== Sunday : YYYY.MM.DD ===