== PS1 IPP Czar Logs for the week YYYY.MM.DD - YYYY.MM.DD == 
[[PageOutline]]

(Up to [wiki:PS1_IPP_CzarLogs PS1 IPP Czar Logs])

=== Monday : 2015.08.03 ===
 * 00:50 MEH: ganglia reporing many down systems and many faults happened -- someone start/turn something on recently...
 * 01:55 MEH: pstamps for QUB don't seem to be loading/running.. try restarting pstamp.. otherwise have to look at in morning..
 * 02:10 MEH: still reg and other faults w/ long running jobs in stdsci.. probably going to be backed up mess in morning
 * 05:55 Bill: restarted pstamp pantasks after moving some broken requests out of the way
 * 06:10 EAM: ganglia continue to report many machines down, but this was not true.  In the suspicion that this was the result of using the xnodes for nightly processing, i have returned to the original loading for stdscience (compute and storage nodes).  I stopped and restarted all ipp pantasks.
 * 11:20 MEH: clearing couple repeat WS faults with quality 42
{{{
difftool -dbname gpc1 -updatediffskyfile -set_quality 42 -skycell_id skycell.2322.017 -diff_id 1186759  -fault 0
difftool -dbname gpc1 -updatediffskyfile -set_quality 42 -skycell_id skycell.2261.014 -diff_id 1186775  -fault 0
}}}
=== Tuesday : YYYY.MM.DD ===

=== Wednesday : YYYY.MM.DD ===

=== Thursday : YYYY.MM.DD ===

=== Friday : YYYY.MM.DD ===

=== Saturday : YYYY.MM.DD ===

=== Sunday : YYYY.MM.DD ===