== PS1 IPP Czar Logs for the week 2015.01.19 - 2015.01.25 == 
[[PageOutline]]

(Up to [wiki:PS1_IPP_CzarLogs PS1 IPP Czar Logs])

=== Monday : 2015.01.19 ===

 * 05:25 EAM: ipp062 crashed around 04:15, nothing on console.  processing completely stalled.  i'm rebooting it now.
 * 05:40 EAM: after the reboot of ipp062, processing back up and running.
 * 09:55 MEH: ipp084 is in WT state and may be dragging on processing, into repair
 * 10:20 MEH: two warps stalling OSS finish
{{{
warptool -dbname gpc1 -updateskyfile -fault 0 -set_quality 42 -warp_id 1369542 -skycell_id skycell.1609.051
warptool -dbname gpc1 -updateskyfile -fault 0 -set_quality 42 -warp_id 1369710 -skycell_id skycell.1609.051
}}}
 * 14:45 EAM: stopping & restarting stdlocal
 * 15:15 EAM: rebooting ippx016 -- load very high for no good reason, ganglia shows there has been no I/O since midnight -- I suspect an ethernet crash.
 * 15:20 EAM: oops: I just shutdown stdlocal accidentally.  restarting it again.

=== Tuesday : YYYY.MM.DD ===

=== Wednesday : YYYY.MM.DD ===

=== Thursday : YYYY.MM.DD ===

=== Friday : YYYY.MM.DD ===

=== Saturday : YYYY.MM.DD ===

=== Sunday : YYYY.MM.DD ===