== PS1 IPP Czar Logs for the week 2011-09-12 - 2011-09-18 == 
[[PageOutline]]

(Up to [wiki:PS1_IPP_CzarLogs PS1 IPP Czar Logs])

=== Monday : 2011-09-12 ===
  * Around 10am Bill finally got all of the pieces checked into the branch for the ppMops memory reduction fix. pantasks were restarted
  * 11:00 adjusted pstamp.dependent.run task to not be so agressive at running. Should reduce the database load that it cause.
  * 15:00 CZW: Reworked host definitions to be more equitable (hopefully) and to run the processors we have as hard as possible without crashing anything.  New definitions for all servers are stored in /home/panstarrs/ipp/ippconfig/pantasks_hosts.input
=== Tuesday : YYYY.MM.DD ===
 * 09:50 Mark (czar): removed from nebulous and processing stopped on ipp021 for Cindy to upgrade the motherboard.
 * 13:00 ipp021 back online. Added back nebulous and pantasks.
 * 15:10 ipp026 went down. Removed from nebulous list until back up. Kernel panic similar to what has happened before, Chris rebooted and added details to [wiki:ipp026-crash-20110913]. Put back into nebulous in same state as before: repair.
 * 21:30 registration trouble, in pantasks.stdout.log and run manually
{{{
crash for: ipp_apply_burntool_single.pl --exp_id 392018 --class_id XY04 --this_uri neb://ipp006.0/gpc1/20110914/o5818g0058o/o5818g0058o.ota04.fits --continue 10 --previous_uri neb://ipp006.0/gpc1/20110914/o5818g0057o/o5818g0057o.ota04.fits --dbname gpc1 --verbose
}}}
=== Wednesday : YYYY.MM.DD ===
  * 06:00 Mark: stalled at o5818g0448o with check_burntool and ota27
    * ipp018 was having trouble connecting to ipp007.0 
  * 11:45 excessive CPU use by distribution pcontrol, restarted distribution.
=== Thursday : YYYY.MM.DD ===

=== Friday : YYYY.MM.DD ===

=== Saturday : YYYY.MM.DD ===

=== Sunday : YYYY.MM.DD ===