== PS1 IPP Czar Logs for the week 2011-05-16 - 2011-05-23 == 
[[PageOutline]]

(Up to [wiki:PS1_IPP_CzarLogs PS1 IPP Czar Logs])

=== Monday : 2011-05-16 ===
 * 07:20. There is a problem with MD05. It looks like the templates are not registered in nebulous, diff.revert is repeatedly failing and creates large logs so I stopped it.

=== Tuesday : 2011-05-17 ===
 * 07:20 Nothing special to mention. ipp005 is still down hence the multiple failures for MD05 and MD03.
 * 07:30 Reverted warp and diff for a short while so that errors not due to ipp05 have a chance to be fixed.
 * 10:40 Tried to revert failing warp by running runwarpskycell.pl --redirect-output --warp_id 199035 --skycell_id skycell.1885.062 and then warptool -revertwarped -fault 4 -label ThreePi.nightlyscience -dbname gpc1. It had unfortunately no effect.
=== Wednesday : 2011-05-18 ===
 * 09:00 Bill restarted stdscience since we were only processing about 25 exposures per hour chip - camera.
 * 09:35 Bill restarted distribution
 * 11:00 Added a set of compute and compute2 hosts to stdscience.

=== Thursday : 2011-05-19 ===
 * 03:00 Bill set fault = 0, quality = 86 all of the diffSkyfiles that are faulted due to missing templates. Gene says consider ipp005 being down "bad weather" for these skycells.

=== Friday : YYYY.MM.DD ===
 * 02:47HST CZW: Manually promoted exp_ids = {338801, 338804, 338800} to full/bt_state = 14 to allow registration to complete.  These exposures were taken in 32bit mode, which burntool cannot handle.

=== Saturday : YYYY.MM.DD ===

=== Sunday : YYYY.MM.DD ===