PS1 IPP Czar Logs for the week 2011-05-16 - 2011-05-23

(Up to PS1 IPP Czar Logs)

Monday : 2011-05-16

• 07:20. There is a problem with MD05. It looks like the templates are not registered in nebulous, diff.revert is repeatedly failing and creates large logs so I stopped it.

Tuesday : 2011-05-17

• 07:20 Nothing special to mention. ipp005 is still down hence the multiple failures for MD05 and MD03.
• 07:30 Reverted warp and diff for a short while so that errors not due to ipp05 have a chance to be fixed.
• 10:40 Tried to revert failing warp by running runwarpskycell.pl --redirect-output --warp_id 199035 --skycell_id skycell.1885.062 and then warptool -revertwarped -fault 4 -label ThreePi.nightlyscience -dbname gpc1. It had unfortunately no effect.

Wednesday : 2011-05-18

• 09:00 Bill restarted stdscience since we were only processing about 25 exposures per hour chip - camera.
• 09:35 Bill restarted distribution
• 11:00 Added a set of compute and compute2 hosts to stdscience.

Thursday : 2011-05-19

• 03:00 Bill set fault = 0, quality = 86 all of the diffSkyfiles that are faulted due to missing templates. Gene says consider ipp005 being down "bad weather" for these skycells.

Friday : YYYY.MM.DD

• 02:47HST CZW: Manually promoted exp_ids = {338801, 338804, 338800} to full/bt_state = 14 to allow registration to complete. These exposures were taken in 32bit mode, which burntool cannot handle.

Saturday : YYYY.MM.DD

Sunday : YYYY.MM.DD