(Up to PS1 IPP Czar Logs)

Monday : 2012-08-13

• 08:00 (Bill) LAP has been running all night but czartool thinks that only chip processing has occurred. Restarted stdscience. Lots of timeouts for chiptool -pendingmfile jobs in pantasks.stdout.log
• 08:17 stdscience stopped to investigate LAP wierdness
• 08:20 There are no cam runs because LAP is not doing new chip processing, it is updating previously cleaned runs. There is no warp processing because the original files are still on disk because we aren't currently cleaning up warps.
• 11:50 With advice from Chris, modified lap_science.pl to not queue updates for exposures that have warps in full state. Set the currently updating chipRuns (which are not needed) to be cleaned.
• 13:26 set two faulted diff skycells out of their misery

  difftool -updatediffskyfile -fault 0 -set_quality 42 -diff_id 266709 -skycell_id skycell.053
  difftool -updatediffskyfile -fault 0 -set_quality 42 -diff_id 266714 -skycell_id skycell.046
  

• (approx) 15:00 (Bill) Chip XY66 is causing memory explosion for several exposures. Stopped stdscience and killed off all outstanding ppImage proceses. Unfortunately forgot to set it back to run after that was done.

Tuesday : 2012-08-14

• 09:00 restarted stdscience which has been left stopped all night.
• 11:00 Bill All queued LAP stacks are done. Set lap label to inactive to avoid memory problems until nightly science is completed.
• 13:30 All pantasks shut down for rebuild with changes to psphot.
• 13:45 pantasks restarted (except for deepstack which currently has nothing to do)
• 17:20 Bill found the root cause of the ppImage memory explosion and integrated a fix into the tag.

Wednesday : 2012-08-15

• 08:45 (Serge) Fixed LAP:
  • gpc1/20100128/o5224g0297o/o5224g0297o.ota32.burn.tbl ; gpc1/20100626/o5373g0017o/o5373g0017o.ota56.burn.tbl ;
  • gpc1/20100624/o5371g0139o/o5371g0139o.ota65.fits ; gpc1/20100624/o5371g0148o/o5371g0148o.ota26.fits ; gpc1/20100624/o5371g0147o/o5371g0147o.ota64.fits ; gpc1/20100624/o5371g0124o/o5371g0124o.ota12.fits ;

Thursday : 2012-08-16

Friday : 2012-08-17

Saturday : 2012-08-18

Sunday : 2012-08-19