PS1 IPP Czar Logs for the week 2012.01.09 - 2012.01.14

(Up to PS1 IPP Czar Logs)

Monday : 2012.01.09

Mark is czar

• 07:00 nightly science mostly finished. seeing few remaining XY17 with fault 4 again. reverting and moving forward, including LAP.
• 11:20 restarting stdscience after fixing the SSdiff trigger time to being ~noon HST rather than 3am.
• 14:10 since magic not required now, setting up SMFs from MD06.GR0 for distribution to ps1-md-GR-cat. will slowly add MD07,04 as other fields with full exposure processing since 4/2009.
• 16:00 started remaining MD06.GR0 nightly stacks in the deepstack pantasks, changed -min_num from 4 to 2, edge exampled of 2-3 look okay.

Tuesday : 2012.01.10

Mark is czar

• 07:10 data still downloaing (780 exposures last night). MD06 stack failing w/ bad PSF (similar for MD06.GR0 nightly stack but with only 2 inputs). Looks like 4 LAP chips stuck with corrupted extensions and see if fixed after nightly science finishes.
• 10:00 nightly science finished, set MD06 stack to quality 42 since all PSF inputs rejected (fault 5). LAP looks to be stalled in warp with skycell_id having quality>0 (not user 42) and not being updated. Bill suggested running warptool -dbname gpc1 -tofullskyfile -warp_id -skycell_id on the stalled ones and they have cleared. 900 stacks to do now.
• 11:30 setting up another MD06.GR0 nightly stack run under deepstack pantasks and distribution MD04.GR0 SMFs (ignore the MD04 stacks on czar page).
• 12:30 shifting the SSdiff time earlier to 10am HST, stoppping stdscience and restarting after rebuild of ippTasks (since LAP is tied up in stack still).
• 13:30 Bill reports that the repair of the damaged M31.v4.2010 distribution runs has finally finished. All data from 2010 and 2011 have not been processed without magic and distributed.
• 13:40 MOPS's postage stamps aren't progressing as quickly as we would like. Restarted pstamp and update pantasks and raised the priority for the MOPS label and lowered QUB
• 13:50 Mark mistakenly sent pre-condor processing of MD04.GR through distribution. must be sitting around somewhere but don't see on datastore.. also don't see the proper condor_MD04 SMFs either. many things going to datastore right now, LAP, M31, and rcserver.makefileset.run has limit of 5 so will be a bit.
• 14:20 Chris implementing LAP changes now -- remaining magic/destreak will continue until lap_id waiting for them clear through cleanup.

Wednesday : 2012.01.11

Thursday : 2012.01.12

Friday : 2012.01.13

Saturday : 2012.01.14

Sunday : 2012.01.15