= Summary for MD.PV3 (updates in progress) = [[PageOutline]] * [wiki:MediumDeepFields] summary page -- quick links to all up to date refstacks * [wiki:MD.GR0] summary page -- summary of all reprocessing details and 2011/2012 refstacks and some deepstack samples * [wiki:MD.PV1] summary page -- the data set that PV2 update reprocessing is based on * [wiki:MD.PV2] summary page -- update type reprocessing This is a summary of the MD.PV3 full pixel reprocessing. Start date and schedule '''TBD'''. This processing will also involve other MD-like fields, including M31, STS and CNP. Criteria for the stacks and diffims are '''TBD'''. From Ken's talk at PS1SC@STSCI meeting in June 2014: * stack: * MDN -- night stack * MD0 -- seasonal reference stack * MDD -- deep stack * MDT -- iq stack * diffim: * warp-stack (WS) -- (warp-ref), no (warp-deep) * stack-stack (SS) -- (night-ref) || '''field''' || '''stage''' || '''N exposures/units''' || '''ave_dtime(s)''' || '''sig_dtime(s)''' || '''status''' || '''comment''' || '''label/data_group''' || || || || || || || || || || MD || chip/camera/warp || 41717 || 130/610/85 || 130/500/65 || TBD || || || iq stk || ~600 || || || night stk || ~ || || || ref stk || 15141 ||| 6700 || 1500 || TBD || || || deep stk || 3033 || 37.5k* || 13k || TBD || *using 8 theads || || || WSref diff || ~ || || || WSdeep diff || ~ || || || SS diff || ~ || || || iq staticsky || || || iq skycal || || || night staticsky || ~ || 110 || 40 || TBD || || || night skycal || || || ref staticsky || || || ref skycal || ~ || 37 || 29 || TBD || || || deep staticsky || || || deep skycal || ~ || 30 || 7 || TBD || || || full-forced phot || ~41717 || ? || ? || TBD || || || || || || || || || || || CNP || chip/camera/warp || 2695 || ~115/410/60 || 150/430/125 || TBD || || || || ref stk || ~500? || X || x || TBD || Nin~ || || || WSref diff || ~2695 || X || X || TBD || || || || ref staticsky || || || ref skycal || ~ || ~37 || ~29 || TBD || || || full-forced phot || || ? || ? || TBD || || || || || || || || || || || M31 || chip/camera/warp || 4347 || 129/624/62 || 190/313/30 || TBD || || || background restore || || || ref stk || ~500? || X || x || TBD || Nin~ || || || WSref diff || ~ || X || X || TBD || || || || ref staticsky || || || ref skycal || ~ || ~37 || ~29 || TBD || || || full-forced phot || || ? || ? || TBD || || || || || || || || || || || STS || chip/camera/warp || 16109 || 210/1200/100 || 120/575/70 || TBD || || || || ref stk || ~3500? || X || x || TBD || Nin~ || || || WSref diff || ~ || X || X || TBD || || || || ref staticsky || || || ref skycal || ~ || ~37 || ~29 || TBD || || || full-forced phot || || ? || ? || TBD || || || || || || || || || || If run only on ippsXX machines for high memory, 12 cores -- * MD: * chip/cam/warp ~5x12/4x15 ~200 jobs/hr max possible, ~210 hrs * iq stack * night stack * ref stack * deep stack * WSref diff * SSref diff * all staticsky + skycal ~ * total ~ * CNP: * M31: * STS: Issues to address: * disk space limiting * chip-warp: * refcat oddities in field * background restore and masking for M31/STS -- test samples to be run * stack * stack quality fault * night stack config, refstack edge loss * ref+deep stack input cuts * iq+ref+deep test stacks for CNP,M31,STS * staticsky/skycal * zeropt recalib in skycal * stack photometry sky oddities * diffim * verify similar photometry * verify similar detections/coverage (no sig loss on edges) * full-forced photometry -- unknown, untested still ___Summary Status:___ * '''10/1''' start chip-warp for MD should be possible, STS+M31 sample should be possible ---- == chip -- camera -- warp == Should be started ASAP, so that the warps are available for some early testing of the stacks and diffims. Testing necessary for the M31, STS and CNP processing still. ---- == stack == Order of operations important -- while deep stacks take 1.5 months or so to finish, night and seasonal reference stacks must be finished before diffims can be started. Lighter jobs like difference images and iq (even reference stacks) can be run along with the deep stacks for some fields. === night === === seasonal reference === === deep === === iq === === photometry === ---- == difference image == Cannot start until both night and seasonal reference stacks finish. ----