= Summary for MD.pv2notyrX.refstack.20140720 (updates in progress) = [[PageOutline]] * [wiki:MediumDeepFields] summary page and quick links to all processing and up to date refstacks * [wiki:MD.GR0] summary page -- summary of all reprocessing details and 2011/2012 refstacks and some deepstack samples * [wiki:MD.PV1] summary page -- the data set that PV2 update reprocessing is based on * [wiki:MD04.pv2_stacktest.20130903] -- pre-PV2 and deep test stacks * [wiki:MD.PV2] summary page -- PV2 warp updates for the stacks * [wiki:MDdeeptest_pixrej_20140403] -- bug and config modifications for stacking * [wiki:MD.PV2.deepstack.20130506] -- PV2 deep stacks This is a summary of the MD PV2 reference/template stack using the PV2 update reprocessing (as started with MD04 in [wiki:MD04.pv2_stacktest.20130903]) for all MD exposures through the end of the survey, April 2014. Because MD.PV2 is an update reprocessing method, there is a mix of photometry from PV1 and PV2 (as tracked by the data_group name summarized in the [wiki:MD.PV2] wiki page), while the warp pixels used for the stacking is of PV2 quality (using the same processing tag ipp-20130712 as with LAP/3PI). The processing sequence will be MD04, then MD01 onwards in order. Like the deep stacks, ([wiki:MD.PV2.deepstack.20130506]), there have been some recent ppStack code changes * pixel rejection bug fixes and config modifications [wiki:MDdeeptest_pixrej_20140403] * staticsky and possibly skycal changes (i.e., MD04 has had a gross offset at least in i-band) * all processing done using the ipp-pv3-20140717 tag now As was decided for the past deep test stacks, '''basic cuts will be used''' to exclude poorer data (contribute less in weighted stacks, potential for more junk, waste resources) -- likely will add summary plots on analysis page for these params for revision -- * pre-June 2010 exposures fully excluded * significant camera change prior 1/2010 * baffle modifications prior 6/2010 * ZPT > 24.2, 24.3, 24.3, 24.0, 23.0 (grizy each by mean exposure value) -- * background < 300, 500, 2000, 3000, 5000 (grizy each by mean exposure value) -- * elongation < 1.25 (gri), 1.30 (zy) (all by exposure value) -- * max FWHM < 7 pixels (grizy each by skycell, not by full exposure value) * cut FWHM at N input warps = 80 -- typical rejection is ~10% and wish to keep N input ~60 so minimum common input per pixel is ~30 Data can be found on the datastore and postage stamp server (PSS) -- * __datastore__: full image/pixel bundles, staticsky and skycal stack photometry * ps1-md-refstack -- these current full PV2 image/pixel bundles * ps1-md-staticsky -- staticsky and skycal stack photometry catalog bundles * __PSS__: selected desired image/pixels * use the label/data_group for the desired stack '''Any problems and/or issues need to be identified quickly so that changes can be made before too many MD stacks are made.''' * skycell loss due to quality issue will be unresolved for PV2 reference stacks (unless it is not edge of field) * background bias/offset -- improved but still there * stack photometry -- skycal zeropoints, staticsky config? * '''this is the first full seasonal exclusion set''' -- expected tuning and improvements needed for PV3 final run * unlike before, will now attempt to do all as one bulk processed set Similar to GR0 there will be a summary for each field, but unlike GR0, will try and keep analysis and issues to other pages to reduce the length and load time for this summary page. Status: * '''7/24''' -- MD04.pv2notyrX.refstack.20140720 started -- estimate ~1.5d per field to finish stacking pixels, unclear on timescale for stack photometry products ---- = MD04 = PV2 camera & warps -- PV2 warps are not cleaned up and will also be a accessible via the PSS/PSPS interface more quickly (release name MD04.PV2). * label: MD04.pv2.20130903 Seasons: {{{ | o5161g0222o | g.00000 | 2009-11-26 13:55:38 | MD04 g,r MJD55161 g MD04 center | .. | o5321g0014o | i.00000 | 2010-05-05 06:20:20 | MD04 i N5321 MD04 center | ---- yr1 -- 11/26/2009 -- 5/5/2010 | o5545g0436o | g.00000 | 2010-12-15 12:12:35 | MD04 g,r N5545 g MD04 center | .. | o5681g0089o | i.00000 | 2011-04-30 07:34:50 | MD04 i N5681 MD04 center | ---- yr2 -- 12/15/2010 -- 4/30/2011 | o5892g0155o | g.00000 | 2011-11-27 14:41:57 | MD04 g,r N5892 g MD04 center | .. | o6056g0114o | z.00000 | 2012-05-09 07:38:31 | MD04 z N6056 MD04 center | ---- yr3 -- 11/27/2011 -- 5/09/2012 | o6260g0448o | y.00000 | 2012-11-29 15:14:41 | MD04 y N6260 MD04 center | .. | o6437g0061o | y.00000 | 2013-05-25 05:50:54 | MD04 y N6437 MD04 center | ---- yr4 -- 11/29/2012 -- 5/25 2013 }}} PV2 reference stacks: * label/data_group: * '''MD04.pv2notyr1.refstack.20140720''' -- notyr1 means excluding all data from season 1 in order to use it as a template reference stack for season 1 * '''MD04.pv2notyr2.refstack.20140720''' * '''MD04.pv2notyr3.refstack.20140720''' * '''MD04.pv2notyr4.refstack.20140720''' * '''MD04.pv2notyr5.refstack.20140720''' * staticsky label/data_group: (same format as other stacks -- Nx/<#>x) * MD04.pv2notyr1.refstack.20140720.Nx201407xx/MD04.pv2notyr1.refstack.20140720.<#>x201407xx -- * skycal label/data_group: * MD04.pv2notyr1.refstack.20140720.Nx201407xx.cal201407xx -- Summary of stack produced: {{{ | stack_id | label | filter | skycell_id | dtime_script | reject_images | count(warp_id) | reject_pix_mean | good_frac | +----------+----------------------------------+---------+-------------+--------------+---------------+----------------+-----------------+-----------+ | 3384080 | MD04.pv2notyr1.refstack.20140720 | g.00000 | skycell.035 | 7835 | 10 | 80 | NULL | 0.987463 | | 3384140 | MD04.pv2notyr1.refstack.20140720 | r.00000 | skycell.035 | 6505 | 15 | 80 | NULL | 0.987397 | | 3384200 | MD04.pv2notyr1.refstack.20140720 | i.00000 | skycell.035 | 8223 | 14 | 80 | NULL | 0.987281 | | 3384260 | MD04.pv2notyr1.refstack.20140720 | z.00000 | skycell.035 | 7726 | 14 | 80 | NULL | 0.987359 | | 3384320 | MD04.pv2notyr1.refstack.20140720 | y.00000 | skycell.035 | 6809 | 14 | 80 | NULL | 0.987438 | | 3384380 | MD04.pv2notyr2.refstack.20140720 | g.00000 | skycell.035 | 7593 | 15 | 80 | NULL | 0.987466 | | 3384440 | MD04.pv2notyr2.refstack.20140720 | r.00000 | skycell.035 | 5684 | 15 | 80 | NULL | 0.987414 | | 3384500 | MD04.pv2notyr2.refstack.20140720 | i.00000 | skycell.035 | 5745 | 17 | 80 | NULL | 0.987272 | | 3384560 | MD04.pv2notyr2.refstack.20140720 | z.00000 | skycell.035 | 6618 | 13 | 80 | NULL | 0.98737 | | 3384620 | MD04.pv2notyr2.refstack.20140720 | y.00000 | skycell.035 | 5839 | 15 | 80 | NULL | 0.987438 | | 3384680 | MD04.pv2notyr3.refstack.20140720 | g.00000 | skycell.035 | 8452 | 13 | 80 | NULL | 0.987462 | | 3384740 | MD04.pv2notyr3.refstack.20140720 | r.00000 | skycell.035 | 6802 | 14 | 80 | NULL | 0.987395 | | 3384800 | MD04.pv2notyr3.refstack.20140720 | i.00000 | skycell.035 | 7254 | 11 | 80 | NULL | 0.987273 | | 3384860 | MD04.pv2notyr3.refstack.20140720 | z.00000 | skycell.035 | 8083 | 10 | 80 | NULL | 0.987351 | | 3384920 | MD04.pv2notyr3.refstack.20140720 | y.00000 | skycell.035 | 7460 | 12 | 80 | NULL | 0.987459 | | 3384980 | MD04.pv2notyr4.refstack.20140720 | g.00000 | skycell.035 | 9319 | 13 | 80 | NULL | 0.987464 | | 3385040 | MD04.pv2notyr4.refstack.20140720 | r.00000 | skycell.035 | 6866 | 15 | 80 | NULL | 0.987395 | | 3385100 | MD04.pv2notyr4.refstack.20140720 | i.00000 | skycell.035 | 6779 | 13 | 80 | NULL | 0.98728 | | 3385160 | MD04.pv2notyr4.refstack.20140720 | z.00000 | skycell.035 | 7621 | 15 | 80 | NULL | 0.987355 | | 3385220 | MD04.pv2notyr4.refstack.20140720 | y.00000 | skycell.035 | 7150 | 13 | 80 | NULL | 0.987447 | | 3385280 | MD04.pv2notyr5.refstack.20140720 | g.00000 | skycell.035 | 8466 | 11 | 80 | NULL | 0.987461 | | 3385340 | MD04.pv2notyr5.refstack.20140720 | r.00000 | skycell.035 | 6917 | 15 | 80 | NULL | 0.987395 | | 3385400 | MD04.pv2notyr5.refstack.20140720 | i.00000 | skycell.035 | 6872 | 14 | 80 | NULL | 0.987279 | | 3385460 | MD04.pv2notyr5.refstack.20140720 | z.00000 | skycell.035 | 7303 | 15 | 80 | NULL | 0.987365 | | 3385520 | MD04.pv2notyr5.refstack.20140720 | y.00000 | skycell.035 | 7666 | 15 | 80 | NULL | 0.987443 | }}} Problems: * quality faults -- yes, like before shouldn't happen but like deep stacks won't be fixed for PV2 {{{ | stack_id | label | filter | skycell_id | state | quality | reject_images | count(warp_id) | good_frac | +----------+----------------------------------+---------+-------------+-------+---------+---------------+----------------+-----------+ | 3384488 | MD04.pv2notyr2.refstack.20140720 | i.00000 | skycell.021 | full | 3012 | 7 | 43 | 0.189285 | | 3384787 | MD04.pv2notyr3.refstack.20140720 | i.00000 | skycell.017 | full | 3013 | 7 | 37 | 0.195772 | }}} * poor pixels/regions -- more need to be listed still? ---- = MD01 = Seasons: {{{ | o5072g0260o | i.00000 | 2009-08-29 13:10:13 | MD01 i MJD55072 MD01 center | .... | o5222g0025o | i.00000 | 2010-01-26 05:15:54 | MD01 i MJD55222 MD01 center | --> yr 1 | o5405g0691o | y.00000 | 2010-07-28 13:14:15 | MD01 y N5405 MD01 center | .... | o5597g0077o | i.00000 | 2011-02-05 06:02:14 | MD01 i N5597 MD01 center | --> yr 2 | o5777g0438o | i.00000 | 2011-08-04 13:17:34 | MD01 i N5777 MD01 center | .... | o5941g0020o | r.00000 | 2012-01-15 06:49:46 | MD01 g,r N5941 r MD01 center | --> yr 3 | o6142g0454o | y.00000 | 2012-08-03 14:09:23 | MD01 y N6142 MD01 center | .... | o6335g0078o | z.00000 | 2013-02-12 05:26:31 | MD01 z N6335 MD01 center | --> yr 4 | o6498g0411o | z.00000 | 2013-07-25 14:18:19 | MD01 z N6498 MD01 center | .... | o6704g0063o | y.00000 | 2014-02-16 05:17:41 | MD01 y N6704 MD01 center | --> yr 5 }}} ----