Changes between Initial Version and Version 1 of MD.pv2.iqstack.20140824

Timestamp:

Aug 27, 2014, 1:13:53 PM (12 years ago)

Author:

Mark Huber

Comment:

--

MD.pv2.iqstack.20140824

@@ +1 @@
+= Summary for MD.pv2.iqstack.20140824 (updates in progress) = 
+[[PageOutline]]
+
+ * [wiki:MediumDeepFields] summary page and quick links to all processing and up to date refstacks  
+ * [wiki:MD.PV2] summary page -- PV2 warp updates for the stacks
+ * [wiki:MD.pv2notyrX.refstack.20140720] --
+ * [wiki:MD.pv2.iqdeepNtest.20140720] -- 
+
+This is a summary of the MD PV2 IQ stack using the PV2 update reprocessing (as started with MD04 in [wiki:MD04.pv2_stacktest.20130903]) for all MD exposures through the end of the survey, April 2014. Because MD.PV2 is an update reprocessing method, there is a mix of photometry from PV1 and PV2 (as tracked by the data_group name summarized in the [wiki:MD.PV2] wiki page), while the warp pixels used for the stacking is of PV2 quality (using the same processing tag ipp-20130712 as with LAP/3PI).
+
+The processing sequence will be MD04, MD09, then continue in order MD01-10. 
+ * pixel rejection bug fixes and config modifications [wiki:MDdeeptest_pixrej_20140403]
+ * staticsky and possibly skycal changes (i.e., MD04 has had a gross offset at least in i-band)
+ * all processing done using the ipp-pv3-20140717 tag now with specific config MD_IQ_STACK_1DG and new refcat (20140713)
+
+Label/data_group names will be uniform now -- PV2 IQ stacks -- and fill be summarized here and not in the subsections
+ * label/data_group: 
+  * '''MD<field>.pv2.iqstack.20140824''' -- 
+ * staticsky label/data_group: (same format as other stacks -- Nx<rundate>/<#>x<rundate>)
+  * MD<field>.pv2.iqstack.20140824.Nx20140824/MD04.pv2.iqstack.20140824.<#>x20140824 --
+ * skycal label/data_group: 
+  * MD<field>.pv2.iqstack.20140824.Nx20140824.cal20140824 -- 
+
+
+
+As for all stacks, '''basic cuts will be used''' to exclude poorer data (contribute less in weighted stacks, potential for more junk, waste resources) -- likely will add summary plots on analysis page for these params for revision -- basically similar to those used for the refstack.20140
+ * pre-June 2010 exposures fully excluded 
+  * significant camera change prior 1/2010
+  * baffle modifications prior 6/2010
+ * ZPT 24.3, 24.4, 24.3, 24.0, 23.0 (grizy each by mean exposure value, same as refstacks)
+ * background < 300, 600, 2000, 3000, 5000 (grizy each by mean exposure value)
+ * elongation < 1.3 (grizy by exposure value)
+ * FWHM < 10 pixels (grizy each by skycell, not by full exposure value) -- unlike <7 pixels for refstack, need <10 so edge skycells are not completely obliterated.
+ * no additional clipping of FWHM of larger inputs (like for refstack) since on early rising edge of FWHM distribution that can cause irregular rejection of inputs and leave large holes in coverage
+
+
+
+Data can be found on the datastore and postage stamp server (PSS) --
+ * __datastore__: full image/pixel bundles, staticsky and skycal stack photometry 
+  * ps1-md-iqstack -- these current full PV2 image/pixel bundles
+  * ps1-md-staticsky -- staticsky and skycal stack photometry catalog bundles 
+
+ * __PSS__: selected desired image/pixels -- use the label/data_group for the desired stack 
+
+
+
+'''Any problems and/or issues need to be identified quickly so that changes can be made before too many MD stacks are made.'''
+ * skycell loss due to quality issue will be unresolved for PV2 stacks
+ * background bias/offset -- still not fully corrected but minimal for small N input  '''(more description needed here)'''
+ * 
+
+
+Similar to GR0 there will be a summary for each field, but unlike GR0, will try and keep analysis and issues to other pages to reduce the length and load time for this summary page. 
+
+
+Status:
+ * '''7/x''' -- testing for FWHM and depth
+ * '''8/20''' -- MD04.iqstack.20140820 test run, ~30-35 inputs (manually set FWHM limit, relaxed ZPT,BG,elong cuts)
+ * '''8/21''' -- MD04.pv2.iqstack.20140821 test run, reduced to 25 inputs but excess, irregular FWHM clipping from config so could be 15-25 inputs
+ * '''8/24''' -- MD04.pv2.iqstack.20140824 started using tag '''ipp-pv3-20140717''' with MD_IQ_STACK_1DG config
+ * '''8/25''' -- MD09.pv2.iqstack.20140824 run and verfified
+ * '''8/26--8/27''' -- MD01,02,03,05,06,07,08,10 run when nightly processing not demanding the data nodes
+ * '''8/28''' to be finished and distributed, stack photometry finished
+
+----
+
+= MD04 =
+
+PV2 camera & warps -- PV2 warps are not cleaned up and will also be a accessible via the PSS/PSPS interface more quickly (release name MD04.PV2). 
+ * label: MD04.pv2.20130903
+
+PV2 IQ stack:
+ * label/data_group: 
+  * MD04.iqstack.20140820 -- test version 
+  * MD04.pv2.iqstack.20140821 -- test version
+  * '''MD04.pv2.iqstack.20140824''' -- final version, also label for postage stamp server
+ * staticsky label/data_group: (same format as other stacks -- Nx<rundate>/<#>x<rundate>)
+  * MD04.pv2.deepstack.20140506.Nx20140511/MD04.pv2.iqstack.20140824.<#>x20140824 --
+ * skycal label/data_group: 
+  * MD04.pv2.iqstack.20140824.Nx20140824.cal20140824 -- PV3 tag with new fixed refcat (20140713) and improved ZPT config 
+
+
+
+Summary of stack produced:
+{{{
+| stack_id | label                     | filter  | skycell_id  | dtime_script | reject_images | count(warp_id) | good_frac |
++----------+---------------------------+---------+-------------+--------------+---------------+----------------+-----------+
+|  3416811 | MD04.pv2.iqstack.20140824 | g.00000 | skycell.035 |         2350 |             0 |             25 |  0.987373 | 
+|  3416871 | MD04.pv2.iqstack.20140824 | r.00000 | skycell.035 |         2170 |             0 |             25 |  0.987292 | 
+|  3416931 | MD04.pv2.iqstack.20140824 | i.00000 | skycell.035 |         2430 |             0 |             25 |  0.987131 | 
+|  3416991 | MD04.pv2.iqstack.20140824 | z.00000 | skycell.035 |         2088 |             0 |             25 |  0.987219 | 
+|  3417051 | MD04.pv2.iqstack.20140824 | y.00000 | skycell.035 |         2139 |             0 |             25 |  0.987373 | 
+}}}
+
+Problems:
+ * no quality faults
+ * poor pixels/regions -- more need to be listed still --  
+{{{
+}}}
+
+
+
+
+----
+
+= MD09 =
+
+PV2 camera & warps -- PV2 warps are not cleaned up and will also be a accessible via the PSS/PSPS interface more quickly (release name MD09.PV2). 
+ * label: MD09.pv2.20131030
+
+
+
+Summary of stack produced:
+{{{
+| stack_id | label                     | filter  | skycell_id  | dtime_script | reject_images | count(warp_id) | good_frac |
++----------+---------------------------+---------+-------------+--------------+---------------+----------------+-----------+
+|  3417110 | MD09.pv2.iqstack.20140824 | g.00000 | skycell.035 |         2340 |             0 |             25 |   0.98679 | 
+|  3417170 | MD09.pv2.iqstack.20140824 | r.00000 | skycell.035 |         1980 |             0 |             25 |  0.986837 | 
+|  3417230 | MD09.pv2.iqstack.20140824 | i.00000 | skycell.035 |         2379 |             0 |             25 |  0.985342 | 
+|  3417290 | MD09.pv2.iqstack.20140824 | z.00000 | skycell.035 |         2076 |             0 |             25 |  0.986922 | 
+|  3417350 | MD09.pv2.iqstack.20140824 | y.00000 | skycell.035 |         2327 |             0 |             25 |  0.987143 | 
+}}}
+
+
+Problems:
+ * no quality faults
+ * poor pixels/regions need to be listed
+
+
+
+
+
+
+
+----