Summary of MD10.refstack.20130715

(back to MediumDeepFields summary)

Similar to the revised MD10.refstack.20120804 (MD10.refstack.20120705) refstacks for the 2012 season, these include recent improvements for the PV2 (list?). Overall fewer inputs to the refstack were done this round and may not be as deep as last season.

MD10 observations:

• starting late June 2013 with pre-observations, regular observations mid-July
• end July 2012 through start Jan. 2013
• mid-July 2011 through early Dec. 2011
• late June 2010 through early Dec. 2010
• end Aug. 2009 through start Jan. 2010
• (some 2008 but pre-survey)

Filter	N total	N FWHM<8 pixels	N (FWHM<8 pixels for 2012	N FWHM<6 pixels	N (FWHM<6 pixels for 2012
g	627	591	120	478	72
r	613	584	111	515	83
i	608	565	145	483	117
z	660	610	180	559	150
y	557	504	217	396	150

• 2012 wasn't a great season for MD10, but better than MD09

Status:

• 07/15/13 selected exposure reprocessing chip->warp for refstack started
• 07/18 reftests finished. detrend issues OTA47, redoing subset of exposures for most of 2010 to use revised video dark.. full refstack started
• 07/19 refstack finished, checked and problem skycells found/fixed if possible. staticsky single filter only finished and mappings started -- seeing psphot issue reported in DRAVG still..
• (07/20) mappings finished (some oddities showing up), 1-d conv PV2 rejecting more than expected, diffim testing, non-1d conv refstack setup , recently missed exposures setup for diffims and finished
• (07/21) reftest+refstack to distribution
• 07/25 finished looking into oddities for now, updating wiki

MD10.V3 Processing (chip->warp + refstack)

Exposure reprocessing was done for only a limited number (~150) of the best images from 2010-2012 to provide a balance of N input warps versus best seeing, excluding exposures with large background, low zeropoints and large elongation.

Processing chip-warp and the refstack itself has the same label, data_group

• label: MD10.refstack.20130715 --> once set as active refstack for diffims, stack label will change to MD10.refstack, chip/cam/warp label will remain the same
• data_group: MD10.refstack.20130715

The ipp-20130715 tag used

• GPC1_Detrend_Documentation -- new video darks
• dynamic masks now propagating through to warps
• 1-d convolution option for PV2
• changes to psphot, PSF_MAJOR,MINOR root(2) different but appropriate now and 2*root(2) for FWHM

Histograms of the FWHM major and minor and elongation from camera stage value (full exposure) for the sample of reprocessed exposures (red) and used for refstack.20130715 (top blue) and used for refstack.20120804 (bottom blue) in grizy order

Test stack (reftest) sample also made again for skycell.055 with different number of input warps.

• label: MD10.reftest.20130715
• data_group:
  • MD10.reftest.20130715.c#f<FWHM cut> where #=comparison run, <FWHM cut>=cut <fwhm_major from camProcessedExp x10>
  • MD10.reftest.20130715.all.<FWHM cut> where all means 05/2010+2011+2012 data possible, <FWHM cut>=cut <fwhm_major from camProcessedExp x10>
  • MD10.reftest.20130715.2012.<FWHM cut> where 2012 means 2012 data only for season stack example case, <FWHM cut>=cut <fwhm_major from camProcessedExp x10>
• the main field center shift was through ~Dec 2009, but is a very small shift. Excluding 2009 since usually not very good, or uncharacteristically too good (avoiding problems basically)
• c1 cuts

  filter: (FWHM set), elongation, zeropoint, background limits
  y: (3.5, 3.8, 4.1, 4.6max), 1.3, 22.8, 5000 -- bkg bit higher
  z: (3.6, 3.7, 3.8, 4.0max), 1.3, 24.0, 4000 -- bkg bit higher 
  i: (3.7, 3.9, 4.1, 4.3), 1.25, 24.3, 2000 --
  r: (4.2, 4.4, 4.5, 4.7), 1.25, 24.3, 600 -- 
  g: (4.6, 4.8, 5.0, 5.2~max), 1.25, 24.3, 400 -- 
  

Summary comparison table with the approximate FWHM (major) as the PSF FWHM from a center field skycell (V3=055) after running psphot on the stacks.

| data_group                        | filter  | stack_id | warps_in | warps_rej |  FWHM_MAJ   IQ_FW1 (pixels)
+-----------------------------------+---------+----------+----------+-----------+
--> 2013 refstack
| MD10.refstack.20130715            | g.00000 |  2294005 |       94 |        16 | 	 5.01  4.03 
| MD10.refstack.20130715            | r.00000 |  2293945 |       84 |        15 | 	 4.52  3.74 
| MD10.refstack.20130715            | i.00000 |  2293885 |       86 |        11 | 	 3.78  3.10 
| MD10.refstack.20130715            | z.00000 |  2293825 |       85 |        16 | 	 3.16  2.99 
| MD10.refstack.20130715            | y.00000 |  2293765 |       87 |        15 | 	 3.42  3.14 

--> reftest comparisons						
| MD10.reftest.20130715.all.49      | g.00000 |  2291338 |       95 |	     20 | 	 4.74  3.88 
| MD10.reftest.20130715.2012.49     | g.00000 |  2291339 |       13 |	      4 | 	 4.77  3.56 
| MD10.reftest.20130715.c1f46       | g.00000 |  2291365 |       25 |	      6 |	 4.82  3.59 
| MD10.reftest.20130715.c1f48       | g.00000 |  2291366 |       56 |	      9 | 	 4.71  3.84 
| MD10.reftest.20130715.c1f50       | g.00000 |  2291367 |       95 |	     17 | 	 4.48  4.04 
| MD10.reftest.20130715.c1f52       | g.00000 |  2291368 |      124 |	     21 | 	 4.95  4.15 
| MD10.reftest.20130715.all.44      | r.00000 |  2291336 |       90 |	     17 | 	 4.26  3.56 
| MD10.reftest.20130715.2012.44     | r.00000 |  2291337 |       17 |	      3 | 	 3.88  3.12 
| MD10.reftest.20130715.c1f42       | r.00000 |  2291361 |       31 |	      4 | 	 4.21  3.38 
| MD10.reftest.20130715.c1f44       | r.00000 |  2291362 |       65 |	     11 | 	 4.41  3.66 
| MD10.reftest.20130715.c1f45       | r.00000 |  2291363 |       84 |	     15 | 	 4.38  3.74 
| MD10.reftest.20130715.c1f47       | r.00000 |  2291364 |      121 |	     16 | 	 4.51  3.83 
| MD10.reftest.20130715.all.40      | i.00000 |  2291334 |       90 |	     12 | 	 3.74  3.06 
| MD10.reftest.20130715.2012.40     | i.00000 |  2291335 |       13 |	      2 | 	 3.33  3.20 
| MD10.reftest.20130715.c1f37       | i.00000 |  2291357 |       30 |	      6 | 	 3.48  2.98 
| MD10.reftest.20130715.c1f39       | i.00000 |  2291358 |       54 |	     10 | 	 4.61  3.02 
| MD10.reftest.20130715.c1f41       | i.00000 |  2291359 |       87 |	     10 | 	 3.77  3.10 
| MD10.reftest.20130715.c1f43       | i.00000 |  2291360 |      124 |	     20 | 	 3.86  3.17 
| MD10.reftest.20130715.all.37      | z.00000 |  2291332 |       85 |	     21 | 	 3.39  2.95 
| MD10.reftest.20130715.2012.37     | z.00000 |  2291333 |       18 |	      3 | 	 3.58  3.03 
| MD10.reftest.20130715.c1f36       | z.00000 |  2291353 |       46 |	      8 | 	 3.36  2.93 
| MD10.reftest.20130715.c1f37       | z.00000 |  2291354 |       66 |	     11 | 	 3.43  2.96 
| MD10.reftest.20130715.c1f38       | z.00000 |  2291355 |       85 |	     18 | 	 3.15  2.98 
| MD10.reftest.20130715.c1f40       | z.00000 |  2291356 |      118 |	     23 | 	 3.22  3.04 
| MD10.reftest.20130715.all.38      | y.00000 |  2291329 |       82 |	     20 |	 3.37  3.07 
| MD10.reftest.20130715.2012.38     | y.00000 |  2291331 |       28 |	      4 | 	 3.37  2.89 
| MD10.reftest.20130715.c1f35       | y.00000 |  2291349 |       27 |	      5 | 	 3.29  2.85 
| MD10.reftest.20130715.c1f38       | y.00000 |  2291350 |       59 |	     10 | 	 3.38  3.06 
| MD10.reftest.20130715.c1f41       | y.00000 |  2291351 |       88 |	     17 | 	 3.41  3.15 
| MD10.reftest.20130715.c1f46       | y.00000 |  2291352 |      118 |	     18 | 	 3.50  3.26 
	
--> previous 2012 refstack				
| MD10.refstack.20120804            | g.00000 |  1108704 |      103 |	     36 | 	 5.08  4.10 
| MD10.refstack.20120804            | r.00000 |  1112755 |       98 |	     21 | 	 4.25  3.86 
| MD10.refstack.20120804            | i.00000 |  1112815 |       89 |	     13 | 	 3.50  3.15 
| MD10.refstack.20120804            | z.00000 |  1112695 |      100 |	     19 | 	 3.41  3.12 
| MD10.refstack.20120804            | y.00000 |  1108632 |       71 |	     11 | 	 3.64  3.32 

As before, the FWHM_MAJOR with the central skycell can be variable and more so with largely different input sets. Comparison with the psf_major/minor maps are more useful between refstack versions.

Problems

• as with all past refstacks, generally edge skycells have issues -- need better containment of those still. (see core coverage below).
• like others, greater % of inputs rejected (20-30%) so per pixel input is less, but still of order 30 inputs per pixel
• some convolved stacks have poorer FWHM PSF but not significant enough to be likely improved by reprocessing using DEEP_STACK config as in earlier MD fields
• skycell notes:
  • y: s025,026,036,037,047,057 bad cell bands still.. s032 odd splotch
  • z: s012 quality fault, rerun DEEP_STACK; s046,063,065,066 odd raised background (bad cell?)
  • i: s065 like some other cells, some odd raised background (bad cell? glint?)
  • r: s014,015,048,064,065,066,084 poor ghost mask/mess
  • g: s014,015,022,023,027,032,037,045,048,058,064,065,067,085 poor ghost mask/mess; s038 edge really ratty; s044,054 poor cell arc (wonder if could/should mask cell?)

Core coverage -- one of the shifted pointings so different from normal distribution of skycells (also see detection efficiency maps below)

082-087
071-078
061-068
051-058
041-048
031-038
021-028
012-017

• skycells with fewer inputs (typical for edges): 012,017,021,028,071,078,082,087
• skycells with <50% or more of typical input number is filter dependent - usually s017,028,078,087; sometimes none except s078

Refstack Summary

Refstacks run through the staticsky (single filter mode so basic psphot with deteff measurements) and skycal stage on the unconvolved stacks to make the map plots (full 5 filter version still having occasional faults to work through):

• label: MD10.refstack.20130715, MD10.refstack.20130715
• data_group: MD10.refstack.20130715.1x20130715, MD10.refstack.20130715.1x20130715.cal20130715

Source photometry psf_major,_minor maps (grizy):

Magnitude of sources@5-sigma maps (grizy):

Detection efficiency magnitude @50% recovery (500 fakes, grizy):

1D convolution mode PV2

Same label as generally above, adding _1dg to the data_group (as will be seen on the datastore)

• label: MD10.reftest.20130715
• data_group:
  • MD10.reftest.20130715.c#f<FWHM cut>_1dg where #=comparison run, <FWHM cut>=cut <fwhm_major from camProcessedExp x10>
  • MD10.reftest.20130715.all.<FWHM cut>_1dg where all means 05/2010+2011+2012 data possible, <FWHM cut>=cut <fwhm_major from camProcessedExp x10>
  • MD10.reftest.20130715.2012.<FWHM cut>_1dg where 2012 means 2012 data only for season stack example case, <FWHM cut>=cut <fwhm_major from camProcessedExp x10>
• the main field center shift was through ~Dec 2009, but is a very small shift. Excluding 2009 since usually not very good, or uncharacteristically too good (avoiding problems basically)
• c1 cuts (same as above)

Summary comparison table with the approximate FWHM (major) as the PSF FWHM from a center field skycell (V3=055) after running psphot on the stacks.

| data_group                        | filter  | stack_id | warps_in | warps_rej |  FWHM_MAJ   IQ_FW1 (pixels)
+-----------------------------------+---------+----------+----------+-----------+