Summary of MDdeeptest_pixrej_20140403

(back to MediumDeepFields summary)

For a while it has been bothersome to find junk in the MD stacks through just simple visual inspection as would not be expected in N=60 (refstack) and definitely not for N>>60 (deepstack), and they can also come and go depending on the inputs used. This seems to be at least configs needing tuning, at worst code bugs.

A related issue also to be addressed is the ratty edge of the MD stacks due to poorer edge chips and smaller number of input pixels. Possible alternatives for a solution are

• hard cut by radius field by field and filter --
• combine MD+3PI to help improve by including better 3PI pixels --
• only include pixel if N input > some minimum, similar to the SAFE (N=2) option but with a larger N minimum --
• any others options?

---

Example Junk and Bugs

Large regions of high level, bad pixels (spike chunks, the moth) -- bugs

img

mk

wt

num

exp

expwt

• due to NAN/0 bug from unprotected denominator being 0, setting mean and sigma to NAN (all inputs used)

Excess hot pixels/CR-like --

img

mk

wt

num

exp

expwt

• due to bug shown after NAN/0 bug fixed, sigma sometimes being set to a negative value resulting in final mean and sigma going NAN (all inputs used)

Large region of low level, bad pixels -- bug? much can be reduced by config mods

img

mk

wt

num

exp

expwt

• greatly reduced by lowering THRESHOLD.MASK 0.5->0.01 (may need further modifications)

Edge pomegranate-like webbing -- bug? much can be reduced by config mods

img

mk

wt

num

exp

expwt

• greatly reduced by lowering THRESHOLD.MASK 0.5->0.01 (may need further modifications)

Misc edge junk --

---

Test Samples

All should be available via the PSS, if large or full sets are desired then can be push to the datastore (let us know)

MD04 PV2 warps -- MD04.cut2009deeptest.20131103 for manual testing, the full test runs below used all available PV2 through the end of the survey (MD.PV2)

• label: MD04.pv2_stacktest.20130903

3PI exposures overlapping with MD04 -- span Apr. 2009 to Feb. 17 2014, however any exposures before June 2010 will be excluded just like the MD04 exposures (i.e., cut2009 condition described at MD04.pv2_stacktest.20130903)

• label: MD04.test3pistack.20140217 --
• (need to add total and used numbers)

MD04+3PI overlap test with just the bug fixes to compare the edge quality -- will include additional PV2 warps through end of survey for MD04, but just 3PI though Feb. 2014

• label: MD04_3PI.cut2009teststack.20140404 -- g-band only

MD04+3PI overlap test with bug fixes and config mods to compare the edge quality -- will include same available warps

• label: MD04_3PI.cut2009teststack.20140411 -- again g-band only
• THRESHOLD.MASK 0.01
• COMBINE.REJ 2.5

MD04 with bug fixes, config mods, N>20 inputs per pixel to clean up the field edge -- can compare to MD04.cut2009deeptest.20131103 since inputs limited by date here

• label: MD04.cut2009n20deeptest.20140413 -- i-band only
• THRESHOLD.MASK 0.01
• COMBINE.REJ 2.5

---

Configuration Mods

This should be done properly before the final version, but will take some time to do