Summary of ppStack_testing_201111 ---IN PROGRESS PLEASE DO NOT EDIT---

Discovered for many inputs into ppStack (i.e., deep and even refstacks), that the PSF in the output convolved stack grows with the number of inputs beyond the initial target PSF. Had been missed due to convolved stacks really only being used for magic, but was noticed with some M31 analysis and deepstacks of MD04. Memory use has also been an issue with the deepstacks and was simultaneously being investigated.

Example: MD04 skycell.055 somewhere, ~100 input warps

• FWHM input average from log = 4.48+-0.81 (pixels)
• largest input has FWHM_MAJ of ~7.2 so clipped?
• target FWHM = 6.88, kron~6.29 from log
• convolved stack FWHM_MAJ=14.36
• for comparison, unconvolved stack FWHM_MAJ=4.32

left to right: input warp FWHM_MAJ~6.8, unconvolved stack, convolved stack

Other issues:

• hard limit on number of inputs (solved: descrip to watch for)
• heavy RAM use
• change the target PSF FWHM selected

Branch for testing (currently r32161 from last summer -- need to update..) -- ​http://svn.pan-starrs.ifa.hawaii.edu/trac/ipp/browser/branches/meh_branches/ppstack_test

• many outputs turned on (runs slower, makes many many files)
• ppStackMatch.c -- need add a TESTING2 for reading in already processed conv images..
• ppSubMatchPSFs.c has TESTING but not ifdef at start, is a .DEBUG. used to trigger?

Test Sets

More easily setup than for testing ppSub, need a large number of a variety of inputs and some number of similar inputs.

MD04

Sample of 20 and 100 drawn from the the MD04.V3 GR0 deepstack set for memory testing as well.

• FWHM in stack logs.. add how compare to psphot? need to add histogram of both actual inputs

Batch scripts for running in /data/ipp059.0/mhuber/testppstack_deep201111/MDdeeptest

Sim

A small variety set of many groups for 20 and 100 inputs. Also sample of two similar inputs using the _000 and _001 images.

Simtest setup:

• pixelscale 0.258"/pixel?

filename	sim FWHM	FWHM_MAJ (pixel)	IQ_FW1 (pixel)
image.0	1.0	3.82	2.98
image.1	1.1	4.19	3.28
image.2	1.2	4.58	3.62
image.3	1.5	5.69	4.49
_and repeat_

Batch scripts for running in various /data/ipp059.0/mhuber/testppstack_deep201111/ppstack_simdeep* (needs cleanup)

Initial Tests

• do clean simulated images suffer the same problem?
  • can use for more detailed testing since faster to run than MD04 skycell and not particular to GPC1 data
• how is it related to the range of inputs and number
  • is 20 inputs enough to reveal problem, if 100 then will be tedious
• what are the output convolved images being stacked, what is the target the images are being convolved to
• need to understand what the code does, so first test is to look at each output, add others and step through the code...

• convolution of each input seem to be larger than expected -- from the tests it appears to be also with the range of input FWHM.

MD04: 20 input case:

• initially run for a memory test, but added extra outputs
• input FWHM 4.49+/-0.48 (ave?)
• target seeing FWHM: 5.06, kron ~4.0

filename	FWHM_MAJ (pixel)	IQ_FW1 (pixel)	.log Input FWHM (pixel)	.log kron (pixel)
real_000	5.38	4.20	5.40	4.25
real_009	4.27	3.17	4.19	3.42/33
fake_000	5.10	4.09
fake_009	5.10	4.09
conv.0
conv.9	7.91	6.02
comb.initial	x	x
stack	8.39	6.06 (also initially missing from header)
stack.unconv	4.02	3.55

MD04: 100 input case:

• was run for memory monitoring, will need to be rerun for real/fake/conv outputs later
• input FWHM 4.84+/-0.81 (ave?)
• target seeing FWHM: 6.88, kron ~6.29

filename	FWHM_MAJ (pixel)	IQ_FW1 (pixel)	.log Input FWHM (pixel)	.log kron (pixel)
real_001	x	x	5.40	4.39/35
real_009	x	x	4.65	3.63/62
fake_000	x	x
fake_009	x	x
conv.0	x	x
conv.9	x	x
comb.initial	x	x
stack	14.36	9.75 (was missing from header)
stack.unconv	4.31	4.15

Sim: 20 input case: 4 groups

filename	sim FWHM	sim FWHM_MAJ	.log Input FWHM (pixel)	.log kron (pixel)
_000	1.0		3.82(1)	1.99/92,88/78,05/05,91/81
_001	1.1		4.19(1)	2.19/09
_002	1.2		4.58(1)	2.55/48
_003	1.5		5.69(1)	3.11/00

• basic set of 4 images of growing FWHM and repeated as 4 groups for 20 inputs
• input FWHM 4.57+/-0.72 (ave?)
• target seeing FWHM: 5.70 -- set by worst input, kron ~3.1
• some wildly varying kron values

filename	FWHM_MAJ (pixel)	IQ_FW1 (pixel)
real_000	3.88	3.00
real_003	5.82	4.54
fake_000	5.10	3.69
fake_003	5.04	3.68
conv.1	6.51	5.10
conv.3	6.60	5.19
comb.initial	6.57	5.58
stack	6.57	5.41
stack.unconv	4.33	3.49

filename descriptions:

• real = input warps
• fake = target image to convolve the real to (bit more than just that, selected target PSF sources, background, scaling)
• conv = convolved real image
• comb.initial = initial stack w/o rejecting input images (that all?)
• stack = final convolved stack

Sim: 20 input case w/ similar inputs: 10 groups

filename	sim FWHM	sim FWHM_MAJ	.log Input FWHM (pixel)	.log kron (pixel)
_000	1.0	3.87(2)	3.88(1)	2.1(1)
_001	1.1	4.25(1)	4.26(1)	2.28(4)

• similar set, just created with 2 types with similar FWHM
• input FWHM 4.07+/-0.19 (ave)
• target seeing FWHM: 4.28 -- set by worst input, kron ~2.26
• s

filename	FWHM_MAJ (pixel)	IQ_FW1 (pixel)
real_000	3.87	3.00
real_001	4.24	3.32
fake_000	4.27	3.22
fake_001	4.27	3.21
conv.1	4.49	3.52
conv.1	4.56	3.58
comb.initial	4.54	3.77
stack	5.37	4.36

• odd final stack is ~20% larger than conv and initial stack -- need to check

Sim: 100 input case: 25 groups

filename	sim FWHM	sim FWHM_MAJ	.log Input FWHM (pixel)	.log kron (pixel)
_000	1.0		3.82(1)	1.99/92,88/78,05/05,91/81
_001	1.1		4.19(1)	2.19/09
_002	1.2		4.58(1)	2.55/48
_003	1.5		5.69(1)	3.11/00

• same set as before, just more groups
• input FWHM 4.56+/-0.71 (ave?)
• target seeing FWHM: 5.72, kron ~3.02

filename	FWHM_MAJ (pixel)	IQ_FW1 (pixel)
real_000	3.82	2.11/24
real_003	5.69	3.10/02
fake_000
fake_003
conv.1
conv.3
comb.initial
stack	7.73
stack.unconv

Modification Tests

Sim: 20 input case: 4 groups