| 16 | | 1) a new "staticsky" distribution component : this is the method by |
| 17 | | which we will be distributing the results from the full photometry |
| 18 | | analysis of the static sky images. |
| | 13 | 1. a new "staticsky" distribution component : this is the method by which we will be distributing the results from the full photometry analysis of the static sky images. |
| | 14 | 1. Full extended source analysis! psphot is now able to produce acceptable measurements of all of the extended source parameters on our list. |
| | 15 | a. for all sources, we are now including Kron parameters (Kron flux and error in an aperture 2.5 times the first radial moment (R1), plus the flux within 1 times R and 4 times R1, as well as the value of R1. |
| | 16 | a. in the static sky analysis, for all sources we now report the radial aperture measurements (this was available in the earlier MD04 example set). |
| | 17 | a. Petrosian and elliptical surface brightness profiles for a subset of extended sources (S/N above some cut off to be defined, probably based on galactic latitude) |
| | 18 | a. PSF-convolved model fits for a subset of extended sources for Exponential, DeVaucouleur, and Sersic models. |
| | 19 | 1. fixed the forced photometry non-negative flux bug |
| | 20 | 1. added some other new stats: |
| | 21 | a. for PSF fits, we now have "psfWeightNotPoor" and "psfWeightNotBad" : the first gives the fraction of psf-weighted unmasked pixels considering any mask bits (except the internal 'mark' bit), while the former considers only 'bad' mask bits -- these are written to QF_PSF and QF_PSF_PERFECT in the CMF / SMF files. This may help to exclude false sources in subtracted burn regions (SUSPECT mask bit) or sources too close to a mask edge (CONV.POOR mask bit). |
| | 22 | a. raw aperture magnitudes (in addition to the curve-of-growth corrected version) for PSF measurements. |
| | 23 | a. in diff images, we now have several additional statistics related to the proximity of a diff detection to an input image source: DIFF_R_P, SN_P : distance and S/N of nearest bright source in the plus image, DIFF_R_M,SN_M : same for the minus image. |
| | 24 | a. for PSF sources, we have added several higher order moments: MOMENTS_M3C,S (third moments cos & sin theta), and same for 4th moments. |
| | 25 | 1. somewhat better CR / EXT tests, including use of Kron magnitude as test for source size (CR vs EXT) instead of PSF-based aperture. (though these are not yet reported as a probability). |
| | 26 | 1. save the radial profile aperture sizes in the headers |
| | 27 | 1. swap read order in dvomerge to loop over the available input tables and merge them with existing output tables |
| | 28 | 1. allow dvomerge to operate on only a region of the sky |
| | 29 | 1. update to dvomerge to allow different average photcodes in the inputs and the output database. |
| | 30 | 1. some important issues in ppSub that were resulting is somewhat poor matches when the IQ difference between the two images was large: |
| | 31 | a. ensure masked pixels are NANed in output diff image |
| | 32 | b. define separate penalties for each image (based on their fwhm values) |
| | 33 | c. define separate apertures for each image for flux normalization |
| | 34 | d. choose aperture based on curve-of-growth (was based on fixed fraction of full aperture flux, and thus noisy) |
| | 35 | e. some fine tuning of the penalty factor (this still seems arbitrary, and results are somewhat sensitive to the right value) |
| 20 | | 2) Full extended source analysis! psphot is now able to produce |
| 21 | | acceptable measurements of all of the extended source parameters on |
| 22 | | our list. |
| 23 | | a) for all sources, we are now including Kron parameters (Kron flux |
| 24 | | and error in an aperture 2.5 times the first radial moment (R1), plus |
| 25 | | the flux within 1 times R and 4 times R1, as well as the value of R1. |
| 26 | | b) in the static sky analysis, for all sources we now report the |
| 27 | | radial aperture measurements (this was available in the earlier MD04 |
| 28 | | example set). |
| 29 | | c) Petrosian and elliptical surface brightness profiles for a subset |
| 30 | | of extended sources (S/N above some cut off to be defined, probably |
| 31 | | based on galactic latitude) |
| 32 | | d) PSF-convolved model fits for a subset of extended sources for |
| 33 | | Exponential, DeVaucouleur, and Sersic models. |
| | 37 | Note that there are three new output formats that are needed to make all of these features part of the standard products: |
| 37 | | 4) added some other new stats: |
| 38 | | a) for PSF fits, we now have "psfWeightNotPoor" and "psfWeightNotBad" |
| 39 | | : the first gives the fraction of psf-weighted unmasked pixels |
| 40 | | considering any mask bits (except the internal 'mark' bit), while the |
| 41 | | former considers only 'bad' mask bits -- these are written to QF_PSF |
| 42 | | and QF_PSF_PERFECT in the CMF / SMF files. This may help to exclude |
| 43 | | false sources in subtracted burn regions (SUSPECT mask bit) or sources |
| 44 | | too close to a mask edge (CONV.POOR mask bit). |
| 45 | | b) raw aperture magnitudes (in addition to the curve-of-growth |
| 46 | | corrected version) for PSF measurements. |
| 47 | | c) in diff images, we now have several additional statistics related |
| 48 | | to the proximity of a diff detection to an input image source: |
| 49 | | DIFF_R_P, SN_P : distance and S/N of nearest bright source in the plus |
| 50 | | image, DIFF_R_M,SN_M : same for the minus image. |
| 51 | | d) for PSF sources, we have added several higher order moments: |
| 52 | | MOMENTS_M3C,S (third moments cos & sin theta), and same for 4th |
| 53 | | moments. |
| 54 | | |
| 55 | | 5) somewhat better CR / EXT tests, including use of Kron magnitude as |
| 56 | | test for source size (CR vs EXT) instead of PSF-based aperture. |
| 57 | | (though these are not yet reported as a probability). |
| 58 | | |
| 59 | | 6) save the radial profile aperture sizes in the headers |
| 60 | | |
| 61 | | 7) swap read order in dvomerge to loop over the available input tables |
| 62 | | and merge them with existing output tables |
| 63 | | |
| 64 | | 8) allow dvomerge to operate on only a region of the sky |
| 65 | | |
| 66 | | 9) update to dvomerge to allow different average photcodes in the |
| 67 | | inputs and the output database. |
| 68 | | |
| 69 | | 10) some important issues in ppSub that were resulting is somewhat |
| 70 | | poor matches when the IQ difference between the two images was large: |
| 71 | | a) ensure masked pixels are NANed in output diff image |
| 72 | | b) define separate penalties for each image (based on their fwhm values) |
| 73 | | c) define separate apertures for each image for flux normalization |
| 74 | | d) choose aperture based on curve-of-growth (was based on fixed |
| 75 | | fraction of full aperture flux, and thus noisy) |
| 76 | | e) some fine tuning of the penalty factor (this still seems |
| 77 | | arbitrary, and results are somewhat sensitive to the right value) |
| 78 | | |
| 79 | | Note that there are three new output formats that are needed to make |
| 80 | | all of these features part of the standard products: |
| 81 | | |
| 82 | | for chip-image processing: PS1_V3 |
| 83 | | for staticsky processing: PS1_SV1 |
| 84 | | for diff processing: PS1_DV2 |
| 85 | | |
| 86 | | I would like to run with the old versions for a few days to check that |
| 87 | | there are no problems, and to give people a bit of a warning. we need |
| 88 | | to be particularly careful that the MOPS folks do not get torqued by |
| 89 | | the diff output changes. |
| | 43 | I would like to run with the old versions for a few days to check that there are no problems, and to give people a bit of a warning. we need to be particularly careful that the MOPS folks do not get torqued by the diff output changes. |
| 102 | | rsync://pikake.ifa.hawaii.edu/ppsub.samples.simtest : this directory |
| 103 | | contains an extensive set of images with different PSFs all |
| 104 | | differenced against each other with the newly-updated psphot. There |
| 105 | | are two classes of images: those with .fg in the name have Gaussian |
| 106 | | PSFs (range of sizes, axis ratios, and angles), while those with .fp |
| 107 | | use the PS1_V1 model (a wingier PSF meant to mimic PS1). |
| | 51 | rsync://pikake.ifa.hawaii.edu/ppsub.samples.simtest : this directory contains an extensive set of images with different PSFs all differenced against each other with the newly-updated psphot. There are two classes of images: those with .fg in the name have Gaussian PSFs (range of sizes, axis ratios, and angles), while those with .fp use the PS1_V1 model (a wingier PSF meant to mimic PS1). |
| 126 | | I next examined the impact of different PSF models, to check the |
| 127 | | impact of the choice of model shape (ie, is the photometry more |
| 128 | | consistent the more accurately the PSF is modelled). This did not |
| 129 | | have a huge impact on the photometry (the bright-end sag was still |
| 130 | | apparent), but the bright end photometric scatter is less in my |
| 131 | | analysis (PSF - AP) than in Nigel's (PS1 - SDSS). |
| | 63 | I next examined the impact of different PSF models, to check the impact of the choice of model shape (ie, is the photometry more consistent the more accurately the PSF is modelled). This did not have a huge impact on the photometry (the bright-end sag was still apparent), but the bright end photometric scatter is less in my analysis (PSF - AP) than in Nigel's (PS1 - SDSS). |
