= Summary of ppSub_testing_201201 ---IN PROGRESS PLEASE DO NOT EDIT--- = [[PageOutline]] The primary purpose has been expanded and redirected. While it appeared that the fixed convolution direction may have been the likely cause of an overabundance of false detections from residuals of bright sources in the field, issues also in the convolved stack with a resulting larger than selected target PSF has illustrated there may also be issues with the PSF matching/convolution itself. So the scope of testing has been broadened/focused to the PSF matching/convolution in ppSub ([wiki:ppStack_testing_201111 tests with ppStack for convolved stacks]) * is ppSub doing what we want * is ppSub doing what we think * has something changed along the way (in the data or code) General tasks (no particular order and by no means complete, concise, clear or quantitative): * need to establish a baseline to verify against any past/future changes in code and with reprocessing including a test set of real+simulated images that is '''readily''' inter-comparable (avoid having to pull values from logfiles etc) * IPP/ppSub: current ops tag ipp-20111222, branches/meh_branches/ppsub_test [available] * photpipe/HOTPANTS: V3 configuration locally configured [finally running again on local desktop -- auto choice in progress, forced opposite to setup after. HOTPANTS compiled on all machines] * datasets: * MD04: for S-S and S-refstk (may want W-refstk later) [stacks and refstack selected over time, IQ and with know sources finished and "bundled"] * sim: for all cases W-W, W-S, S-S, S-refstk [in progress, mostly created with past testing with ppStack -- hold with just these] * 3PI/other: for W-W and W-S cases [still need to select images to use -- delay for now] * wrap up and re-test the convolution direction choice in ppSub (see monitor) * does it still work as it did when tested a few months ago with MD10.V2? [to test for the baseline sample MD04.V3 S-refstk and S-S, sim] * does it affect the dual convolution [need 3PI/other sample still, need forced photometry setup] * if it chooses to convolve the input, is it poorer (see recent monitoring) with greater false detections, larger/messy residuals * verify the PSF matching, convolution and diffims - test as expected, self-comparison, cross-comparison (need add a translation map for different outputs) * PSF shape - is it equivalent to the target before convolution and subtraction (is there a scaling/normalization issue?) * appears solution fairly insensitive to input kernel params -- * return to stamp choices - need a check for "poor" not being rejected, are masked values set to 0 under stars in background subtracted image reasonable or cause discontinuity problems? * forced photometry measurements on sky and selected sources (stats and residuals) -- * the "no-conv" case - what is limiting ppSub -- have many cases of "close" inputs in test sets, what are the resulting kernels and output convolution params * tracking sources of "extra" false diffim detections * obviously more use of flags2 and DIFF_* diffim stats -- need to map conditions in more detail (see tuning) as seem to miss flagging the lower level peak/blister residuals (below) * lower level peak/blister residuals -- seem to come and go not always aligned with FWHM (see monitoring and MD04 test sample) and not found often in photpipe (to be tested with test set however) * monitor new data/reprocessing/tag changes * initially new data as MD04 is ongoing and IQ is improved -- convolution direction tests, false detection tests * obviously test changes with ppsub_test * parameter space, tuning, adding * kernels (current ppSub using equivalent HOTPANTS, pandromeda pipeline values) and proper scaling -- currently ppSub actually seems mostly insensitive to the kernel params * DIFF_xRATIO diffim stats (photpipe vs MT) * values to be added to gpc1 DB and/or the FITS headers (for checking, monitoring) == Background == Samples of previous information/work/comparisons * http://svn.pan-starrs.ifa.hawaii.edu/trac/ipp/wiki/ppSub_vs_Hotpants * http://svn.pan-starrs.ifa.hawaii.edu/trac/ipp/wiki/Basic_GPC1_Processing_IPP_Photpipe_Comparison * http://svn.pan-starrs.ifa.hawaii.edu/trac/ipp/wiki/ppSubModifications_201009 * http://svn.pan-starrs.ifa.hawaii.edu/trac/ipp/wiki/ppSub_Modifications_20101021.single * http://svn.pan-starrs.ifa.hawaii.edu/trac/ipp/wiki/ppSub_Modifications_20100918.single * http://ps1sc.ifa.hawaii.edu/PS1wiki/index.php/TransientPhotfestSept2010 * http://ps1sc.ifa.hawaii.edu/PS1wiki/index.php/Performance_Tests_July2010#A.X_Diffim_photometry_reprocessing_data_sample * http://ps1sc.ifa.hawaii.edu/PS1wiki/index.php/Diffimtest_IPP_photpipe_sne * http://ps1sc.ifa.hawaii.edu/PS1wiki/index.php/Diffimtest_ut100510_md07s056 = Setup = Operations tag for testing base diffims is ipp-20111220 (since local tests could/should fix at some r since the tag has revisions added to it? ) Branch for originally testing the choice of convolution direction but now full development testing is also updated to r33098 (from 1/11/2012) -- http://svn.pan-starrs.ifa.hawaii.edu/trac/ipp/browser/branches/meh_branches/ppsub_test Summary of changes so far: * for convolution direction choice * normalization updated each direction -- need to look if in path for ppStack fixed, seem to recall modifies even fixed (may be for both) * for PSF matching * kernel scaling based on Kron radius instead of * general, help for MOPS using DIFF_R_P for cuts -- ppSub/src/ppSubFlagNeighbors.c DIFF_R_P/M chooses closest match based on detection peak flux s/n, change to 1/psfmagerr used for DIFF_SN_P/M. * to be tested how responds to if no input catalogs provided -- no catalogs produce an error before the change {{{ Error in subtraction: -> subScaleKernel (ppSubMatchPSFs.c:127): Problem in data values Unable to scale kernel, since no sources were provided. -> ppSubMatchPSFs (ppSubMatchPSFs.c:379): Problem in data values Unable to scale kernel parameters -> ppSubLoop (ppSubLoop.c:113): Problem in data values Unable to match PSFs. }}} * only the no-conv case allows no input catalogs, so need to trace what detection peak is used for that -- running NOCONVOLVE TRUE then faults with Assertion failed in function ppSubMakePSF at ppSubMakePSF.c:61. Error stack: Abort. -- so don't need to worry about case of no input sources and can make change. * gpc1 DB columns: * FWHM/IQ would be helpful to have in stackSumSkyfile * FITS keywords: * kernel sum useful in ppSub? Photpipe/HOTPANTS setup on desktop to start, then may move to the dev cluster (HOTPANTS also build on dev and ops clusters). = General/Baseline "start" tests = = Parameter Space = == Kernel parameters == HOTPANTS suggested: * need to also resolve size/sigma conversion between ppSub and HOTPANTS M31 group: * standard deviations of 9, 6, 3 and 0.1 pixel and a polynomial order of 2, 4, 6 and 0 * independent but similar algorithm described in Kerins et al. 2010 http://arxiv.org/abs/1004.2166 for regions with complex backgrounds * look at difference in photometric scaling method in more detail = PSF Matching/Convolution = == Poor PSF-matching? == Not sure yet what to classify this as other than the PSF not being matched well. Suspect similar to issue with convolved stacks in ppStack. == No-convolution? == Reports from other surveys that diffims are poorer with images having similar PSFs, convolution isn't well matched? Is this for dual only? = Convolution direction choice = We want to avoid large deconvolution in PSF-matching image subtraction. As the image quality of the images continues to improve, always convolving the reference stack will not produce the best difference image and convolving the input image is desired. The quality of the difference image is evaluated in both directions and the better is chosen for the output (need to add specific condition test). MD04 sample: Not all seem to be really due to convolving in the wrong direction and need to identify and separate the cases/causes if can. Running samples forced in both direction useful to see. CfA photpipe/HOTPANTs direction: using single template/reference stack so locally get keyword CONVOL00 from header except slight issue with amps. '''All are convolving the TEMPLATE only''' so also suggest issue seems not a convolution direction but convolution issue itself. * discovered the current photpipe setup is now set to for convolving the template only.. rather then testing both.. argh.. Sample diffims with direction forced and detections marked (note both stack-refstack and stack-stack cases). The stack-stack case is the really the only way to test the convolution direction choice now unless go back to the MD04.V2 sample. (easiest to use event stamps from pages, but may want image photpipe diffim..) * ref - ref * stk - ref vs ref - stk (both directions) * stk - stk (both directions) || '''obsdate/stack_id (stk-ref)''' || '''FWHM_MAJ (pixel)''' || '''IQ_FW1 (pixel)''' || '''ppSub (auto choice, old/test)''' || '''photpipe/HOTPANTS (auto choice)''' || comment || || || || || || || || || refstack.20111012 / 450933 || 5.206454 || 4.08811 || -- || -- || || || 20100110 / 444020 || 4.878624 || 3.891729 || 1/2 || i || || || 20100121 / 444079 || 5.843588 || 4.574009 || 1/1 || t || || || 20110129 / 444251 || 4.424473 || 3.378561 || 1/2 || i || || || 20110201 / 644876 || 5.746622 || 4.748873 || 1/1 || t || || || 20110312 / 446658 || 4.958342 || 3.74775 || 1/2 || i || || || 20110315 / 645114 || 4.270276 || 3.232871 || 1/1 || i || || || 20110423 / 446715 || 4.603964 || 3.510957 || 1/2 || i || || || 20110429 / 645474 || 7.178107 || 6.027955 || 1/1 || t || || || 20120115 / 622752 || 5.805826 || 4.622056 || 1/1 || t || || || 20120121 / 646801 || 6.346761 || 5.359003 || 1/1 || t || || || 20120126 676389 || 4.443175 || 3.475093 || 1/1 || i || || || || || || || || || Example cutouts - || '''event (auto direction)''' || '''TARGET2 (convolved ref)''' / '''TARGET1 (convolved stk)''' || '''photpipe automatic (direction)''' || comment || || X (TARGET2) || [[Image(test.png,300px)]] || [[Image(test.png,300px)]] (TEMPLATE) || conv refstk better, || Photometry/detection comparisons: Simulated sample: equivalent to W-W diffims -- || '''sim_id_1 - sim_id_2 ''' || '''FWHM_MAJ _1/_2 (pixel)''' || '''IQ_FW1 _1/_2 (pixel)''' || '''ppSub (auto choice ops/orig. test/revised test)''' || comment || || || || || || || || .0 - .0 || 3.82/3.82 || 2.98/2.98 || 1/1 || || || .0 - .1 || 3.82/4.19 || 2.98/3.28 || 1/2 || || || .0 - .2 || 3.82/4.58 || 2.98/3.62 || 1/2 || || || .0 - .3 || 3.82/5.69 || 2.98/4.49 || 1/2 || || || .1 - .0 || 4.19/3.82 || 3.28/2.98 || 2/1 || || || .1 - .1 || 4.19/ || 3.28/ || 1/1 || || || .1 - .2 || 4.19/4.58 || 3.28/3.62 || 1/2 || || || .1 - .3 || 4.19/5.69 || 3.28/4.49 || 1/2 || || || .2 - .0 || 4.58/3.82 || 3.62/2.98 || 2/1 || || || .2 - .1 || 4.58/4.19 || 3.62/3.28 || 1/1 || || || .2 - .2 || 4.58/ || 3.62/ || 1/2 || || || .2 - .3 || 4.58/5.69 || 3.62/4.49 || 1/2 || || || .3 - .0 || 5.69/3.82 || 4.49/2.98 || 2/1 || || || .3 - .1 || 5.69/4.19 || 4.49/3.28 || 2/1 || || || .3 - .2 || 5.69/4.58 || 4.49/3.62 || 2/1 || || || .3 - .3 || 5.69/ || 4.49/ || 1/2 || || || || || || || || * original test from branch ppsub_test chooses the wrong direction with simulated data. = Test Sets = Need tests to verify changes will not break diffims for other surveys (MOPS etc) but do not need to worry about magic now. Not for testing if they will choose the right direction (only if using AUTO), but changes involved part of the normalization and will need to verify doesn't change flux/variance values: * MD * simulated image set WW,WS,SS, SSref -- since SSref for MD04 seem to prefer convolving the deeper refstack still, will need to generate * warp-warp diffim: MD and 3PI TTI * warp-stack diffim: MD and LAP stack == MD04 primary samples == Initially selected for if choosing the proper direction in stack-stack diffims now using MD04. Was previously done using MD10, but we want to continue to build up a test set for testing other parts of the IPP and MD04 is a favorite with extensive overlap from other surveys. Start with just 2 skycells having example events from last year for photometry comparisons as well - skycell.055 (previous tessellations 077) -- near center - * http://telescopes.rc.fas.harvard.edu/ps1/alerts2011/2010-C-020101/2010-C-020101.html - AGN@0.345 (xy?) * http://telescopes.rc.fas.harvard.edu/ps1/alerts2011/2010-D-030288/2010-D-030288.html - poor sub/var? * http://telescopes.rc.fas.harvard.edu/ps1/alerts2011/2011-A-120103/2011-A-120103.html - alert * http://telescopes.rc.fas.harvard.edu/ps1/alerts2011/2011-A-120706/2011-A-120706.html - alert and spectrum * new events * http://telescopes.rc.fas.harvard.edu/ps1/alerts2012/2012-A-350113/2012-A-350113.html - residual peak? * http://telescopes.rc.fas.harvard.edu/ps1/alerts2012/2012-A-350492/2012-A-350492.html - bright star * http://telescopes.rc.fas.harvard.edu/ps1/alerts2012/2012-A-350211/2012-A-350211.html - alert skycell.058 (previous tessellations 073) -- edge - * http://telescopes.rc.fas.harvard.edu/ps1/alerts2011/2010-A-000541/2010-A-000541.html - QSO@2.051 * http://telescopes.rc.fas.harvard.edu/ps1/alerts2011/2011-B-130093/2011-B-130093.html - A star * http://telescopes.rc.fas.harvard.edu/ps1/alerts2011/2011-C-140196/2011-C-140196.html - sdss target QSO * new events * TBA QUB cross-match page: http://star.pst.qub.ac.uk/ps1/psdb/crossmatchipptocfa/ (add when time.. difficult to search the new crossmatch page..) Difficult to use past examples of wrong convolution direction since refstacks remade, so select sample to just test current choices. The monitoring part should take care of of this in more recent cases as MD04 actively being observed for next couple months. QUB examples of wrong convolution choice: * http://star.pst.qub.ac.uk/ps1/psdb/userlist/10/ * http://star.pst.qub.ac.uk/ps1/psdb/userlist/5/?sort=-followup_flag_date * http://star.pst.qub.ac.uk/ps1/psdb/candidate/1095456431022404400/ Sample nightly stacks for both skycells with same obsdate to look at variation of PSF center and edge (0.25 "/pixel), limited to r-band for now and a sample size that can be manually rerun with some ease. '''still need to find a night with very similar IQ -- watching for a recent nightly stack ''' need to probably add background and approx depth || '''obsdate''' || '''stack_id''' || '''FWHM_MAJ (pixel)''' || '''IQ_FW1 (pixel)''' || || || || || || || || skycell.055 || || || || refstack.20111012 || 450933 || 5.206454 (+-0.6-0.8) not the 4.5 on the MD.GR0 page.. || 4.08811 (+-0.3-0.4)|| || 20100110 || 444020 || 4.878624 || 3.891729 || || 20100121 || 444079 || 5.843588 || 4.574009 || || 20110129 || 444251 || 4.424473 || 3.378561 || || 20110201 || 644876 || 5.746622 || 4.748873 || || 20110312 || 446658 || 4.958342 || 3.74775 || || 20110315 || 645114 || 4.270276 || 3.232871 || || 20110423 || 446715 || 4.603964 || 3.510957 || || 20110429 || 645474 || 7.178107 || 6.027955 || || 20120115 || 622752 || 5.805826 || 4.622056 || || 20120121 || 646801 || 6.346761 || 5.359003 || || (swap 20120126 for 20120115?) || 676389 || 4.443175 || 3.475093 || || || || || || || || skycell.058 || || || || refstack.20111012 || 450936 || 4.616929 || 3.926292 || || 20100110 || 444023 || 4.777016 || 3.687181 || || 20100121 || 444082 || 5.567342 || 4.243489 || || 20110129 || 444254 || 3.976701 || 3.100284 || || 20110201 || 644879 || 5.023516 || 4.421264 || || 20110312 || 446661 || 5.114515 || 3.701454 || || 20110315 || 645117 || 4.58284 || 3.376984 || || 20110423 || 446718 || 4.358292 || 3.138227 || || 20110429 || 645477 || 6.088856 || 5.447231 || || 20120115 || 622755 || 5.300241 || 4.337034 || || 20120121 || 646804 || 5.627441 || 5.058287 || || (swap 20120126 for 20120115?) || || || || || || || || || == Simulated Samples == Simulated image sample: || '''filename''' || '''sim FWHM''' || '''FWHM_MAJ (pixel)''' || '''IQ_FW1 (pixel)''' || || || || || || || image.0 || 1.0 || 3.82 || 2.98 || || image.1 || 1.1 || 4.19 || 3.28 || || image.2 || 1.2 || 4.58 || 3.62 || || image.3 || 1.5 || 5.69 || 4.49 || || || || || || == 3PI sample == Will SAS provide enough variation? = Monitoring = == Nightly Tests of Diffims == Is there any conflict with the expected desired direction? Compare to CfA photpipe, detection counts. * having IQ/FWHM keywords in stack images or at least the gpc1 DB would be helpful here since are calculated for the PSF matching in the diffim process, doing manually here takes a good amount of time. Is the convolution not optimal? == HOTPANT Diffim Comparisons == Difficult to automate and may want to force both directions for comparison as well as shallower reference stacks to use. Are the diffims continuing to produce similar results. * for select night samples should setup and run locally. still on the todo list. == diffim stats and flags == There are columns of diffim stats and flags to help characterize the diffim and detections * detection catalog uses CMF_PS1_DV2 -- DIFF_* entries http://svn.pan-starrs.ifa.hawaii.edu/trac/ipp/wiki/CMF_PS1_DV2 * descriptions need more detail added * FLAGS2 http://svn.pan-starrs.ifa.hawaii.edu/trac/ipp/browser/trunk/psModules/src/objects/pmSourceMasks.h * PM_SOURCE_MODE2_MATCHED for psphotStack * descriptions need more detail added DIFF_ equivalent setting from photpipe: * DC_FRATIO_MIN 0.75 * DC_NRATIO_BAD_MIN 0.7 * DC_NRATIO_MASK_MIN 0.6 * DC_NRATIO_ALL_MIN 0.5 * DC_NGOOD_MIN 3 DIFF_ initial settings from Maria Teresa's tests: * DIFF_NPOS >5 nPos (n pix > 3 sigma) * DIFF_FRATIO >0.7 fPos / (fPos + fNeg) * DIFF_NRATIO_BAD >0.7 nPos / (nPos + nNeg) * DIFF_NRATIO_MASK >0.7 nPos / (nPos + nMask) * DIFF_NRATIO_ALL >0.5 nPos / (nGood + nMask + nBad) Grid of expectations for DIFF_ values/cases: Ken notes has been currently using {{{ diff_npos > 3 diff_fratio > 0.6 diff_nratio_bad > 0.4 diff_nratio_mask > 0.4 diff_nratio_all > 0.3 }}} ---- = Extra IPP/Photpipe Comparison Set 20120417 = Not sure which section this will be worked into (probably monitoring as photpipe/HP comparisons when finished working through and writing up the primary test/monitor set). None in particular specified, so picked a few possible ones from the QUB single convolution issue page at http://star.pst.qub.ac.uk/ps1/psdb/userlist/5/ * listing seem to be primarly i,z-band examples and many on outer FPA. * sInce primarily setup for the MD04 skycell.051-058 stripe, randomly picking ones from there to setup in i/z as well. event 1 -- http://star.pst.qub.ac.uk/ps1/psdb/candidate/1100317551021456600/ event 2 -- http://star.pst.qub.ac.uk/ps1/psdb/candidate/1100303971022245500/ event 3 -- http://star.pst.qub.ac.uk/ps1/psdb/candidate/1100544881021529400/ {{{ event= photpipe chopped skycell and filter/mjd = coordinates 1= md04s052_42 z/55935+i/56027+z/55997 = 10:03:17.55, 02:14:56.6 2= md04s053_41 i/55985+z56010+z/55997+i/55950 = 10:03:03.97, 02:22:45.5 3= md04s051_41 z/56005+i/56007+i/56001 = 10:05:44.88, +2:15:29.4 filter: MJD = date z: 55935,55997,56005,56010 = 1/9/12, 3/11, 3/19, 3/24 i: 55985,56001,56007,56027 = 2/28/12, 3/15, 3/21, 4/10 }}} Photpipe: {{{ DOPHOT FWHM: template stacks: gethead -auh templf/4?/md04s05?.i.*dcmp FWHM DPFWHM1 md04s051.i.templf.450164_41.sw.dcmp 4.321905 4.409171 md04s052.i.templf.450165_41.sw.dcmp 4.097028 4.170490 md04s053.i.templf.450166_41.sw.dcmp 4.108097 4.198685 md04s050.i.templf.450163_42.sw.dcmp 4.387660 4.548762 md04s051.i.templf.450164_42.sw.dcmp 4.315008 4.384093 md04s052.i.templf.450165_42.sw.dcmp 4.043221 4.095054 md04s053.i.templf.450166_42.sw.dcmp 3.921639 4.068218 md04s051.i.templf.450164_43.sw.dcmp 4.398300 4.551275 md04s052.i.templf.450165_43.sw.dcmp 4.077950 4.142438 md04s053.i.templf.450166_43.sw.dcmp 4.047938 4.112565 md04s050.i.templf.450163_44.sw.dcmp 4.520050 4.735612 md04s051.i.templf.450164_44.sw.dcmp 4.235297 4.336629 md04s052.i.templf.450165_44.sw.dcmp 4.012170 4.060529 md04s053.i.templf.450166_44.sw.dcmp 4.031805 4.089207 gethead -auh templf/4?/md04s05?.z.*dcmp FWHM DPFWHM1 md04s051.z.templf.450206_41.sw.dcmp 4.065523 4.091033 md04s052.z.templf.450207_41.sw.dcmp 4.032902 4.153893 md04s053.z.templf.450208_41.sw.dcmp 4.044911 4.243518 md04s050.z.templf.450205_42.sw.dcmp 3.891697 3.914562 md04s051.z.templf.450206_42.sw.dcmp 4.117935 4.208221 md04s052.z.templf.450207_42.sw.dcmp 4.030878 4.170149 md04s053.z.templf.450208_42.sw.dcmp 3.937878 4.088828 md04s051.z.templf.450206_43.sw.dcmp 4.076400 4.108247 md04s052.z.templf.450207_43.sw.dcmp 4.070577 4.211355 md04s053.z.templf.450208_43.sw.dcmp 4.044751 4.233154 md04s050.z.templf.450205_44.sw.dcmp 3.904974 3.954958 md04s051.z.templf.450206_44.sw.dcmp 4.067736 4.145131 md04s052.z.templf.450207_44.sw.dcmp 4.050899 4.193798 md04s053.z.templf.450208_44.sw.dcmp 3.996057 4.136053 nightly stacks: gethead -auh ut120109f/4?/md04s05?.*dcmp FWHM DPFWHM1 md04s051.z.ut120109f.597100_41.sw.dcmp 3.910486 3.958817 md04s052.z.ut120109f.597101_41.sw.dcmp 4.785979 4.942646 md04s053.z.ut120109f.597102_41.sw.dcmp 4.605583 4.728257 md04s051.z.ut120109f.597100_42.sw.dcmp 3.828005 3.945981 md04s052.z.ut120109f.597101_42.sw.dcmp 3.741147 3.760939 md04s052.z.ut120109f.597101_43.sw.dcmp 4.094854 4.116098 md04s053.z.ut120109f.597102_43.sw.dcmp 3.758487 3.877855 md04s051.z.ut120109f.597100_44.sw.dcmp 4.990966 5.302013 md04s052.z.ut120109f.597101_44.sw.dcmp 3.852385 3.990288 md04s053.z.ut120109f.597102_44.sw.dcmp 4.809997 5.033048 gethead -auh ut120228f/4?/md04s05?.*dcmp FWHM DPFWHM1 md04s051.i.ut120228f.783781_41.sw.dcmp 4.062733 4.411043 md04s052.i.ut120228f.783782_41.sw.dcmp 3.784938 3.895499 md04s053.i.ut120228f.783783_41.sw.dcmp 3.777932 3.902250 md04s051.i.ut120228f.783781_42.sw.dcmp 3.795055 3.956238 md04s052.i.ut120228f.783782_42.sw.dcmp 3.682643 3.835131 md04s053.i.ut120228f.783783_42.sw.dcmp 3.832803 3.939556 md04s051.i.ut120228f.783781_43.sw.dcmp 3.950601 4.218263 md04s052.i.ut120228f.783782_43.sw.dcmp 3.779057 3.876787 md04s053.i.ut120228f.783783_43.sw.dcmp 3.750915 3.869000 md04s051.i.ut120228f.783781_44.sw.dcmp 3.794149 3.946007 md04s052.i.ut120228f.783782_44.sw.dcmp 3.667984 3.805066 md04s053.i.ut120228f.783783_44.sw.dcmp 3.896519 3.987511 gethead -auh ut120311f/4?/md04s05?.*dcmp FWHM DPFWHM1 md04s051.z.ut120311f.826472_41.sw.dcmp 4.485604 4.585094 md04s052.z.ut120311f.826473_41.sw.dcmp 4.222085 4.466032 md04s053.z.ut120311f.826474_41.sw.dcmp 4.080266 4.266544 md04s051.z.ut120311f.826472_42.sw.dcmp 4.462721 4.682871 md04s052.z.ut120311f.826473_42.sw.dcmp 4.181149 4.392014 md04s053.z.ut120311f.826474_42.sw.dcmp 3.912066 4.100021 md04s051.z.ut120311f.826472_43.sw.dcmp 4.503288 4.571452 md04s052.z.ut120311f.826473_43.sw.dcmp 4.098567 4.366942 md04s053.z.ut120311f.826474_43.sw.dcmp 4.019595 4.186208 md04s051.z.ut120311f.826472_44.sw.dcmp 4.287295 4.481936 md04s052.z.ut120311f.826473_44.sw.dcmp 4.080934 4.335871 md04s053.z.ut120311f.826474_44.sw.dcmp 4.018463 4.153892 gethead -auh ut120315f/4?/md04s05?.*dcmp FWHM DPFWHM1 md04s051.i.ut120315f.835157_41.sw.dcmp 5.225922 5.441126 md04s052.i.ut120315f.835158_41.sw.dcmp 5.093193 5.279879 md04s053.i.ut120315f.835159_41.sw.dcmp 5.241187 5.447266 md04s051.i.ut120315f.835157_42.sw.dcmp 5.164400 5.423758 md04s052.i.ut120315f.835158_42.sw.dcmp 5.153998 5.374012 md04s053.i.ut120315f.835159_42.sw.dcmp 5.080042 5.189585 md04s051.i.ut120315f.835157_43.sw.dcmp 5.319784 5.516204 md04s052.i.ut120315f.835158_43.sw.dcmp 5.116147 5.268099 md04s053.i.ut120315f.835159_43.sw.dcmp 5.220162 5.380995 md04s051.i.ut120315f.835157_44.sw.dcmp 5.035054 5.273283 md04s052.i.ut120315f.835158_44.sw.dcmp 5.134746 5.318884 md04s053.i.ut120315f.835159_44.sw.dcmp 5.177593 5.322531 gethead -auh ut120319f/4?/md04s05?.*dcmp FWHM DPFWHM1 md04s051.z.ut120319f.837639_41.sw.dcmp 3.860835 3.957535 md04s052.z.ut120319f.837640_41.sw.dcmp 3.672039 3.702787 md04s053.z.ut120319f.837641_41.sw.dcmp 3.773565 3.899878 md04s051.z.ut120319f.837639_42.sw.dcmp 3.777736 3.844666 md04s052.z.ut120319f.837640_42.sw.dcmp 3.724654 3.819047 md04s053.z.ut120319f.837641_42.sw.dcmp 3.705920 3.764158 md04s051.z.ut120319f.837639_43.sw.dcmp 3.879583 4.042664 md04s052.z.ut120319f.837640_43.sw.dcmp 3.766225 3.852783 md04s053.z.ut120319f.837641_43.sw.dcmp 3.752853 3.879372 md04s051.z.ut120319f.837639_44.sw.dcmp 3.697401 3.802111 md04s052.z.ut120319f.837640_44.sw.dcmp 3.695296 3.819493 md04s053.z.ut120319f.837641_44.sw.dcmp 3.774935 3.903328 gethead -auh ut120321f/4?/md04s05?.*dcmp FWHM DPFWHM1 md04s051.i.ut120321f.840427_41.sw.dcmp 4.684535 4.706014 md04s052.i.ut120321f.840428_41.sw.dcmp 4.530626 4.588261 md04s053.i.ut120321f.840429_41.sw.dcmp 4.685523 4.811733 md04s051.i.ut120321f.840427_42.sw.dcmp 4.613884 4.733840 md04s052.i.ut120321f.840428_42.sw.dcmp 4.511564 4.656615 md04s053.i.ut120321f.840429_42.sw.dcmp 4.522036 4.681495 md04s051.i.ut120321f.840427_43.sw.dcmp 4.814125 4.911501 md04s052.i.ut120321f.840428_43.sw.dcmp 4.574361 4.693586 md04s053.i.ut120321f.840429_43.sw.dcmp 4.627339 4.736137 md04s051.i.ut120321f.840427_44.sw.dcmp 4.575857 4.705813 md04s052.i.ut120321f.840428_44.sw.dcmp 4.472039 4.644287 md04s053.i.ut120321f.840429_44.sw.dcmp 4.725504 4.849675 gethead -auh ut120324f/4?/md04s05?.*dcmp FWHM DPFWHM1 md04s051.z.ut120324f.841589_41.sw.dcmp 5.004570 5.059174 md04s052.z.ut120324f.841590_41.sw.dcmp 4.761919 4.901902 md04s053.z.ut120324f.841591_41.sw.dcmp 4.824104 5.101102 md04s051.z.ut120324f.841589_42.sw.dcmp 4.785691 4.931409 md04s052.z.ut120324f.841590_42.sw.dcmp 4.811706 4.995777 md04s053.z.ut120324f.841591_42.sw.dcmp 4.696254 4.871933 md04s051.z.ut120324f.841589_43.sw.dcmp 4.921095 4.962840 md04s052.z.ut120324f.841590_43.sw.dcmp 4.805610 5.024990 md04s053.z.ut120324f.841591_43.sw.dcmp 4.824822 5.108505 md04s051.z.ut120324f.841589_44.sw.dcmp 4.709386 4.894106 md04s052.z.ut120324f.841590_44.sw.dcmp 4.796778 5.049093 md04s053.z.ut120324f.841591_44.sw.dcmp 4.742401 5.003395 gethead -auh ut120410f/4?/md04s05?.*dcmp FWHM DPFWHM1 md04s051.i.ut120410f.855720_41.sw.dcmp 3.970818 4.153314 md04s052.i.ut120410f.855721_41.sw.dcmp 4.009083 4.227981 md04s053.i.ut120410f.855722_41.sw.dcmp 3.991465 4.202103 md04s051.i.ut120410f.855720_42.sw.dcmp 3.810293 4.101245 md04s052.i.ut120410f.855721_42.sw.dcmp 3.905974 4.090654 md04s053.i.ut120410f.855722_42.sw.dcmp 3.882282 3.901059 md04s051.i.ut120410f.855720_43.sw.dcmp 3.800445 4.012670 md04s052.i.ut120410f.855721_43.sw.dcmp 3.930362 4.131590 md04s053.i.ut120410f.855722_43.sw.dcmp 3.918175 3.931091 md04s051.i.ut120410f.855720_44.sw.dcmp 3.965380 4.358949 md04s052.i.ut120410f.855721_44.sw.dcmp 3.910313 4.041145 md04s053.i.ut120410f.855722_44.sw.dcmp 3.951957 4.028536 HOTPANTS convolution direction choice: gethead -auhc ut120*g_*/*/*05*diff.dcmp CONVOL00 md04s051.z.ut120109f.597100_41_z.templf.450206_41.diff.dcmp IMAGE___ md04s052.z.ut120109f.597101_41_z.templf.450207_41.diff.dcmp IMAGE___ md04s053.z.ut120109f.597102_41_z.templf.450208_41.diff.dcmp IMAGE___ md04s051.z.ut120109f.597100_42_z.templf.450206_42.diff.dcmp IMAGE___ md04s052.z.ut120109f.597101_42_z.templf.450207_42.diff.dcmp IMAGE___ md04s053.z.ut120109f.597102_42_z.templf.450208_42.diff.dcmp IMAGE___ md04s051.z.ut120109f.597100_43_z.templf.450206_43.diff.dcmp IMAGE___ md04s052.z.ut120109f.597101_43_z.templf.450207_43.diff.dcmp IMAGE___ md04s053.z.ut120109f.597102_43_z.templf.450208_43.diff.dcmp IMAGE___ md04s051.z.ut120109f.597100_44_z.templf.450206_44.diff.dcmp IMAGE___ md04s052.z.ut120109f.597101_44_z.templf.450207_44.diff.dcmp IMAGE___ md04s053.z.ut120109f.597102_44_z.templf.450208_44.diff.dcmp IMAGE___ md04s051.i.ut120228f.783781_41_i.templf.450164_41.diff.dcmp IMAGE___ md04s052.i.ut120228f.783782_41_i.templf.450165_41.diff.dcmp IMAGE___ md04s053.i.ut120228f.783783_41_i.templf.450166_41.diff.dcmp IMAGE___ md04s051.i.ut120228f.783781_42_i.templf.450164_42.diff.dcmp IMAGE___ md04s052.i.ut120228f.783782_42_i.templf.450165_42.diff.dcmp IMAGE___ md04s053.i.ut120228f.783783_42_i.templf.450166_42.diff.dcmp IMAGE___ md04s051.i.ut120228f.783781_43_i.templf.450164_43.diff.dcmp IMAGE___ md04s052.i.ut120228f.783782_43_i.templf.450165_43.diff.dcmp IMAGE___ md04s053.i.ut120228f.783783_43_i.templf.450166_43.diff.dcmp IMAGE___ md04s051.i.ut120228f.783781_44_i.templf.450164_44.diff.dcmp IMAGE___ md04s052.i.ut120228f.783782_44_i.templf.450165_44.diff.dcmp IMAGE___ md04s053.i.ut120228f.783783_44_i.templf.450166_44.diff.dcmp IMAGE___ md04s051.z.ut120311f.826472_41_z.templf.450206_41.diff.dcmp TEMPLATE md04s052.z.ut120311f.826473_41_z.templf.450207_41.diff.dcmp TEMPLATE md04s053.z.ut120311f.826474_41_z.templf.450208_41.diff.dcmp TEMPLATE md04s051.z.ut120311f.826472_42_z.templf.450206_42.diff.dcmp TEMPLATE md04s052.z.ut120311f.826473_42_z.templf.450207_42.diff.dcmp TEMPLATE md04s053.z.ut120311f.826474_42_z.templf.450208_42.diff.dcmp IMAGE___ md04s051.z.ut120311f.826472_43_z.templf.450206_43.diff.dcmp TEMPLATE md04s052.z.ut120311f.826473_43_z.templf.450207_43.diff.dcmp IMAGE___ md04s053.z.ut120311f.826474_43_z.templf.450208_43.diff.dcmp IMAGE___ md04s051.z.ut120311f.826472_44_z.templf.450206_44.diff.dcmp IMAGE___ md04s052.z.ut120311f.826473_44_z.templf.450207_44.diff.dcmp TEMPLATE md04s053.z.ut120311f.826474_44_z.templf.450208_44.diff.dcmp TEMPLATE md04s051.i.ut120315f.835157_41_i.templf.450164_41.diff.dcmp TEMPLATE md04s052.i.ut120315f.835158_41_i.templf.450165_41.diff.dcmp TEMPLATE md04s053.i.ut120315f.835159_41_i.templf.450166_41.diff.dcmp TEMPLATE md04s051.i.ut120315f.835157_42_i.templf.450164_42.diff.dcmp TEMPLATE md04s052.i.ut120315f.835158_42_i.templf.450165_42.diff.dcmp TEMPLATE md04s053.i.ut120315f.835159_42_i.templf.450166_42.diff.dcmp TEMPLATE md04s051.i.ut120315f.835157_43_i.templf.450164_43.diff.dcmp TEMPLATE md04s052.i.ut120315f.835158_43_i.templf.450165_43.diff.dcmp TEMPLATE md04s053.i.ut120315f.835159_43_i.templf.450166_43.diff.dcmp TEMPLATE md04s051.i.ut120315f.835157_44_i.templf.450164_44.diff.dcmp TEMPLATE md04s052.i.ut120315f.835158_44_i.templf.450165_44.diff.dcmp TEMPLATE md04s053.i.ut120315f.835159_44_i.templf.450166_44.diff.dcmp TEMPLATE md04s051.z.ut120319f.837639_41_z.templf.450206_41.diff.dcmp IMAGE___ md04s052.z.ut120319f.837640_41_z.templf.450207_41.diff.dcmp IMAGE___ md04s053.z.ut120319f.837641_41_z.templf.450208_41.diff.dcmp IMAGE___ md04s051.z.ut120319f.837639_42_z.templf.450206_42.diff.dcmp IMAGE___ md04s052.z.ut120319f.837640_42_z.templf.450207_42.diff.dcmp IMAGE___ md04s053.z.ut120319f.837641_42_z.templf.450208_42.diff.dcmp IMAGE___ md04s051.z.ut120319f.837639_43_z.templf.450206_43.diff.dcmp IMAGE___ md04s052.z.ut120319f.837640_43_z.templf.450207_43.diff.dcmp IMAGE___ md04s053.z.ut120319f.837641_43_z.templf.450208_43.diff.dcmp IMAGE___ md04s051.z.ut120319f.837639_44_z.templf.450206_44.diff.dcmp IMAGE___ md04s052.z.ut120319f.837640_44_z.templf.450207_44.diff.dcmp IMAGE___ md04s053.z.ut120319f.837641_44_z.templf.450208_44.diff.dcmp IMAGE___ md04s051.i.ut120321f.840427_41_i.templf.450164_41.diff.dcmp TEMPLATE md04s052.i.ut120321f.840428_41_i.templf.450165_41.diff.dcmp TEMPLATE md04s053.i.ut120321f.840429_41_i.templf.450166_41.diff.dcmp TEMPLATE md04s051.i.ut120321f.840427_42_i.templf.450164_42.diff.dcmp TEMPLATE md04s052.i.ut120321f.840428_42_i.templf.450165_42.diff.dcmp TEMPLATE md04s053.i.ut120321f.840429_42_i.templf.450166_42.diff.dcmp TEMPLATE md04s051.i.ut120321f.840427_43_i.templf.450164_43.diff.dcmp TEMPLATE md04s052.i.ut120321f.840428_43_i.templf.450165_43.diff.dcmp TEMPLATE md04s053.i.ut120321f.840429_43_i.templf.450166_43.diff.dcmp TEMPLATE md04s051.i.ut120321f.840427_44_i.templf.450164_44.diff.dcmp TEMPLATE md04s052.i.ut120321f.840428_44_i.templf.450165_44.diff.dcmp TEMPLATE md04s053.i.ut120321f.840429_44_i.templf.450166_44.diff.dcmp TEMPLATE md04s051.z.ut120324f.841589_41_z.templf.450206_41.diff.dcmp TEMPLATE md04s052.z.ut120324f.841590_41_z.templf.450207_41.diff.dcmp TEMPLATE md04s053.z.ut120324f.841591_41_z.templf.450208_41.diff.dcmp TEMPLATE md04s051.z.ut120324f.841589_42_z.templf.450206_42.diff.dcmp TEMPLATE md04s052.z.ut120324f.841590_42_z.templf.450207_42.diff.dcmp TEMPLATE md04s053.z.ut120324f.841591_42_z.templf.450208_42.diff.dcmp TEMPLATE md04s051.z.ut120324f.841589_43_z.templf.450206_43.diff.dcmp TEMPLATE md04s052.z.ut120324f.841590_43_z.templf.450207_43.diff.dcmp TEMPLATE md04s053.z.ut120324f.841591_43_z.templf.450208_43.diff.dcmp TEMPLATE md04s051.z.ut120324f.841589_44_z.templf.450206_44.diff.dcmp TEMPLATE md04s052.z.ut120324f.841590_44_z.templf.450207_44.diff.dcmp TEMPLATE md04s053.z.ut120324f.841591_44_z.templf.450208_44.diff.dcmp TEMPLATE md04s051.i.ut120410f.855720_41_i.templf.450164_41.diff.dcmp IMAGE___ md04s052.i.ut120410f.855721_41_i.templf.450165_41.diff.dcmp IMAGE___ md04s053.i.ut120410f.855722_41_i.templf.450166_41.diff.dcmp IMAGE___ md04s051.i.ut120410f.855720_42_i.templf.450164_42.diff.dcmp IMAGE___ md04s052.i.ut120410f.855721_42_i.templf.450165_42.diff.dcmp IMAGE___ md04s053.i.ut120410f.855722_42_i.templf.450166_42.diff.dcmp IMAGE___ md04s051.i.ut120410f.855720_43_i.templf.450164_43.diff.dcmp IMAGE___ md04s052.i.ut120410f.855721_43_i.templf.450165_43.diff.dcmp IMAGE___ md04s053.i.ut120410f.855722_43_i.templf.450166_43.diff.dcmp IMAGE___ md04s051.i.ut120410f.855720_44_i.templf.450164_44.diff.dcmp IMAGE___ md04s052.i.ut120410f.855721_44_i.templf.450165_44.diff.dcmp IMAGE___ md04s053.i.ut120410f.855722_44_i.templf.450166_44.diff.dcmp IMAGE___ images rsync'd from /scratch/SMSN/data/v10.0/GPC1v3/ with normal photpipe data structure (when finished) to * workspace_tmpl -- convolved template (default) * workspace_auto -- photpipe/HP choice direction /data/ipp059.0/mhuber/testppsub120417_md04/photpipe/ }}} IPP: using ipp-20120404 ops tag {{{ psphot FWHM: reference stacks: gethead -auhc *fpa.cmf FWHM_MAJ IQ_FW1 FPA.FILTER MD04.V3.skycell.051.stk.450164.unconv.fpa.cmf 4.970654 3.997815 i.00000 MD04.V3.skycell.051.stk.450206.unconv.fpa.cmf 4.189464 3.723285 z.00000 MD04.V3.skycell.052.stk.450165.unconv.fpa.cmf 4.398435 3.678164 i.00000 MD04.V3.skycell.052.stk.450207.unconv.fpa.cmf 4.33788 3.700287 z.00000 MD04.V3.skycell.053.stk.450166.unconv.fpa.cmf 4.357341 3.634033 i.00000 MD04.V3.skycell.053.stk.450208.unconv.fpa.cmf 4.305784 3.612702 z.00000 nightly stacks: gethead -auhc 2012*/*fpa.cmf FWHM_MAJ IQ_FW1 FPA.FILTER MD04.V3.skycell.051.stk.597100.unconv.20120109.fpa.cmf 3.805214 2.996295 z.00000 MD04.V3.skycell.052.stk.597101.unconv.20120109.fpa.cmf 3.458675 2.876253 z.00000 MD04.V3.skycell.053.stk.597102.unconv.20120109.fpa.cmf 3.401241 2.796868 z.00000 MD04.V3.skycell.051.stk.783781.unconv.20120228.fpa.cmf 4.345765 3.451233 i.00000 MD04.V3.skycell.052.stk.783782.unconv.20120228.fpa.cmf 4.074079 3.338143 i.00000 MD04.V3.skycell.053.stk.783783.unconv.20120228.fpa.cmf 4.222304 3.371685 i.00000 MD04.V3.skycell.051.stk.826472.unconv.20120311.fpa.cmf 4.61985 3.998761 z.00000 MD04.V3.skycell.052.stk.826473.unconv.20120311.fpa.cmf 4.459845 3.830599 z.00000 MD04.V3.skycell.053.stk.826474.unconv.20120311.fpa.cmf 4.123871 3.672285 z.00000 MD04.V3.skycell.051.stk.835157.unconv.20120315.fpa.cmf 5.408048 4.931641 i.00000 MD04.V3.skycell.052.stk.835158.unconv.20120315.fpa.cmf 5.071351 4.893692 i.00000 MD04.V3.skycell.053.stk.835159.unconv.20120315.fpa.cmf 5.189733 4.955226 i.00000 MD04.V3.skycell.051.stk.837639.unconv.20120319.fpa.cmf 3.841477 3.354799 z.00000 MD04.V3.skycell.052.stk.837640.unconv.20120319.fpa.cmf 3.738017 3.326009 z.00000 MD04.V3.skycell.053.stk.837641.unconv.20120319.fpa.cmf 3.809136 3.348667 z.00000 MD04.V3.skycell.051.stk.840427.unconv.20120321.fpa.cmf 4.978145 4.294078 i.00000 MD04.V3.skycell.052.stk.840428.unconv.20120321.fpa.cmf 4.719079 4.181434 i.00000 MD04.V3.skycell.053.stk.840429.unconv.20120321.fpa.cmf 4.891323 4.290066 i.00000 MD04.V3.skycell.051.stk.841589.unconv.20120324.fpa.cmf 4.967541 4.447652 z.00000 MD04.V3.skycell.052.stk.841590.unconv.20120324.fpa.cmf 4.968191 4.440432 z.00000 MD04.V3.skycell.053.stk.841591.unconv.20120324.fpa.cmf 4.972937 4.416224 z.00000 MD04.V3.skycell.051.stk.855720.unconv.20120410.fpa.cmf 3.98965 3.26209 i.00000 MD04.V3.skycell.052.stk.855721.unconv.20120410.fpa.cmf 3.700689 3.119125 i.00000 MD04.V3.skycell.053.stk.855722.unconv.20120410.fpa.cmf 3.550875 3.036315 i.00000 images under by the night date YYYYMMDD with the convolution choice in the filename: * SS_2 -- forced reference convolution (default) * SS_1 -- forced input convolution /data/ipp059.0/mhuber/testppsub120417_md04/ops_base/YYYYMMDD }}} == Data Location Summary == Summary of where to find the FITS and catalogs for the original and comparison runs. To illustrate where/what particular data is, will use the example of misc. event 3 * photpipe field ID=md04s051_41 * filter=z * mjd=56005 * utdate=120319 * coords=10:05:44.88, +2:15:29.4 Photpipe@CfA -- default running convolving TEMPLATE only (normal alert page access/password, can take VERY long time to get directory listing..) http://telescopes.rc.fas.harvard.edu/ps1/workspace_v3/ {{{ ut120319f_templf/41/md04s051.z.ut120319f.837639_41_z.templf.450206_41.diff.fits -- diffim ut120319f_templf/41/md04s051.z.ut120319f.837639_41_z.templf.450206_41.diff.dcmp -- all detections ut120319f_templf/41/md04s051.z.ut120319f.837639_41_z.templf.450206_41.diff.cut.dcmp -- cut detections with s/n>=3, dipole-stats }}} Photpipe@IfA -- test samples re-running convolving TEMPLATE, IMAGE and AUTO -- (normal ps1sc access/password) http://orac.ifa.hawaii.edu/photpipe/GPC1v3/ * _tmpl are for TEMPLATE run (workspace, logs directory) * _img are for IMAGE run (may not be complete) * _auto are for AUTO run {{{ workspace_tmpl/ut120319f_templf/41/md04s051.z.ut120319f.837639_41_z.templf.450206_41.diff.fits -- diffim with convolved TEMPLATE workspace_tmpl/ut120319f_templf/41/md04s051.z.ut120319f.837639_41_z.templf.450206_41.diff.dcmp workspace_tmpl/ut120319f_templf/41/md04s051.z.ut120319f.837639_41_z.templf.450206_41.diff.cut.dcmp workspace_auto/ut120319f_templf/41/md04s051.z.ut120319f.837639_41_z.templf.450206_41.diff.fits -- diffim with auto choice of convolved stack workspace_auto/ut120319f_templf/41/md04s051.z.ut120319f.837639_41_z.templf.450206_41.diff.dcmp workspace_auto/ut120319f_templf/41/md04s051.z.ut120319f.837639_41_z.templf.450206_41.diff.cut.dcmp }}} {{{ workspace_tmpl/ut120319f/41/md04s051.z.ut120319f.837639_41.sw.fits -- input nightly stack workspace_tmpl/ut120319f/41/md04s051.z.ut120319f.837639_41.sw.dcmp -- input nightly stack detections workspace_tmpl/templf/41/md04s051.z.templf.450206_41.sw.fits -- refstack workspace_tmpl/templf/41/md04s051.z.templf.450206_41.sw.dcmp -- refstack detections }}} IPP@PS1 -- default running copy (need to add?) IPP@IfA -- test samples re-running convolving refstack (SS_2), input image stack (SS_1) -- (normal ps1sc access/password) http://orac.ifa.hawaii.edu/ipp_tests/testppsub120417_md04/ * ops_base means re-run with current ops tag ipp-20120404 {{{ ops_base/20120319/MD04.V3.skycell.051.stk.837639.unconv.SS_2.20120319.fits ops_base/20120319/MD04.V3.skycell.051.stk.837639.unconv.SS_2.20120319.cmf ops_base/20120319/MD04.V3.skycell.051.stk.837639.unconv.SS_1.20120319.fits ops_base/20120319/MD04.V3.skycell.051.stk.837639.unconv.SS_1.20120319.cmf }}} Past dump to the IfA rsync server -- may disappear at some point to reclaim diskspace -- rsync://ps1sc@ipp0222.ifa.hawaii.edu/mhuber-demo-data/ipp_photpipe20120417/ For example, the 20120319 set would be {{{ -- IPP diffims (convolved reference SS_2, convolved input SS_1) : ops_base/20120319/MD04.V3.skycell.051.stk.837639.unconv.SS_2.20120319.fits ops_base/20120319/MD04.V3.skycell.051.stk.837639.unconv.SS_1.20120319.fits (ops means the current ops tag used, ipp-20120404) -- photpipe diffims (convolved template, auto choice): photpipe/workspace_tmpl/ut120319f_templf/41/md04s051.z.ut120319f.837639_41_z.templf.450206_41.diff.fits photpipe/workspace_auto/ut120319f_templf/41/md04s051.z.ut120319f.837639_41_z.templf.450206_41.diff.fits -- setup photpipe input stack, template stack photpipe/workspace_tmpl/ut120319f/41/md04s051.z.ut120319f.837639_41.sw.fits photpipe/workspace_tmpl/templf/41/md04s051.z.templf.450206_41.sw.fits }}} ---- == Comparison Panels == Quick+dirty example image cutouts - panels left to right include IPP convolved refstack (default), IPP convolved input stack test, photpipe convolved TEMPLATE, photpipe convolved IMAGE or TEMPLATE by best choice (i.e., auto), maybe a photpipe IMAGE input stack and maybe a photpipe TEMPLATE stack. || '''event #:date''' || '''IPP SS_2 (def)''' | '''IPP SS_1''' | '''photpipe/HP TEMPLATE (def)''' | '''photpipe/HP auto''' | '''photpipe IMAGE stack''' | '''photpipe TEMPLATE stack''' || '''notes''' || || || || || || 1:20120109 || [[Image(1_md04s052.z.20120109_ipp_photpipe_diffim_panelstack.jpg,1200px)]] || HP would pick IMAGE || || 2:20120228 || [[Image(2_md04s053.i.20120228_ipp_photpipe_diffim_panelstack.jpg,1200px)]] || HP would pick IMAGE || || 3:20120319 || [[Image(3_md04s051.z.20120319_ipp_photpipe_diffim_panelstack.jpg,1200px)]] || HP would pick IMAGE || || 3:20120321 || [[Image(3_md04s051.i.20120321_ipp_photpipe_diffim_panel.jpg,1200px)]] || HP would pick TEMPLATE || || 2:20120324 || [[Image(2_md04s053.z.20120324_ipp_photpipe_diffim_panel.jpg,1200px)]] || HP would pick TEMPLATE. odd ppSub re-run problem, clearly not same as original run.. || || 1:20120410 || [[Image(1_md04s052.i.20120410_ipp_photpipe_diffim_panel.jpg,1200px)]] || HP would pick IMAGE || || || || || * Like before, not seeing clear improvement by convolving the image with ppSub and even in the photpipe case if the convolution choice was turned on doesn't appear to be much improved either. * Not seeing a clear indication that photpipe/HP is doing much better, though photometry+detection stats on these would be useful to compare (and not that there aren't issues that need tweaking noted top of page as well). '''Any additional specific, better examples from Ken/Stephen?''' == Diffim detections == Photpipe detection level set to lower S/N>=3 (IPP set to >=5). Photpipe detections are swamped at the low level, but don't often consider the typical residual a true source. Photpipe auto-choice for IMAGE tends to produce more low-level detections and not always better as expected. || [[Image(1_md04s052.i.20120410_ipp_photpipe_diffim_det_panel.jpg,1200px)]] || 1:20120410, i-filter, photpipe chose IMAGE || || [[Image(1_md04s052.z.20120311_ipp_photpipe_diffim_det_panel.jpg,1200px)]] || 1:20120311, z-filter, photpipe chose TEMPLATE || || [[Image(1_md04s052.z.20120109_ipp_photpipe_diffim_det_panel.jpg,1200px)]] || 1:20120109, z-filter, photpipe chose IMAGE || || || || || from left to right: IPP SS_2 default (convolved refstack), IPP SS_1 (convolved input stack), photpipe (convolved TEMPLATE), photpipe (auto) || || || blue for IPP are the good detections using flags from [wiki:QUBTCSIPPFlags], green for the photpipe is the basic cuts (including the dipole stat cuts) || || ppSub re-run of samples were not producing the same detections, particularly the ones in question. Re-running with the same SEED however does. Could make using the dipole stats difficult to tune. || [[Image(1_md04s052.i.20120410_ipp_photpipe_diffim_orig_det_panel.jpg,1200px)]] || || From left to right: IPP original, IPP rerun, photpipe original, photpipe rerun. || || blue=IPP detections with good flags, red=photpipe detections all, green=photpipe detections cut (dipole stats etc) || Uncompressing and descaling the IPP diffim into something like what can run through something like the dophot that photpipe uses results in not finding or keeping as a detection the target in question either. || [[Image(1_md04s052.i.20120410_ipp_dophot_det_panel.jpg,300px)]] ||