IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 34 and Version 35 of STS.refstack.20120510


Ignore:
Timestamp:
Jun 11, 2012, 4:55:23 PM (14 years ago)
Author:
Mark Huber
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • STS.refstack.20120510

    v34 v35  
    220220...
    221221
    222 --> sample unconvolved images
     222--> sample unconvolved images -- doesn't seem to be fully filling in regions/gaps, see input details.
    223223gpc1/STS.reftest.20120510/STS.V4/skycell.1.03/STS.V4.skycell.1.03.stk.899917.unconv.num.fits -- c1f39 (max inputs 36)
    224224gpc1/STS.reftest.20120510/STS.V4/skycell.1.03/STS.V4.skycell.1.03.stk.899918.unconv.num.fits -- c1f38 (max inputs 23)
    … …  
    299299 * faults because of recent modified psphot config/code to limit peaks and so faults.. need to add -Di PEAKS_NMAX_TOTAL 60000
    300300 * unconvolved stacks still faulting.. so do PASS1 only -D BREAK_POINT PASS1. Convolved ones are poor, FWHM_MAJ~9-10??
    301 
    302301{{{
    303302gethead -auhc *fpa.cmf FWHM_MAJ IQ_FW1
    … …  
    312311--> basically as with MD, +/- pixel, so all are basically similar and going to smaller FWHM cut not improve much, partially because cut doen't always match true FWHM going in.
    313312}}}
     313 * previous refstack.20110613
     314{{{
     315gpc1/STS.refstack.20110613/STS.V4/skycell.1.03/STS.V4.skycell.1.03.stk.310672.fits (cleaned)
     316gpc1/STS.refstack.20110613/STS.V4/skycell.1.03/STS.V4.skycell.1.03.stk.310672.cmf
     317gpc1/STS.refstack.20110613/STS.V4/skycell.1.03/STS.V4.skycell.1.03.stk.310672.log
     318}}}
     319
    314320
    315321
    … …  
    318324|| '''version data_group''' (stack_id) || '''filter''' || '''skycell input warps (rej)''' || '''skycell FWHM (major) conv/unconv''' ||
    319325|| || || || ||
    320 || new ''STS.refstack.20120510'' V4  || i || 61 (2) || 1.27/" ||
     326|| new ''STS.refstack.20120510'' V4  || i || 61 (2) || 1.38/0.98" ||
    321327|| || || || ||
    322328|| STS.reftest.20120510.c1f39 V4  (899917) || i || 36 (0) || 1.10/0.98"  ||
    … …  
    325331|| STS.reftest.20120510.c0f45 V4  (899920) || i || 44 (0) || 1.14/0.97"  ||
    326332|| || || || ||
    327 || old STS.refstack.20110613 V3  || i || 68 (0) || 1.45/" ||
     333|| old STS.refstack.20110613 V3  || i || 68 (0) || ~1.16/0.9" (approx from log since image cleaned) ||
    328334|| || || || ||
    329335
    … …  
    332338 * recent observations all 180 (as of 120510)
    333339 * center+dither available
    334  * sample:
     340 * sample from rawExp table:
    335341{{{
    336342| 484662 | o6054g0382o | 2012-05-07 13:44:36 | i.00000 |       30 | STS.180.ND PP1 center
    … …  
    347353
    348354
    349 
    350 
    351 Main run -- do by region 1-7:
     355Main run -- do by projection PP 1-7:
    352356 * use FWHM cut 3.8 for ~20-40 and see -- if some need fixing, then re-run that skycell, if too much burntool then know for next version
    353357  * should really add the PSF cut to PS1_REFERENCE too to help reject unrepresentative camera FWHM for skycell.
    … …  
    357361stacktool -definebyquery -dbname gpc1 -set_dist_group NULL -set_data_group STS.refstack.20120510 -set_label STS.refstack.20120510 -set_workdir neb://@HOST@.0/gpc1/STS.refstack.20120510 -select_data_group STS.refstack.20120510 -select_good_frac_min 0.05 -min_num 2 -select_fwhm_major_max 3.8 -select_elong_max 1.2 -set_reduction PS1_REFERENCE -simple  >& stacktool.sts_refstack.20120510.fwhm38_elong12.log
    358362--->  oops forgot to add -select_skycell_id skycell.1.% -- so it is running all projections at once.
     363}}}
     364
     365Compare to test sample skycell.1.03:
     366{{{
     367gpc1/STS.refstack.20120510/STS.V4/skycell.1.03/STS.V4.skycell.1.03.stk.902905.fits
     368gpc1/STS.refstack.20120510/STS.V4/skycell.1.03/STS.V4.skycell.1.03.stk.902905.unconv.fits
     369gpc1/STS.refstack.20120510/STS.V4/skycell.1.03/STS.V4.skycell.1.03.stk.902905.log
     370--> run psphot manually and add to table above -- need to set 65000 detections for unconv stack
    359371}}}
    360372
    … …  
    377389
    378390Run additional reftest for selected examples:
    379 {{{
    380 --> 1.35
    381 neb-ls gpc1/STS.refstack.20120510/STS.V4/skycell.1.35/%unconv%fits
    382 gpc1/STS.refstack.20120510/STS.V4/skycell.1.35/STS.V4.skycell.1.35.stk.902937.unconv.exp.fits
    383 gpc1/STS.refstack.20120510/STS.V4/skycell.1.35/STS.V4.skycell.1.35.stk.902937.unconv.expwt.fits
    384 gpc1/STS.refstack.20120510/STS.V4/skycell.1.35/STS.V4.skycell.1.35.stk.902937.unconv.fits
    385 gpc1/STS.refstack.20120510/STS.V4/skycell.1.35/STS.V4.skycell.1.35.stk.902937.unconv.mask.fits
    386 gpc1/STS.refstack.20120510/STS.V4/skycell.1.35/STS.V4.skycell.1.35.stk.902937.unconv.num.fits
    387 gpc1/STS.refstack.20120510/STS.V4/skycell.1.35/STS.V4.skycell.1.35.stk.902937.unconv.wt.fits
    388 
    389 
     391 * skycell.1.35 -- gpc1/STS.refstack.20120510/STS.V4/skycell.1.35/STS.V4.skycell.1.35.stk.902937.log
     392{{{
    390393stacktool -definebyquery -dbname gpc1 -set_dist_group NULL -set_data_group STS.reftest.20120510.c2f39 -set_label STS.reftest.20120510 -set_workdir neb://@HOST@.0/gpc1/STS.reftest.20120510 -select_data_group STS.refstack.20120510 -select_good_frac_min 0.05 -min_num 2 -select_fwhm_major_max 3.9 -select_elong_max 1.2 -set_reduction PS1_REFERENCE -simple -select_skycell_id skycell.1.35  >& stacktool.sts_reftest.20120510.fwhm39_elong12_skycell135_c2.log
    391394
    … …  
    394397stacktool -definebyquery -dbname gpc1 -set_dist_group NULL -set_data_group STS.reftest.20120510.c2f37 -set_label STS.reftest.20120510 -set_workdir neb://@HOST@.0/gpc1/STS.reftest.20120510 -select_data_group STS.refstack.20120510 -select_good_frac_min 0.05 -min_num 2 -select_fwhm_major_max 3.7 -select_elong_max 1.2 -set_reduction PS1_REFERENCE -simple -select_skycell_id skycell.1.35  >& stacktool.sts_reftest.20120510.fwhm37_elong12_skycell135_c2.log
    395398
    396 *** the additional input 45 shows lower corner with much worse seeing -- this is problem, each skycell may need to be tuned/limited directly since DB not have proper stats
    397 *** reason for using conv stacking
    398 }}}
    399 
    400 
    401 
    402 {{{
    403 --> 1.40
    404 gpc1/STS.refstack.20120510/STS.V4/skycell.1.40/STS.V4.skycell.1.40.stk.902942.unconv.exp.fits
    405 gpc1/STS.refstack.20120510/STS.V4/skycell.1.40/STS.V4.skycell.1.40.stk.902942.unconv.expwt.fits
    406 gpc1/STS.refstack.20120510/STS.V4/skycell.1.40/STS.V4.skycell.1.40.stk.902942.unconv.fits
    407 gpc1/STS.refstack.20120510/STS.V4/skycell.1.40/STS.V4.skycell.1.40.stk.902942.unconv.mask.fits
    408 gpc1/STS.refstack.20120510/STS.V4/skycell.1.40/STS.V4.skycell.1.40.stk.902942.unconv.num.fits
    409 gpc1/STS.refstack.20120510/STS.V4/skycell.1.40/STS.V4.skycell.1.40.stk.902942.unconv.wt.fits
    410 
    411 
     399---> the additional input 45 shows lower corner with much worse seeing -- this is problem, each skycell may need to be tuned/limited directly since DB not have proper stats. A reason for using conv stacking
     400}}}
     401
     402 * skycell.1.40 -- gpc1/STS.refstack.20120510/STS.V4/skycell.1.40/STS.V4.skycell.1.40.stk.902942.log
     403{{{
    412404stacktool -definebyquery -dbname gpc1 -set_dist_group NULL -set_data_group STS.reftest.20120510.c2f39 -set_label STS.reftest.20120510 -set_workdir neb://@HOST@.0/gpc1/STS.reftest.20120510 -select_data_group STS.refstack.20120510 -select_good_frac_min 0.05 -min_num 2 -select_fwhm_major_max 3.9 -select_elong_max 1.2 -set_reduction PS1_REFERENCE -simple -select_skycell_id skycell.1.40  >& stacktool.sts_reftest.20120510.fwhm39_elong12_skycell140_c2.log
    413405
    … …  
    416408stacktool -definebyquery -dbname gpc1 -set_dist_group NULL -set_data_group STS.reftest.20120510.c2f37 -set_label STS.reftest.20120510 -set_workdir neb://@HOST@.0/gpc1/STS.reftest.20120510 -select_data_group STS.refstack.20120510 -select_good_frac_min 0.05 -min_num 2 -select_fwhm_major_max 3.7 -select_elong_max 1.2 -set_reduction PS1_REFERENCE -simple -select_skycell_id skycell.1.40  >& stacktool.sts_reftest.20120510.fwhm37_elong12_skycell140_c2.log
    417409
    418 *** max input not fill in masking much
    419 }}}
    420 
    421 {{{
    422 --> 1.55 mix of pp inputs and possible IQ issues, try reducing greatly -- really need to do manually..
    423 gpc1/STS.refstack.20120510/STS.V4/skycell.1.55/STS.V4.skycell.1.55.stk.902957.log
    424 
     410---> max input not fill in masking much
     411}}}
     412
     413 * skycell.1.55 -- mix of PP inputs and possible IQ issues, try reducing Ninput greatly. really need to do manually.. -- gpc1/STS.refstack.20120510/STS.V4/skycell.1.55/STS.V4.skycell.1.55.stk.902957.log
     414{{{
    425415stacktool -definebyquery -dbname gpc1 -set_dist_group NULL -set_data_group STS.reftest.20120510.c2f36 -set_label STS.reftest.20120510 -set_workdir neb://@HOST@.0/gpc1/STS.reftest.20120510 -select_data_group STS.refstack.20120510 -select_good_frac_min 0.05 -min_num 2 -select_fwhm_major_max 3.6 -select_elong_max 1.2 -set_reduction PS1_REFERENCE -simple -select_skycell_id skycell.1.55  >& stacktool.sts_reftest.20120510.fwhm36_elong12_skycell155_c2.log
    426416
    427417stacktool -definebyquery -dbname gpc1 -set_dist_group NULL -set_data_group STS.reftest.20120510.c2f37 -set_label STS.reftest.20120510 -set_workdir neb://@HOST@.0/gpc1/STS.reftest.20120510 -select_data_group STS.refstack.20120510 -select_good_frac_min 0.05 -min_num 2 -select_fwhm_major_max 3.7 -select_elong_max 1.2 -set_reduction PS1_REFERENCE -simple -select_skycell_id skycell.1.55  >& stacktool.sts_reftest.20120510.fwhm37_elong12_skycell155_c2.log
    428418
    429 *** the fewer inputs makes the IQ worse in upper left,
    430 *** reason to use conv stacks here
    431 }}}
    432 
    433 
    434 
    435 
    436 
    437 
    438 
    439 
    440 
    441 
    442 
    443 
    444 
    445 Look at Target seeing to see if any odd inputs driving
    446 
     419---> the fewer inputs makes the IQ worse in upper left, reason to use conv stacks here
     420}}}
     421
     422
     423
     424Look at Target seeing to see if any odd inputs driving target PSF:
     425 * Target seeing for PSF
    447426{{{
    448427mysql -hippdb01 -uippuser -pippuser gpc1 -B -e 'select path_base from stackRun join stackSumSkyfile using (stack_id) where stackRun.label like "STS.refstack.20120510" and  stackRun.skycell_id like "%.1.%";' | grep -v path_base | awk '{print "/home/panstarrs/ipp/psconfig//ipp-20120404.lin64/bin/neb-ls -l -p "$1"%.log"}' | tcsh | awk '{print " cat "$9}' | tcsh | grep "Target seeing"
    449 --> couple with 8-9 -- #3,7 =
    450 gpc1/STS.refstack.20120510/STS.V4/skycell.1.02/STS.V4.skycell.1.02.stk.902904.log -- 83 Nin, largest ~5.7 so wacky shapes then, even 2.89
    451 gpc1/STS.refstack.20120510/STS.V4/skycell.1.06/STS.V4.skycell.1.06.stk.902908.log -- 78 Nun, largest ~4.5 so wacky shapes..
    452 }}}
    453 
    454 
     428      Target seeing FWHM: 3.871291
     429      Target seeing FWHM: 5.136444
     430      Target seeing FWHM: 9.224628
     431      Target seeing FWHM: 5.216270
     432      Target seeing FWHM: 4.238182
     433      Target seeing FWHM: 4.433765
     434      Target seeing FWHM: 8.005375
     435      Target seeing FWHM: 5.200400
     436...
     437--> look at couple with FWHM 8-9 -- #3,7 -- manually match to input file:
     438gpc1/STS.refstack.20120510/STS.V4/skycell.1.02/STS.V4.skycell.1.02.stk.902904.log -- 83 Ninput, largest ~5.7 so wacky shapes? even 2.89 FWHM
     439gpc1/STS.refstack.20120510/STS.V4/skycell.1.06/STS.V4.skycell.1.06.stk.902908.log -- 78 Ninput, largest ~4.5 so wacky shapes?
     440}}}
     441
     442 * create log of Input FWHM, Target seeing, and convolved PSF FWHM:
    455443{{{
    456444mysql -hippdb01 -uippuser -pippuser gpc1 -B -e 'select path_base from stackRun join stackSumSkyfile using (stack_id) where stackRun.label like "STS.refstack.20120510" and  stackRun.skycell_id like "%";' | grep -v path_base | awk '{print "/home/panstarrs/ipp/psconfig//ipp-20120404.lin64/bin/neb-ls -l -p "$1"%.log"}' | tcsh | awk '{print "echo "$9"; grep  -e \" Input \" -e \"Target seeing\" -e \"fwhm (psf)\" "$9" ;echo \" \""}' | tcsh  > STS.refstack.20120510_input_target_output_fwhm_inputlong.log