| Version 31 (modified by , 14 years ago) ( diff ) |
|---|
Summary STS.refstack.20120510
MOPS would like a refstack for the STS fields to do warp-stack diffims.
The previous STS.refstack.20110613,20110615 wasn't usable as it was destroyed by magic.
STS.20120510 was made using a similar number of inputs from the best exposures from 2011. Not pretty but hopefully sufficient.
Status:
- 5/8: past refstack from 6/2011 are cleaned, magic destroyed them. no magic problem anymore..
- 5/10: test samples and selected exposures processed for chip->warp
- 5/13: test samples for refstack finished, full refstack started
- 5/15: refstack finished and checked. looking at diffim samples and how to publish detections to MOPS
- 5/18: test diffim sample 1 using updated warps from past nights in 2011, early 2012
- 5/20: test diffims finished but fault in publishing, tracing out.
- 5/27: test sample 1 a mess, restart with test sample 2
- 5/29: test sample 2 diffim detections published to IPP-MOPS-TEST-2
Details to add:
- FWHM of test stacks (STS.reftest.20120510.c#f#) like done with MD refstacks
- samole unconv vs convolved stacks and issues found
- test diffims faults, details and issues with recent STS data
STS observation and tessellation summary
Sample rawExp.comment information for the type of observation
STS.180.ND PP1 center STS.000.GIQ PP1 dither 1 STS.180.NDGIQ PP5 center STS.180.NOM PP3 dither 3
- 000,090,180,270 -- rotator to keep rough PA on field over season
- GIQ -- shorter exp_time (20s versus 30s nominal) to not saturate more sources in better seeing conditions
- ND -- no dither so always with center and typically with 30s, occasional NDGIQ
- NOM -- nominal IQ?
- PP# -- 1-7, 7 pointings
- dither 1-4 -- dither shifts (by ?) and typically with GIQ
Overlay of camera SMFs for PP1-PP7 (colored) on top of the projection skycells defined at http://svn.pan-starrs.ifa.hawaii.edu/trac/ipp/wiki/PS1_Tessellations.
 | 7 projections and their skycell overlap (STS.V4, 0.25"/pixel platescale) |
Approximate pattern, E left, N up:
1 (orange) 2 (red) 3 (blue) 4 (green) 5 (violet) 6 (indigo) 7 (yellow)
To generate SMF sample for position and look at dither pattern:
mysql -hippdb03 -uippuser -pippuser gpc1 -B -e 'select chipRun.workdir,rawExp.exp_tag,rawExp.exp_name from chipRun join rawExp using (exp_id) join camRun using (chip_id) join camProcessedExp using (cam_id) where rawExp.obs_mode="STS" and rawExp.dateobs>"2011-05-23" and rawExp.dateobs<"2012-01" and camProcessedExp.fwhm_major<3.9 and camProcessedExp.zpt_obs>24.5 and camProcessedExp.bg<120.0 and rawExp.comment like "%PP1%center%" group by rawExp.exp_id;' | grep -v "workdir" | uniq -f2 | awk '{ print "/home/panstarrs/ipp/psconfig//ipp-20120404.lin64/bin/neb-ls -p " $1"/"$2"/o%smf" }' | tcsh | awk '{print "imbox "$1}' >& STSsub.1_i_imboxsmf_c.lst
mysql -hippdb03 -uippuser -pippuser gpc1 -B -e 'select chipRun.workdir,rawExp.exp_tag,rawExp.exp_name from chipRun join rawExp using (exp_id) join camRun using (chip_id) join camProcessedExp using (cam_id) where rawExp.obs_mode="STS" and rawExp.dateobs>"2011-05-23" and rawExp.dateobs<"2012-01" and camProcessedExp.fwhm_major<3.9 and camProcessedExp.zpt_obs>24.5 and camProcessedExp.bg<120.0 and rawExp.comment like "%PP1%dither 1%" group by rawExp.exp_id;' | grep -v "workdir" | uniq -f2 | awk '{ print "/home/panstarrs/ipp/psconfig//ipp-20120404.lin64/bin/neb-ls -p " $1"/"$2"/o%smf" }' | tcsh | awk '{print "imbox "$1}' >& STSsub.1_i_imboxsmf_d1.lst
...
dvo -D CATDIR STS.V4
$KAPA = kapa -noX
region 297.5 17.1 4.2
style -c black
image
style -c orange
input STSsub.1_i_imboxsmf.lst
style -c red
input STSsub.2_i_imboxsmf.lst
...
There is significant overlap of projections and skycells, may cause issue with general input into a refstack skycell with wildly different IQ.
add a sample cross-match table for example tests
| skycell A.xx | skycell B.xx |
| 1.03 | 4. |
Refstack
Reference stack using data from 2011 only, a balance of N input warps versus best seeing, excluding exposures with large background, low zeropoints, large elongation.
Chip->Warp processing
Only reprocessing a selected sample to use in the refstack only --
- label STS.refstack.20120510
- data_group STS.refstack.20120510
- dist_group NULL
- workdir: neb://@HOST@.0/gpc1/STS.refstack.20120510
Test sample:
chiptool -definebyquery -set_label STS.mehtest -set_workdir neb://@HOST@.0/meh/STS.mehtest -set_data_group STS.mehtest -set_dist_group NULL -set_tess_id STS.V4 -set_end_stage warp -dbname gpc1 -dateobs_begin 2011-05-24 -dateobs_end 2011-05-25 -filter i% -comment STS% -obs_mode STS -simple -pretend >& teststschip.log --> 5/24 has 84 exposures, yep so need more restrictive for test - do o5705g0373o chiptool -definebyquery -set_label STS.mehtest -set_workdir neb://@HOST@.0/meh/STS.mehtest -set_data_group STS.mehtest -set_dist_group NULL -set_tess_id STS.V4 -set_end_stage warp -set_reduction STS_DATASET -dbname gpc1 -exp_name o5705g0373o -simple -pretend >& teststschip_o5705g0373o.log -- test run - STS.mehtest - dont see corner unglow in camera image, dynamic range such that not see strongly? neb://@HOST@.0/meh/STS.mehtest/o5705g0373o.340508 --> see some patterns in warp background for sample -- significant? see meh/STS.mehtest/o5705g0373o.340508/o5705g0373o.340508.wrp.408756.skycell.1.04.fits
Determine cuts for exposure sample to reprocess, pick of order 50 exposure sample:
- time range
| o5666g0560o | 324290 | STS | STS | 30 | 2011-04-15 14:01:18 | i.00000 | STS PP6 test visit 2 | | o5666g0561o | 324291 | STS | STS | 30 | 2011-04-15 14:02:10 | i.00000 | STS PP7 test visit 2 | | o5667g0517o | 324909 | RINGS.V3 | STS | 30 | 2011-04-16 14:39:15 | i.00000 | STS PP8 test visit 1 | | o5667g0518o | 324910 | RINGS.V3 | STS | 30 | 2011-04-16 14:39:58 | i.00000 | STS PP9 test visit 1 | .. | o5681g0558o | 332242 | RINGS.V3 | STS | 30 | 2011-04-30 15:02:10 | i.00000 | STS PP6 test visit 2 | | o5681g0559o | 332243 | RINGS.V3 | STS | 30 | 2011-04-30 15:03:32 | i.00000 | STS PP3 test visit 2 | | c5681g0007d | 332244 | NULL | STS | 30 | 2011-04-30 15:05:39 | i.00000 | STS PP3 test visit 2 | | o5695g0143o | 335717 | NULL | STS | 30 | 2011-05-14 11:06:19 | i.00000 | STS.180.NOM PP4 center | .. | o5695g0144o | 335718 | NULL | STS | 30 | 2011-05-14 11:07:04 | i.00000 | STS.180.NOM PP1 center | | o5695g0225o | 335799 | NULL | STS | 30 | 2011-05-14 12:06:25 | i.00000 | STS.180.NOM PP6 dither 5 | | o5695g0226o | 335800 | NULL | STS | 30 | 2011-05-14 12:07:09 | i.00000 | STS.180.NOM PP3 dither 5 | | o5705g0373o | 340508 | STS.V4 | STS | 20 | 2011-05-24 12:05:27 | i.00000 | STS.270.GIQ PP4 dither 1 | -- talking with Bill, looks like when to start -- | o5705g0374o | 340510 | STS.V4 | STS | 20 | 2011-05-24 12:06:00 | i.00000 | STS.270.GIQ PP1 dither 1 |
- camera FWHM, ZPT, background cut
- dither content check
SELECT exp_id,exp_time,dateobs,zpt_obs,zpt_stdev,fwhm_major,format(fwhm_major/fwhm_minor,3) as elong,format(iq_fwhm_major/iq_fwhm_minor,3) as iq_elong,format(fwhm_major-iq_fwhm_major,2) as fwhm_iq_maj,format(camProcessedExp.bg,2) as bg,format(camProcessedExp.bg_stdev,2) as bg_stdev,format(fwhm_major_uq,2) as uq,format(fwhm_major_lq,2) as lq,n_stars,comment FROM rawExp join chipRun using (exp_id) join camRun using (chip_id) join camProcessedExp using (cam_id) WHERE obs_mode="STS" and dateobs>"2011-05-23" and dateobs<"2012-01" and fwhm_major<3.8 and zpt_obs>24.6 and camProcessedExp.bg<100.0 and comment like "%PP1%" group by exp_id; ...
- summary
PP1 fwhm_major<3.9 and zpt_obs>24.5 and camProcessedExp.bg<120.0 and camProcessedExp.bg_stdev<20.0 --> 42, ~half center half dither (16,7,5,6,8) PP2 fwhm_major<3.9 and zpt_obs>24.5 and camProcessedExp.bg<120.0 and camProcessedExp.bg_stdev<20.0 --> 47, ~half center half dither PP3 fwhm_major<3.9 and zpt_obs>24.5 and camProcessedExp.bg<120.0 and camProcessedExp.bg_stdev<20.0 --> 53, ~half center half dither PP4 fwhm_major<3.9 and zpt_obs>24.5 and camProcessedExp.bg<120.0 and camProcessedExp.bg_stdev<20.0 --> 50, ~half center half dither PP5 fwhm_major<3.9 and zpt_obs>24.5 and camProcessedExp.bg<120.0 and camProcessedExp.bg_stdev<20.0 --> 52, ~half center half dither PP6 fwhm_major<3.9 and zpt_obs>24.5 and camProcessedExp.bg<120.0 and camProcessedExp.bg_stdev<20.0 --> 49, ~half center half dither (14,8,8,10,9) PP7 fwhm_major<3.9 and zpt_obs>24.5 and camProcessedExp.bg<120.0 and camProcessedExp.bg_stdev<20.0 --> 49, ~half center half dither (18,9,5,10,7)
Run PP1 set first with selected exposures and perl script to make reftest stacks:
mysql -hippdb03 -uippuser -pippuser gpc1 -B -e 'select rawExp.exp_id from chipRun join rawExp using (exp_id) join camRun using (chip_id) join camProcessedExp using (cam_id) where rawExp.obs_mode="STS" and rawExp.dateobs>"2011-05-23" and rawExp.dateobs<"2012-01" and camProcessedExp.fwhm_major<3.9 and camProcessedExp.zpt_obs>24.5 and camProcessedExp.bg<120.0 and rawExp.comment like "%PP1%" group by rawExp.exp_id;' | grep -v "exp_id" perl sts.v4.refstackexp.20120510_pp1.chip > run_pp1.chip.bat source run_pp1.chip.bat >& run_pp1.chip.log
Once reftest check out, run remaining PP2-7 exposures:
mysql -hippdb03 -uippuser -pippuser gpc1 -B -e 'select rawExp.exp_id from chipRun join rawExp using (exp_id) join camRun using (chip_id) join camProcessedExp using (cam_id) where rawExp.obs_mode="STS" and rawExp.dateobs>"2011-05-23" and rawExp.dateobs<"2012-01" and camProcessedExp.fwhm_major<3.9 and camProcessedExp.zpt_obs>24.5 and camProcessedExp.bg<120.0 and rawExp.comment not like "%PP1%" group by rawExp.exp_id;' | grep -v "exp_id" perl sts.v4.refstackexp.20120510_pp2-7.chip > run_pp2-7.chip.bat source run_pp2-7.chip.bat >& run_pp2-7.chip.log --> set priority with lap @200 labeltool -definelabel -set_label STS.refstack.20120510 -set_priority 200 -dbname gpc1 labeltool -updatelabel -label STS.refstack.20120510 -set_priority 190 -dbname gpc1
Stack processing
- label: STS.refstack.20120510
- data_group: STS.refstack.20120510
- workdir: neb://@HOST@.0/gpc1/STS.reftest.20120510
- reduction: PS1_REFERENCE
OUTPUT.NOCOMP BOOL TRUE OUTPUT.LOGFLUX BOOL FALSE OUTPUT.REPLICATE BOOL TRUE --> compared to other reduction recipes -- cut on input PSF in STACK_DEEP may be useful but can apply in selecting exposures for stacking (not 100% effective however). STACK_THREEPI METADATA PSF.INPUT.MAX F32 12.0 OUTPUT.NOCOMP BOOL FALSE OUTPUT.LOGFLUX BOOL TRUE STACK_DEEP METADATA OUTPUT.NOCOMP BOOL TRUE OUTPUT.LOGFLUX BOOL FALSE PSF.INPUT.MAX F32 7.5 PSF.INPUT.CLIP.NSIGMA F32 5.0
Test stack (reftest) sample like made for MD skycell.055 with different number of input warps and FWHM cut using reprocessed sample (background,ZPT cut)
- label: STS.reftest.20120510
- data_group: STS.reftest.20120510.c#f<FWHM cut> where #=comparison run, <FWHM cut>=cut <fwhm_major from camProcessedExp
- c0 additional FWHM cut only
- c1 additional FWHM cut with elong<1.2
- skycell.1.03 chosen being on outer edge without large masking fraction and for comparison in possible overlap tests with other projection (PP4)
stacktool -definebyquery -dbname gpc1 -set_dist_group NULL -set_data_group STS.reftest.20120510.c1f39 -set_label STS.reftest.20120510 -set_workdir neb://@HOST@.0/gpc1/STS.reftest.20120510 -select_data_group STS.refstack.20120510 -select_good_frac_min 0.05 -min_num 2 -select_fwhm_major_max 3.9 -select_elong_max 1.2 -set_reduction PS1_REFERENCE -simple -select_skycell_id skycell.1.03 >& stacktool.sts_reftest.20120510.fwhm39_elong12_skycell103.log ... --> sample unconvolved images gpc1/STS.reftest.20120510/STS.V4/skycell.1.03/STS.V4.skycell.1.03.stk.899917.unconv.num.fits -- c1f39 (max inputs 36) gpc1/STS.reftest.20120510/STS.V4/skycell.1.03/STS.V4.skycell.1.03.stk.899918.unconv.num.fits -- c1f38 (max inputs 23) gpc1/STS.reftest.20120510/STS.V4/skycell.1.03/STS.V4.skycell.1.03.stk.899919.unconv.num.fits -- c1f37 (max inputs 12) gpc1/STS.reftest.20120510/STS.V4/skycell.1.03/STS.V4.skycell.1.03.stk.899920.unconv.num.fits -- c0f45 (max inputs 44) --> input stats for likely FWHM cut SELECT exp_id,exp_time,dateobs,zpt_obs,zpt_stdev,fwhm_major,format(fwhm_major/fwhm_minor,3) as elong,format(iq_fwhm_major/iq_fwhm_minor,3) as iq_elong,format(fwhm_major-iq_fwhm_major,2) as fwhm_iq_maj,format(camProcessedExp.bg,2) as bg,format(camProcessedExp.bg_stdev,2) as bg_stdev,format(fwhm_major_uq,2) as uq,format(fwhm_major_lq,2) as lq,n_stars,comment FROM rawExp join chipRun using (exp_id) join camRun using (chip_id) join camProcessedExp using (cam_id) join fakeRun using (cam_id) join warpRun using (fake_id) join stackInputSkyfile using (warp_id) join stackRun using (stack_id) WHERE stackRun.data_group like "STS.reftest.20120510.c1f38" group by exp_id; | exp_id | exp_time | dateobs | zpt_obs | zpt_stdev | fwhm_major | elong | iq_elong | fwhm_iq_maj | bg | bg_stdev | uq | lq | n_stars | comment | +--------+----------+---------------------+---------+-----------+------------+-------+----------+-------------+--------+----------+------+------+---------+--------------------------+ | 340540 | 20 | 2011-05-24 12:22:25 | 24.5549 | 0.0259 | 3.69691 | 1.188 | 1.083 | 0.92 | 91.27 | 14.01 | 3.98 | 3.46 | 8648132 | STS.270.GIQ PP1 dither 1 | | 340558 | 20 | 2011-05-24 12:34:54 | 24.5559 | 0.026682 | 3.7342 | 1.148 | 1.073 | 0.86 | 88.49 | 14.04 | 4.04 | 3.45 | 8393568 | STS.270.GIQ PP1 dither 4 | | 340567 | 20 | 2011-05-24 12:39:02 | 24.5563 | 0.025387 | 3.62252 | 1.130 | 1.059 | 0.84 | 88.18 | 13.78 | 3.89 | 3.29 | 8588336 | STS.270.GIQ PP1 dither 1 | | 340573 | 20 | 2011-05-24 12:43:16 | 24.5591 | 0.025946 | 3.64969 | 1.127 | 1.050 | 0.82 | 87.11 | 13.21 | 4.05 | 3.38 | 8380448 | STS.270.GIQ PP1 dither 2 | | 344556 | 20 | 2011-06-07 11:28:32 | 24.4608 | 0.029333 | 3.59708 | 1.165 | 1.079 | 0.88 | 100.50 | 13.30 | 4.04 | 3.39 | 8487768 | STS.180.GIQ PP1 dither 1 | | 344562 | 20 | 2011-06-07 11:32:30 | 24.5164 | 0.024937 | 3.59372 | 1.150 | 1.069 | 0.87 | 97.07 | 13.32 | 3.99 | 3.37 | 8638928 | STS.180.GIQ PP1 dither 2 | | 344569 | 20 | 2011-06-07 11:36:21 | 24.5313 | 0.024183 | 3.69415 | 1.168 | 1.085 | 0.93 | 94.56 | 13.63 | 4.03 | 3.47 | 8641948 | STS.180.GIQ PP1 dither 3 | | 344575 | 20 | 2011-06-07 11:40:18 | 24.5333 | 0.027669 | 3.66644 | 1.154 | 1.070 | 0.91 | 94.17 | 13.25 | 3.99 | 3.39 | 8611680 | STS.180.GIQ PP1 dither 4 | | 344583 | 20 | 2011-06-07 11:44:12 | 24.4983 | 0.040863 | 3.72526 | 1.159 | 1.088 | 0.92 | 96.11 | 13.24 | 4.14 | 3.51 | 8467340 | STS.180.GIQ PP1 dither 1 | | 344589 | 20 | 2011-06-07 11:48:13 | 24.4937 | 0.046644 | 3.72833 | 1.136 | 1.068 | 0.90 | 95.45 | 13.70 | 4.02 | 3.51 | 8327116 | STS.180.GIQ PP1 dither 2 | | 344597 | 20 | 2011-06-07 11:52:11 | 24.4935 | 0.031675 | 3.71614 | 1.141 | 1.066 | 0.87 | 92.70 | 13.54 | 4.13 | 3.51 | 8277828 | STS.180.GIQ PP1 dither 3 | | 344605 | 20 | 2011-06-07 11:56:13 | 24.5409 | 0.025897 | 3.74193 | 1.160 | 1.063 | 0.90 | 89.26 | 13.15 | 4.15 | 3.54 | 8427112 | STS.180.GIQ PP1 dither 4 | | 367982 | 30 | 2011-07-25 11:59:50 | 24.5698 | 0.02507 | 3.79495 | 1.091 | 1.052 | 0.79 | 97.48 | 17.60 | 4.03 | 3.65 | 8991280 | STS.000.ND PP1 center | | 367996 | 30 | 2011-07-25 12:09:52 | 24.5652 | 0.026531 | 3.6958 | 1.104 | 1.064 | 0.79 | 97.83 | 19.54 | 4.02 | 3.49 | 9311700 | STS.000.ND PP1 center | | 368010 | 30 | 2011-07-25 12:19:54 | 24.5644 | 0.026506 | 3.74343 | 1.089 | 1.055 | 0.77 | 102.98 | 19.22 | 3.99 | 3.60 | 9108432 | STS.000.ND PP1 center | | 368833 | 30 | 2011-07-27 07:23:06 | 24.5521 | 0.026382 | 3.75974 | 1.153 | 1.061 | 0.93 | 114.75 | 17.14 | 4.16 | 3.49 | 9435552 | STS.180.ND PP1 center | | 393751 | 20 | 2011-09-18 08:24:25 | 24.5337 | 0.029066 | 3.54239 | 1.153 | 1.071 | 0.91 | 89.00 | 12.90 | 3.89 | 3.31 | 9090136 | STS.000.GIQ PP1 dither 1 | | 393763 | 20 | 2011-09-18 08:32:30 | 24.533 | 0.02565 | 3.60961 | 1.170 | 1.071 | 0.96 | 88.74 | 12.99 | 3.88 | 3.33 | 9028068 | STS.000.GIQ PP1 dither 3 | | 393778 | 20 | 2011-09-18 08:40:35 | 24.5299 | 0.027023 | 3.55016 | 1.177 | 1.072 | 0.92 | 92.47 | 13.17 | 3.88 | 3.30 | 9102116 | STS.000.GIQ PP1 dither 1 | | 393785 | 20 | 2011-09-18 08:44:33 | 24.5337 | 0.027504 | 3.6808 | 1.135 | 1.065 | 0.92 | 96.03 | 13.46 | 4.03 | 3.48 | 8654104 | STS.000.GIQ PP1 dither 2 | | 393792 | 20 | 2011-09-18 08:48:23 | 24.5315 | 0.026466 | 3.70284 | 1.164 | 1.073 | 0.97 | 94.42 | 13.26 | 4.00 | 3.44 | 8762736 | STS.000.GIQ PP1 dither 3 | | 393799 | 20 | 2011-09-18 08:52:22 | 24.5312 | 0.028034 | 3.71144 | 1.172 | 1.078 | 0.96 | 98.12 | 13.35 | 4.02 | 3.47 | 8695292 | STS.000.GIQ PP1 dither 4 | | 393835 | 20 | 2011-09-18 09:13:19 | 24.5271 | 0.027369 | 3.75097 | 1.157 | 1.076 | 0.99 | 103.99 | 13.49 | 4.07 | 3.47 | 8624396 | STS.000.GIQ PP1 dither 1 |
psphot on samples, unconvolced and convolved (compare to ppStack log file):
- faults because of recent modified psphot config/code to limit peaks and so faults.. need to add -Di PEAKS_NMAX_TOTAL 60000
- unconvolved stacks still faulting.. so do PASS1 only -D BREAK_POINT PASS1. Convolved ones are poor, FWHM_MAJ~9-10?
gethead -auhc *fpa.cmf FWHM_MAJ IQ_FW1 STS.V4.skycell.1.03.stk.899917.fpa.cmf 4.405078 3.746344 STS.V4.skycell.1.03.stk.899917.unconv.fpa.cmf 3.921824 3.04026 STS.V4.skycell.1.03.stk.899918.fpa.cmf 4.359843 3.701267 STS.V4.skycell.1.03.stk.899918.unconv.fpa.cmf 3.788124 2.973968 STS.V4.skycell.1.03.stk.899919.fpa.cmf 4.184109 3.576873 STS.V4.skycell.1.03.stk.899919.unconv.fpa.cmf 3.835106 2.939088 STS.V4.skycell.1.03.stk.899920.fpa.cmf 4.54595 3.812682 STS.V4.skycell.1.03.stk.899920.unconv.fpa.cmf 3.862908 3.048509 --> basically as with MD, +/- pixel, so all are basically similar and going to smaller FWHM cut not improve much, partially because cut doen't always match true FWHM going in.
Summary of runs:
| version data_group (stack_id) | filter | skycell input warps (rej) | skycell FWHM (major) |
| new STS.refstack.20120510 V4 | i | 96 (2) | 1.27" |
| STS.reftest.201205.c1f49 V4 () | i | 34 (1) | 1.20" |
| STS.reftest.201205.c1f V4 () | i | () | 1.20" |
| STS.reftest.201205.c1f V4 () | i | () | 1.20" |
| STS.reftest.201205.c1f V4 () | i | () | " |
| STS.reftest.201205.c0f V4 () | i | () | " |
| old STS.refstack.2011 V3 | i | 78 (4) | 1.45" |
Look at recent camera/warps to check similar coverage
- recent observations all 180 (as of 120510)
- center+dither available
- sample:
| 484662 | o6054g0382o | 2012-05-07 13:44:36 | i.00000 | 30 | STS.180.ND PP1 center gpc1/STS.nt/2012/05/07/o6054g0382o.484662/ gpc1/STS.nt/2012/05/07/o6054g0382o.484662/o6054g0382o.484662.wrp.408115.skycell.1.03.fits --> bad tracking image, startrails.. try another gpc1/STS.nt/2012/05/07/o6054g0375o.484656/ gpc1/STS.nt/2012/05/07/o6054g0375o.484656/o6054g0375o.484656.wrp.408110.skycell.1.03.fits --> yes, similar pattern -
Main run -- do by region 1-7:
- use FWHM cut 3.8 for ~20-40 and see -- if some need fixing, then re-run that skycell, if too much burntool then know for next version
- should really add the PSF cut to PS1_REFERENCE too to help reject unrepresentative camera FWHM for skycell.
- run in normal stack, system fairly loaded w/o deepstack running? no, the c3 machines need more work
stacktool -definebyquery -dbname gpc1 -set_dist_group NULL -set_data_group STS.refstack.20120510 -set_label STS.refstack.20120510 -set_workdir neb://@HOST@.0/gpc1/STS.refstack.20120510 -select_data_group STS.refstack.20120510 -select_good_frac_min 0.05 -min_num 2 -select_fwhm_major_max 3.8 -select_elong_max 1.2 -set_reduction PS1_REFERENCE -simple >& stacktool.sts_refstack.20120510.fwhm38_elong12.log ---> oops forgot to add -select_skycell_id skycell.1.% -- so it is running all projections at once.
Look at final stacks: bottom line, more inputs would help, but maybe this is sufficient
- 4.17 odd bright cell print through
- 2.02 odd faint chunk print through
- 2.39 gap faint print through
- 5.06 missed burntool?
- 1.09,1.17 large unfilled gap
- 1.24 long unfilled gap
- 1.25,1.35 long and large unfilled gap
- 1.12 large unfilled cell
- 1.40 unfilled masking corner multi-cell
- 1.55 rounded edge + corner adds other exp
- 1.44,5.14 odd bright orphan diffspike-like unmasked
- 1.11 nice cluster
- 1.32 faint flux print through from brighter cell
Look at Target seeing to see if any odd inputs driving
mysql -hippdb01 -uippuser -pippuser gpc1 -B -e 'select path_base from stackRun join stackSumSkyfile using (stack_id) where stackRun.label like "STS.refstack.20120510" and stackRun.skycell_id like "%.1.%";' | grep -v path_base | awk '{print "/home/panstarrs/ipp/psconfig//ipp-20120404.lin64/bin/neb-ls -l -p "$1"%.log"}' | tcsh | awk '{print " cat "$9}' | tcsh | grep "Target seeing"
--> couple with 8-9 -- #3,7 =
gpc1/STS.refstack.20120510/STS.V4/skycell.1.02/STS.V4.skycell.1.02.stk.902904.log -- 83 Nin, largest ~5.7 so wacky shapes then, even 2.89
gpc1/STS.refstack.20120510/STS.V4/skycell.1.06/STS.V4.skycell.1.06.stk.902908.log -- 78 Nun, largest ~4.5 so wacky shapes..
mysql -hippdb01 -uippuser -pippuser gpc1 -B -e 'select path_base from stackRun join stackSumSkyfile using (stack_id) where stackRun.label like "STS.refstack.20120510" and stackRun.skycell_id like "%";' | grep -v path_base | awk '{print "/home/panstarrs/ipp/psconfig//ipp-20120404.lin64/bin/neb-ls -l -p "$1"%.log"}' | tcsh | awk '{print "echo "$9"; grep -e \" Input \" -e \"Target seeing\" -e \"fwhm (psf)\" "$9" ;echo \" \""}' | tcsh > STS.refstack.20120510_input_target_output_fwhm_inputlong.log
Test Diffim samples
Want to create a sample of diffims with detections for MOPS to look at. Will need to also keep in "full" state so they can get postage stamps quickly. Focus on projection 1.
Basic setup: (warp - convolved stack) -- need examples and compared to unconv stack (why not using this?)
survey.add.publish STS.mopsdiff STS.mopsdiffv2.mehtest 12 NULL survey.show.publish survey.del.publish STS.mopsdiff add.label STS.mopsdiffv2.mehtest
Diffim sample 1 (faulted)
Sample diffims for projection 1 faulted in publishing
Diffim sample 2 (published)
Rerun of sample diffims for projection 1 and published under IPP-MOPS-TEST-2
SELECT exp_id,exp_time,dateobs,zpt_obs,zpt_stdev,fwhm_major,format(fwhm_major/fwhm_minor,3) as elong,format(iq_fwhm_major/iq_fwhm_minor,3) as iq_elong,format(fwhm_major-iq_fwhm_major,2) as fwhm_iq_maj,format(camProcessedExp.bg,2) as bg,format(camProcessedExp.bg_stdev,2) as bg_stdev,format(fwhm_major_uq,2) as uq,format(fwhm_major_lq,2) as lq,n_stars,comment FROM rawExp join chipRun using (exp_id) join camRun using (chip_id) join camProcessedExp using (cam_id) join fakeRun using (cam_id) join warpRun using (fake_id) WHERE warpRun.data_group like "STS.refstack.20120510" and comment like "%PP1%" group by exp_id;
mysql -hippdb01 -uippuser -pippuser gpc1 -B -e 'select distinct exp_name,dateobs,chip_id,warp_id from warpRun join fakeRun using (fake_id) join camRun using (cam_id) join chipRun using (chip_id) join rawExp using (exp_id) where comment like "STS%PP1%" and dateobs like "2011-09-30%" and warpRun.state like "cleaned" and chipRun.state like "cleaned" group by exp_name; ' | grep -v chip_id | awk '{print "chiptool -dbname gpc1 -setimfiletoupdate -set_label STS.mopsdiffv2.mehtest -chip_id "$4"; warptool -dbname gpc1 -setskyfiletoupdate -set_label STS.mopsdiffv2.mehtest -warp_id "$5}' > ~/updatechipwarp_sts.mopsdiffv2.mehtest_110930.bat
...
difftool -dbname gpc1 -definewarpstack -good_frac 0.2 -warp_label STS.mopsdiffv2.mehtest -stack_label STS.refstack.20120510 -set_dist_group NULL -set_label STS.mopsdiffv2.mehtest -set_workdir neb://@HOST@.0/meh/STS.mopsdiffv2.mehtest -set_data_group STS.mopsdiffv2.mehtest -set_reduction WARPSTACK -simple -pretend
select * from diffRun where data_group like "STS.20110930"; difftool -dbname gpc1 -definewarpstack -good_frac 0.2 -warp_label STS.mopsdiffv2.mehtest -stack_label STS.refstack.20120510 -set_dist_group NULL -set_label STS.mopsdiffv2.mehtest -set_workdir neb://@HOST@.0/meh/STS.mopsdiffv2.mehtest -set_data_group STS.mopsdiffv2.mehtest -set_reduction WARPSTACK -simple -rerun -pretend pubtool -dbname gpc1 -definerun -label STS.mopsdiffv2.mehtest -client_id 12 -simple -pretend
| skycell | FWHM input/ref | Ndet | comment |
| 1.03 |
Attachments (1)
- STS_i_smf_fieldcolor.png (13.9 KB ) - added by 14 years ago.
Download all attachments as: .zip
Note:
See TracWiki
for help on using the wiki.
