Changes between Version 52 and Version 53 of STS.refstack.20120510

Timestamp:

Jun 15, 2012, 5:24:34 PM (14 years ago)

Author:

Mark Huber

Comment:

--

STS.refstack.20120510

@@ -23 +23 @@
   * tricky to do in an automated way. giving each field a different refstack processing label is easiest and do on update? will still try to populate other regions though, so need to restrict to particular region with -skycell_id. won't need a sub-label for each 7 to prevent the rerun headache and to only run against proper field since matched by skycell in diffim.
  *
+
 = STS observation and tessellation summary =
 
@@ -794 +795 @@
 Rerun of sample diffims for projection 1 and published under IPP-MOPS-TEST-2 
 
-Need to update chip->warp of (re)selected nights for testing
- * like before avoid dates used in refstack, try sample similar/better FWHM and worse
+Need to update chip->warp of (re)selected nights for testing:
+ * like before avoid dates used in refstack
 {{{
 SELECT exp_id,exp_time,dateobs,zpt_obs,zpt_stdev,fwhm_major,format(fwhm_major/fwhm_minor,3) as elong,format(iq_fwhm_major/iq_fwhm_minor,3) as iq_elong,format(fwhm_major-iq_fwhm_major,2) as fwhm_iq_maj,format(camProcessedExp.bg,2) as bg,format(camProcessedExp.bg_stdev,2) as bg_stdev,format(fwhm_major_uq,2) as uq,format(fwhm_major_lq,2) as lq,n_stars,comment FROM rawExp join chipRun using (exp_id) join camRun using (chip_id) join camProcessedExp using (cam_id) join fakeRun using (cam_id) join warpRun using (fake_id) WHERE warpRun.data_group like "STS.refstack.20120510" and comment like "%PP1%" group by exp_id;
-
+}}}
+ * try for sample similar/better FWHM and worse
+{{{
 SELECT exp_id,exp_name,exp_time,dateobs,zpt_obs,fwhm_major,format(fwhm_major/fwhm_minor,3) as elong,format(fwhm_major-iq_fwhm_major,2) as fwhm_iq_maj,format(camProcessedExp.bg,2) as bg,format(camProcessedExp.bg_stdev,2) as bg_stdev,format(fwhm_major_uq,2) as uq,format(fwhm_major_lq,2) as lq,n_stars,comment FROM rawExp join chipRun using (exp_id) join camRun using (chip_id) join camProcessedExp using (cam_id)  WHERE  comment like "STS%PP1%" group by exp_id;
 
@@ -859 +862 @@
 
 
-Setup for publishing:
- * check but DONT run -- would get sent to 5 as well as 12..
+Setup for publishing test:
+ * to check but DONT run (would get sent to 5 as well as 12..)
 {{{
 pubtool -dbname gpc1 -definerun -label STS.mopsdiffv2.mehtest -simple -pretend
@@ -880 +883 @@
 --> only 1 from 9/19 used so use that date? 9/11 better and none used from it - or 9/30 to have sample of worse input (yes)
 --> so 4/14 after 4/12 for close in time observ and still pretty good -- would prefer one not as good.. 
-
+}}}
+
+ * now update 9/30/11 and 4/14/12 nights chips->warps
+{{{
 mysql -hippdb01 -uippuser -pxxxx gpc1 -B -e 'select distinct exp_name,dateobs,chip_id,warp_id from warpRun join fakeRun using (fake_id) join camRun using (cam_id) join chipRun using (chip_id) join rawExp using (exp_id) where comment like "STS%PP1%" and dateobs like "2011-09-30%" and warpRun.state like "cleaned" and chipRun.state like "cleaned" group by exp_name; ' | grep -v chip_id | awk '{print "chiptool -dbname gpc1 -setimfiletoupdate -set_label STS.mopsdiffv2.mehtest -chip_id "$4"; warptool -dbname gpc1  -setskyfiletoupdate -set_label STS.mopsdiffv2.mehtest -warp_id  "$5}' > ~/updatechipwarp_sts.mopsdiffv2.mehtest_110930.bat
 
 mysql -hippdb01 -uippuser -pxxxx gpc1 -B -e 'select distinct exp_name,dateobs,chip_id,warp_id from warpRun join fakeRun using (fake_id) join camRun using (cam_id) join chipRun using (chip_id) join rawExp using (exp_id) where comment like "STS%PP1%" and dateobs like "2012-04-14%" and warpRun.state like "cleaned" and chipRun.state like "cleaned" group by exp_name; ' | grep -v chip_id | awk '{print "chiptool -dbname gpc1 -setimfiletoupdate -set_label STS.mopsdiffv2.mehtest -chip_id "$4"; warptool -dbname gpc1  -setskyfiletoupdate -set_label STS.mopsdiffv2.mehtest -warp_id  "$5}' > ~/updatechipwarp_sts.mopsdiffv2.mehtest_120414.bat
-
+}}}
+
+ * pretend test run diffims 
+{{{
 difftool -dbname gpc1 -definewarpstack -good_frac 0.2 -warp_label STS.mopsdiffv2.mehtest -stack_label STS.refstack.20120510 -set_dist_group NULL -set_label STS.mopsdiffv2.mehtest -set_workdir neb://@HOST@.0/meh/STS.mopsdiffv2.mehtest -set_data_group STS.mopsdiffv2.mehtest  -set_reduction WARPSTACK -simple -pretend
 }}}
 
-
-
-
-* 9/30 only 1 is going to go through diffs for some reason.  because diffs make last year.. but were WW diffims
+  * 9/30 only one exposure is going to go through diffs for some reason
 {{{
 select * from diffRun where data_group like "STS.20110930";
 
---> try with -rerun -- yes seems to be there, runs then all -- seems rerun works to run new type of diffim but not rerun old one?
+--> diffims make last year for this night, but were WW diffims. try with -rerun 
 
 difftool -dbname gpc1 -definewarpstack -good_frac 0.2 -warp_label STS.mopsdiffv2.mehtest -stack_label STS.refstack.20120510 -set_dist_group NULL -set_label STS.mopsdiffv2.mehtest -set_workdir neb://@HOST@.0/meh/STS.mopsdiffv2.mehtest -set_data_group STS.mopsdiffv2.mehtest  -set_reduction WARPSTACK -simple -rerun -pretend
 
+--> yes, now seems to be there, runs all -- seems rerun works to run new type of diffim but not rerun old one?
+
 pubtool -dbname gpc1 -definerun -label STS.mopsdiffv2.mehtest -client_id 12 -simple -pretend
 
---> seems to have worked, out onto datastore now for MOPS to look at.  
+--> seems to have worked, removed the -pretend and out onto datastore now for MOPS to look at.  
 }}}