Changes between Version 29 and Version 30 of PS1_IPP_Czarlog_20190510

Timestamp:

May 15, 2019, 2:43:02 PM (7 years ago)

Author:

tdeboer

Comment:

--

PS1_IPP_Czarlog_20190510

@@ -137 +137 @@
  *TdB: 18:00 we have finished going through the chip exposure that Roger queued up, but there are still ~6k warps that are lagging behind and are imbalanced. In principle it would be ok to run with just warps updating to remove the imbalance, but might as well feed in a small batch of chip+warps anyway, since warp run at a higher rate than chips. But unsure which data_group we were doing, since I could find no info on the czarlog from last week about which daa_groups Roger queued up. Looking at the query John provided we should be at data_group = LAP.PV3.20140730.20150% (but please correct me if I am wrong). Therefore, setting a batch of 1000 exp to update, using:
 {{{
-mysql -hscidbm -uX -pX gpc1 -B -e ' select exp_id from warpRun join fakeRun using (fake_id) join camRun using (cam_id) join chipRun using (chip_id)  where warpRun.data_group like "LAP.PV3.20140730.20150%"  group by warp_id ; ' | grep -v exp_id |  awk '{ print "mysql -hscidbm -u ippuser -pippuser gpc1 -B -e \" select s.exp_name,s.label,s.data_group,s.chip_id,s.warp_id,s.state from ( select chip_id,warp_id,exp_name,camRun.label,camRun.data_group,warpRun.state from warpRun join fakeRun using (fake_id) join camRun using (cam_id) join chipRun using (chip_id) join rawExp using (exp_id) where exp_id="$1" order by warp_id desc ) as s limit 1 ;\" " }' | tcsh | grep -v exp_name | grep LAP.PV3.2014 | grep cleaned | awk '{print "chiptool -dbname gpc1 -updaterun  -set_label update.LAP.PV3 -chip_id  "$4" ; chiptool -dbname gpc1 -setimfiletoupdate  -set_label update.LAP.PV3 -chip_id  "$4" ;warptool -dbname gpc1  -updaterun -set_label update.LAP.PV3 -warp_id "$5"; warptool -dbname gpc1  -setskyfiletoupdate -set_label update.LAP.PV3 -warp_id "$5 }' | head -n 1000 | tcsh
+mysql -hscidbm -uX -pX gpc1 -B -e ' select exp_id from warpRun join fakeRun using (fake_id) join camRun using (cam_id) join chipRun using (chip_id)  where warpRun.data_group like "LAP.PV3.20140730.20150%"  group by warp_id ; ' | grep -v exp_id |  awk '{ print "mysql -hscidbm -uX -pX gpc1 -B -e \" select s.exp_name,s.label,s.data_group,s.chip_id,s.warp_id,s.state from ( select chip_id,warp_id,exp_name,camRun.label,camRun.data_group,warpRun.state from warpRun join fakeRun using (fake_id) join camRun using (cam_id) join chipRun using (chip_id) join rawExp using (exp_id) where exp_id="$1" order by warp_id desc ) as s limit 1 ;\" " }' | tcsh | grep -v exp_name | grep LAP.PV3.2014 | grep cleaned | awk '{print "chiptool -dbname gpc1 -updaterun  -set_label update.LAP.PV3 -chip_id  "$4" ; chiptool -dbname gpc1 -setimfiletoupdate  -set_label update.LAP.PV3 -chip_id  "$4" ;warptool -dbname gpc1  -updaterun -set_label update.LAP.PV3 -warp_id "$5"; warptool -dbname gpc1  -setskyfiletoupdate -set_label update.LAP.PV3 -warp_id "$5 }' | head -n 1000 | tcsh
 }}}
 
@@ -988 +988 @@
  We can find their chip_id and warp_id, using:
 {{{
-mysql -hscidbm -uippuser -pippuser gpc1 -B -e ' SELECT rawExp.exp_name,rawExp.exp_id,chipRun.chip_id,chipRun.state,chipRun.label,warpRun.warp_id,warpRun.state,warpRun.label,warpRun.data_group FROM  warpSkyfile, warpRun, fakeRun, camRun, chipRun, rawExp WHERE  warpSkyfile.warp_id = warpRun.warp_id AND warpRun.fake_id = fakeRun.fake_id AND fakeRun.cam_id = camRun.cam_id AND camRun.chip_id = chipRun.chip_id AND chipRun.exp_id = rawExp.exp_id AND  chipRun.chip_id in (1131144,1131146,1131208,1131210,1130544,1130549,1130551,1130546,1130556,1130560,1131230,1200205,1131246,1131251,1130562,1130564,1130568,1130570,1131257,1131260,1200216,1130573,1131276,1131280,1130575,1130578,1131297,1131303,1131318,1131321,1130587,1130590,1131340,1130596,1130598,1130600,1583717,1583733,1756192,1756719,1795556,1795572,1795588,1795603,1813787,1813804,1813821,1813838,1936305,1936310,1936321,1936326,1936337,1936342,1936353,1936358,2055192,2055202,2055212,2055222,2088153,2088169,2088185,2088201) group by chip_id;' 
+mysql -hscidbm -uX -pX gpc1 -B -e ' SELECT rawExp.exp_name,rawExp.exp_id,chipRun.chip_id,chipRun.state,chipRun.label,warpRun.warp_id,warpRun.state,warpRun.label,warpRun.data_group FROM  warpSkyfile, warpRun, fakeRun, camRun, chipRun, rawExp WHERE  warpSkyfile.warp_id = warpRun.warp_id AND warpRun.fake_id = fakeRun.fake_id AND fakeRun.cam_id = camRun.cam_id AND camRun.chip_id = chipRun.chip_id AND chipRun.exp_id = rawExp.exp_id AND  chipRun.chip_id in (1131144,1131146,1131208,1131210,1130544,1130549,1130551,1130546,1130556,1130560,1131230,1200205,1131246,1131251,1130562,1130564,1130568,1130570,1131257,1131260,1200216,1130573,1131276,1131280,1130575,1130578,1131297,1131303,1131318,1131321,1130587,1130590,1131340,1130596,1130598,1130600,1583717,1583733,1756192,1756719,1795556,1795572,1795588,1795603,1813787,1813804,1813821,1813838,1936305,1936310,1936321,1936326,1936337,1936342,1936353,1936358,2055192,2055202,2055212,2055222,2088153,2088169,2088185,2088201) group by chip_id;' 
 }}}
  And then send the chips to cleanup and then back to update.