Changes between Version 27 and Version 28 of External_Supercomputing_Notes

Timestamp:

Feb 19, 2014, 4:12:39 PM (12 years ago)

Author:

watersc1

Comment:

--

External_Supercomputing_Notes

@@ +1 @@
+== 2014-02-19 ==
+
+The database changes and tool work has been done, and so far I've tested the IPP side of the code to handle multi-exposure job bundles:
+
+{{{
+# remote_id 2
+chiptool -definebyquery -dateobs_begin 2011-07-03T00:00:00 -dateobs_end 2011-07-06T23:59:59 -obs_mode SAS2  -set_label lanl.SAS.201402114 -set_data_group czw.SAS.201402114 -set_end_stage warp -set_tess_id RINGS.V3 -set_workdir neb://@HOST@.0/czw/SAS.201402114/ -filter g.00000 -pretend -simple -set_dist_group SAS
+chiptool -definebyquery -dateobs_begin 2011-07-03T00:00:00 -dateobs_end 2011-07-06T23:59:59 -obs_mode SAS2  -set_label lanl.SAS.201402114 -set_data_group czw.SAS.201402114 -set_end_stage warp -set_tess_id RINGS.V3 -set_workdir neb://@HOST@.0/czw/SAS.201402114/ -filter i.00000 -pretend -simple -set_dist_group SAS
+chiptool -definebyquery -dateobs_begin 2011-07-03T00:00:00 -dateobs_end 2011-07-06T23:59:59 -obs_mode SAS2  -set_label lanl.SAS.201402114 -set_data_group czw.SAS.201402114 -set_end_stage warp -set_tess_id RINGS.V3 -set_workdir neb://@HOST@.0/czw/SAS.201402114/ -filter r.00000 -pretend -simple -set_dist_group SAS
+chiptool -definebyquery -dateobs_begin 2011-07-03T00:00:00 -dateobs_end 2011-07-06T23:59:59 -obs_mode SAS2  -set_label lanl.SAS.201402114 -set_data_group czw.SAS.201402114 -set_end_stage warp -set_tess_id RINGS.V3 -set_workdir neb://@HOST@.0/czw/SAS.201402114/ -filter y.00000 -pretend -simple -set_dist_group SAS
+chiptool -definebyquery -dateobs_begin 2011-07-03T00:00:00 -dateobs_end 2011-07-06T23:59:59 -obs_mode SAS2  -set_label lanl.SAS.201402114 -set_data_group czw.SAS.201402114 -set_end_stage warp -set_tess_id RINGS.V3 -set_workdir neb://@HOST@.0/czw/SAS.201402114/ -filter z.00000 -pretend -simple -set_dist_group SAS
+remotetool -definebyquery -label lanl.SAS.201402114 -stage chip -path_base neb://@HOST@.0/czw/lanl.SAS.201402114
+sc_prepare_chip.pl --remote_id 2 --camera GPC1 --dbname gpc1 --path_base neb://@HOST@.0/czw/lanl.rtdb.t1/remote_chip.2 --no_update --verbose
+
+# remote_id 3
+chiptool -definebyquery -set_label czw.lanl.t2 -set_workdir neb://any/czw/lanl.t2/ -exp_id 555555
+chiptool -definebyquery -set_label czw.lanl.t2 -set_workdir neb://any/czw/lanl.t2/ -exp_id 555556
+remotetool -definebyquery -label czw.lanl.t2 -stage chip -path_base neb://@HOST@.0/czw/lanl.rtdb.t1/ -trace db 45
+sc_prepare_chip.pl --remote_id 3 --camera GPC1 --dbname gpc1 --path_base neb://@HOST@.0/czw/lanl.rtdb.t1/remote_chip.3 --no_update --verbose
+
+# remote_id 4
+chiptool -definebyquery -set_label czw.lanl.t2 -set_workdir neb://any/czw/lanl.t2/ -exp_id 555557
+chiptool -definebyquery -set_label czw.lanl.t2 -set_workdir neb://any/czw/lanl.t2/ -exp_id 555558
+remotetool -definebyquery -label czw.lanl.t2 -stage chip -path_base neb://@HOST@.0/czw/lanl.rtdb.t1/ -trace db 45
+sc_prepare_chip.pl --remote_id 4 --camera GPC1 --dbname gpc1 --path_base neb://@HOST@.0/czw/lanl.rtdb.t1/remote_chip.4 --no_update --verbose
+neb-ls neb://@HOST@.0/czw/lanl.rtdb.t1/remote_chip.4%
+}}
+
+Unfortunately, the prepare_chip call for SAS is taking much longer than I'd expected, largely due to the cost in looking up the detrends.  I think this means that chiptool needs to be able to do the detselect operations itself, reducing the number of extra calls that need to be done.
+
 == 2014-02-07 ==