Changes between Version 6 and Version 7 of LAP_Czar

Timestamp:

Oct 17, 2011, 2:10:07 PM (15 years ago)

Author:

watersc1

Comment:

--

LAP_Czar

@@ -10 +10 @@
    * If a run is old, or looks stuck, look at the exposures:  `laptool -exposures -lap_id LLL`
      * Is something stuck because of a fault? Revert it.
-     * Is something failing after a revert? It probably has a corrupt file, check the log and fix it.
+     * Is something failing after a revert? It probably has a corrupt file, check the log and fix it using the runXXXfile.pl command from the tools directory.
      * Is something weird? If you can't figure out why exposure X is holding things up, kick it out so we can move on: `laptool -updateexp -lap_id LLL -exp_id XXX -set_data_state drop`
 
@@ -38 +38 @@
 
 Caveat: this script blocks the region into bands in declination, to allow regions of five filter coverage to be generated quickly.  Because of this, it cycles through the filters in a different way for each block, as it selects the last filter of the previous block as the first filter of the current block.  
+
+== Determining when a block is finished ==
+
+Projection cells are identified by an index number that increases by one with increasing RA, starting at 0 degrees.  Once an entire band is finished at that declination, the declination is incremented by 4 degrees and another band of projection cells is defined, again incrementing by one.  The consequence of this is that projection cells in the same part of the sky have large jumps in the index number as the declination changes.  As the five color blocks are also divided by declination, these jumps can be used to determine when a block has been fully processed.  Looking at a section of the output of `laptool -listrun -seq_id 8 -simple`:
+{{{
+1252 8 RINGS.V3 skycell.1585 y.00000 done LAP.ThreePi.20110809 LAP.ThreePi 2011-10-12T11:36:11.000000 0 9223372036854775807 4534
+1253 8 RINGS.V3 skycell.1586 y.00000 done LAP.ThreePi.20110809 LAP.ThreePi 2011-10-12T11:40:29.000000 0 9223372036854775807 4535
+1254 8 RINGS.V3 skycell.1999 g.00000 done LAP.ThreePi.20110809 LAP.ThreePi 2011-10-12T11:45:21.000000 0 9223372036854775807 4537
+1255 8 RINGS.V3 skycell.2000 g.00000 done LAP.ThreePi.20110809 LAP.ThreePi 2011-10-12T11:48:44.000000 0 9223372036854775807 4538
+1256 8 RINGS.V3 skycell.2001 g.00000 done LAP.ThreePi.20110809 LAP.ThreePi 2011-10-12T12:11:46.000000 0 9223372036854775807 4540
+1257 8 RINGS.V3 skycell.2002 g.00000 done LAP.ThreePi.20110809 LAP.ThreePi 2011-10-12T13:02:06.000000 0 9223372036854775807 4541
+1258 8 RINGS.V3 skycell.2003 g.00000 done LAP.ThreePi.20110809 LAP.ThreePi 2011-10-12T13:10:41.000000 0 9223372036854775807 4542
+1259 8 RINGS.V3 skycell.2004 g.00000 done LAP.ThreePi.20110809 LAP.ThreePi 2011-10-12T14:07:01.000000 0 9223372036854775807 4545
+1260 8 RINGS.V3 skycell.2005 g.00000 done LAP.ThreePi.20110809 LAP.ThreePi 2011-10-12T14:16:41.000000 0 9223372036854775807 4546
+1261 8 RINGS.V3 skycell.2076 g.00000 done LAP.ThreePi.20110809 LAP.ThreePi 2011-10-12T14:27:39.000000 0 9223372036854775807 4550
+...
+1297 8 RINGS.V3 skycell.2004 r.00000 done LAP.ThreePi.20110809 LAP.ThreePi 2011-10-14T17:00:22.000000 0 9223372036854775807 4599
+1298 8 RINGS.V3 skycell.2005 r.00000 run LAP.ThreePi.20110809 LAP.ThreePi 2011-10-14T23:02:57.000000 0 9223372036854775807 4600
+}}}
+LAP run 1298 is the lowest numbered run that is still processing.  Therefore the block that contains skycell.2005 is not complete in five colors.  Continuing backwards, the jump from skycell.1586 to skycell.1999 is large, so we seem to have full five-color completion for any sequence 8 data prior to 1254.  There is another jump between lap_id 1260 and 1261, but that is just a regular step in declination.
+
+Once we know that we've completed processing of exposures in lapRuns < 1254, we can get a list of exp_ids from the database:
+{{{
+select DISTINCT exp_id from lapRun JOIN lapExp USING(lap_id) where seq_id = 8 AND lap_id < 1254;
+...
+11972 rows in set (0.07 sec)
+}}}
 
 == Examples ==