Changeset 13937 for trunk/dbconfig

Timestamp:

Jun 21, 2007, 2:10:11 PM (19 years ago)

Author:

Paul Price

Message:

Changes to multiple packages in order to use "reduction classes" to
specify recipe names. The idea is to give a group of recipes a
symbolic name, which distinguish how the reduction is to be performed,
without going to all the trouble of changing the recipes themselves.

For example, we might want to turn off the usual
overscan/bias/dark/shutter/flat processing and only do photometry if
we have pre-processed data. Gene also wants a similar ability for
building the flat-field correction.

Added a REDUCTION metadata to the camera configuration that contains
multiple METADATA entries that have recipes for different processing
steps. PS::IPP::Config has a 'reduction' function to return the
appropriate recipe, and this is now used in the scripts. Updated
ippTasks to use these where appropriate.

This necessitated changing the database, so that the desired reduction
class can be specified in the right places. Instructions on converting
an extant database are in dbconfig/changes.txt.

Tested with the SIMTEST, and it works.

There is currently no way of specifying the reduction class when an
exposure proceeds from 'register' to 'chip' (it has to be hacked in
the database directly: "update chipPendingExp set reduction =
'SOME_CLASS' where ..."), but it can be specified when adding a
detrend run or queuing chips with 'chiptool -queue' (the '-reduction'
option). Also, the 'recipe' columns remain throughout the detrend
tables, and they continue to be populated with the actual recipe used
(rather than the reduction class; but that is contained in the
detRun).

Location:

trunk/dbconfig

Files:

• cam.md (modified) (2 diffs)
• changes.txt (modified) (1 diff)
• chip.md (modified) (2 diffs)
• config.md (modified) (1 diff)
• det.md (modified) (1 diff)

trunk/dbconfig/cam.md

@@ -6 +6 @@
     workdir     STR         255 
     label       STR         64      # key
-    recipe      STR         64
+    reduction   STR         64
     expgroup    STR         64      # key
     dvodb       STR         255
@@ -17 +17 @@
     workdir        STR      255 
     label          STR      64      # key
-    recipe         STR      64
+    reduction      STR      64
     expgroup       STR      64      # key
     dvodb          STR      255

trunk/dbconfig/changes.txt

@@ -12 +12 @@
 alter table diffSkyfile add column path_base varchar(255) NULL DEFAULT NULL after uri;
 alter table stackSumSkyfile add column path_base varchar(255) NULL DEFAULT NULL after uri;
+
+
+Version 1.1.22 --> 1.1.23
+# Adding support for reduction classes (which are used to specify recipes for parts of the pipeline).
+# Adding 'reduction' to detRun
+# Renaming 'recipe' in {chip,cam}{Pending,Processed}Exp to 'reduction'
+
+alter table detRun add column reduction varchar(64) NULL DEFAULT NULL after exp_type;
+alter table chipPendingExp change column recipe reduction varchar(64);
+alter table chipProcessedExp change column recipe reduction varchar(64);
+alter table camPendingExp change column recipe reduction varchar(64);
+alter table camProcessedExp change column recipe reduction varchar(64);

trunk/dbconfig/chip.md

@@ -8 +8 @@
     workdir     STR         255 
     label       STR         64      # key
-    recipe      STR         64
+    reduction   STR         64      # Reduction class
     expgroup    STR         64      # key
     dvodb       STR         255
@@ -30 +30 @@
     workdir     STR         255 
     label       STR         64      # key
-    recipe      STR         64
+    reduction   STR         64
     expgroup    STR         64      # key
     dvodb       STR         255

trunk/dbconfig/config.md

@@ -2 +2 @@
     pkg_name        STR     ippdb
     pkg_namespace   STR     ippdb
-    pkg_version     STR     1.1.22
+    pkg_version     STR     1.1.23
 END

trunk/dbconfig/det.md

@@ -10 +10 @@
     telescope   STR         64
     exp_type    STR         64      # XXX this should be dropped
+    reduction   STR         64      # Reduction clas
     filter      STR         64
     airmass_min F32         0.0