Changeset 35072

Timestamp:

Jan 29, 2013, 5:33:25 AM (13 years ago)

Author:

eugene

Message:

update notes

File:

• branches/eam_branches/ipp-20121219/ippToPsps/doc/upgrade.txt (modified) (3 diffs)

branches/eam_branches/ipp-20121219/ippToPsps/doc/upgrade.txt

@@ +1 @@
+
+2012.01.27
+
+remaining issues:
+
+* operational sequence:
+
+  I need to change the way ippToPsps works at the operational level.
+  currently, the concept is that a 'config' is once and the boundaries
+  / aspect changed to trigger different processing.  this is poor
+  because it leaves no tracking, and it means the current situation
+  change change too easily.  in addition, the rules for triggering dvo
+  ingest are not completely clear, and probably not enforceable from
+  within ippToPsps
+
+  alternatively, I'd like to have the following sequence:
+
+  * init batch should not require a config -- it simply passes along
+    the statically defined tables from tables.IN.vot.  it should be
+    required first, and perhaps depends on the associated dvo database
+    (eg, for skytable?).
+
+  * queue config (probably to include P2,ST,OB batches in general
+    operations) -- should only be done for a region when the items for
+    that region are done.
+
+  * trigger dvo ingest for detections (and image / skytable?)
+    (allow for rerunning ingest operations which failed)
+
+  * run loader once to bundle the batches for the pending items
+    - do not load dvo tables here
+  
+* modify object ingest to happen at same times as the detections
+
+* seems to be some odd behavior -- failure to ingest, duplicate keys?
 
 2013.01.26
@@ -13 +48 @@
 This simple modification speeds up the processing of the smfs by a
 factor of nearly 2x!
-
-
 
 2013.01.24 : Status of the ippToPsps Upgrade
@@ -76 +109 @@
 
   * need to enable -parallel option to dvopsps (config option?)
-  * add multi-row ingest to stilts
-  * need to fix test obj ingest
+  * add multi-row ingest to stilts (maybe not immediately -- the
+    select/load fix helped quite a bit)
+  * need to fix test obj ingest (DONE)
   * file handles are not promptly closed -- is this a garbage
     collection problem?