Changeset 35402 for branches/eam_branches/ipp-20130307/ippToPsps/jython/scratchdb.py

Timestamp:

Apr 16, 2013, 6:27:02 AM (13 years ago)

Author:

eugene

Message:

add error handling for dvopsps skytable; add config entry for memory usage for memory db tables; add / fix version parsing; error handling for xmllint; error handline for dvograbber (unused); set max_heap_table_size before creating memory tables; add error handling for dvopsps objects; break on error from dvopsps detections; do not try to populate Chip table unless it exists; skip batch on failure, but continue to load

File:

• branches/eam_branches/ipp-20130307/ippToPsps/jython/scratchdb.py (modified) (2 diffs)

branches/eam_branches/ipp-20130307/ippToPsps/jython/scratchdb.py

@@ -38 +38 @@
         self.dvoSkyTable = "dvoSkyTable"
         self.dvoPhotcodesTable = "dvoPhotcodes"
+        self.memoryTableSize = config.getDbMemory(dbType)
 
     '''
@@ -509 +510 @@
        self.dropTable(self.dvoDetectionTable)
 
+       # we need a big enough memory table for the incoming detections
+       print "requested memory in gigs: ", self.memoryTableSize
+       tableSize = int(self.memoryTableSize) * 1024 * 1024 * 1024
+       sql = "set @@max_heap_table_size = " + str(tableSize)
+       print "setting max heap size: ", sql
+       try: self.execute(sql)
+       except: 
+           self.logger.errorPair("Unable to set max MEMORY table size for ", self.dvoDetectionTable)
+           return False
+
        # create detections table
        self.logger.infoPair("Creating table", self.dvoDetectionTable)