Changeset 38763
- Timestamp:
- Sep 21, 2015, 11:54:38 AM (11 years ago)
- Location:
- trunk/ippToPsps
- Files:
-
- 17 edited
-
config/tables.DF.vot (modified) (2 diffs)
-
config/tables.DO.vot (modified) (1 diff)
-
config/tables.FG.vot (modified) (1 diff)
-
config/tables.FO.vot (modified) (2 diffs)
-
config/tables.FW.vot (modified) (2 diffs)
-
config/tables.OB.vot (modified) (1 diff)
-
config/tables.P2.vot (modified) (3 diffs)
-
config/tables.ST.vot (modified) (2 diffs)
-
jython/detectionbatch.py (modified) (5 diffs)
-
jython/diffbatch.py (modified) (3 diffs)
-
jython/diffobjectbatch.py (modified) (1 diff)
-
jython/forcedobjectbatch.py (modified) (2 diffs)
-
jython/forcedwarpbatch.py (modified) (3 diffs)
-
jython/ipptopspsdb.py (modified) (1 diff)
-
jython/objectbatch.py (modified) (1 diff)
-
jython/skychunk.py (modified) (1 diff)
-
jython/stackbatch.py (modified) (7 diffs)
Legend:
- Unmodified
- Added
- Removed
-
trunk/ippToPsps/config/tables.DF.vot
r38762 r38763 81 81 <DESCRIPTION>Linear transformation matrix element between image pixel y and declination.</DESCRIPTION> 82 82 </FIELD> 83 <FIELD name=" dataRelease" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA">83 <FIELD name="processingVersion" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA"> 84 84 <DESCRIPTION>Data release version.</DESCRIPTION> 85 85 </FIELD> … … 289 289 <DESCRIPTION>Information flag bitmask indicating details of the photometry. Values listed in DetectionFlags3.</DESCRIPTION> 290 290 </FIELD> 291 <FIELD name=" dataRelease" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA">291 <FIELD name="processingVersion" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA"> 292 292 <DESCRIPTION>Data release version.</DESCRIPTION> 293 293 </FIELD> -
trunk/ippToPsps/config/tables.DO.vot
r38751 r38763 93 93 <DESCRIPTION>Maximum PSF weighted fraction of pixels totally unmasked from y filter detections.</DESCRIPTION> 94 94 </FIELD> 95 <FIELD name=" dataRelease" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA">95 <FIELD name="processingVersion" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA"> 96 96 <DESCRIPTION>Data release version.</DESCRIPTION> 97 97 </FIELD> -
trunk/ippToPsps/config/tables.FG.vot
r38751 r38763 21 21 <DESCRIPTION>Unique stack identifier.</DESCRIPTION> 22 22 </FIELD> 23 <FIELD name=" dataRelease" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA">23 <FIELD name="processingVersion" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA"> 24 24 <DESCRIPTION>Data release version.</DESCRIPTION> 25 25 </FIELD> -
trunk/ippToPsps/config/tables.FO.vot
r38751 r38763 24 24 <DESCRIPTION>Internal database batch identifier.</DESCRIPTION> 25 25 </FIELD> 26 <FIELD name=" dataRelease" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA">26 <FIELD name="processingVersion" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA"> 27 27 <DESCRIPTION>Data release version.</DESCRIPTION> 28 28 </FIELD> … … 523 523 <DESCRIPTION>Internal database batch identifier.</DESCRIPTION> 524 524 </FIELD> 525 <FIELD name=" dataRelease" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA">525 <FIELD name="processingVersion" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA"> 526 526 <DESCRIPTION>Data release version.</DESCRIPTION> 527 527 </FIELD> -
trunk/ippToPsps/config/tables.FW.vot
r38760 r38763 96 96 <DESCRIPTION>Linear transformation matrix element between image pixel y and declination.</DESCRIPTION> 97 97 </FIELD> 98 <FIELD name=" dataRelease" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA">98 <FIELD name="processingVersion" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA"> 99 99 <DESCRIPTION>Data release version.</DESCRIPTION> 100 100 </FIELD> … … 253 253 <DESCRIPTION>Information flag bitmask indicating details of the photometry. Values listed in DetectionFlags3.</DESCRIPTION> 254 254 </FIELD> 255 <FIELD name=" dataRelease" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA">255 <FIELD name="processingVersion" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA"> 256 256 <DESCRIPTION>Data release version.</DESCRIPTION> 257 257 </FIELD> -
trunk/ippToPsps/config/tables.OB.vot
r38751 r38763 45 45 <DESCRIPTION>Internal DVO region identifier.</DESCRIPTION> 46 46 </FIELD> 47 <FIELD name=" dataRelease" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA">47 <FIELD name="processingVersion" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA"> 48 48 <DESCRIPTION>Data release version.</DESCRIPTION> 49 49 </FIELD> -
trunk/ippToPsps/config/tables.P2.vot
r38762 r38763 147 147 <DESCRIPTION>Internal database batch identifier.</DESCRIPTION> 148 148 </FIELD> 149 <FIELD name=" dataRelease" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA">149 <FIELD name="processingVersion" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA"> 150 150 <DESCRIPTION>Data release version.</DESCRIPTION> 151 151 </FIELD> … … 361 361 <DESCRIPTION>Polynomial coefficient for the astrometric fit component (x^0 y^2) for focal plane M.</DESCRIPTION> 362 362 </FIELD> 363 <FIELD name=" dataRelease" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA">363 <FIELD name="processingVersion" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA"> 364 364 <DESCRIPTION>Data release version.</DESCRIPTION> 365 365 </FIELD> … … 542 542 <DESCRIPTION>Information flag bitmask indicating details of the photometry. Values listed in DetectionFlags3.</DESCRIPTION> 543 543 </FIELD> 544 <FIELD name=" dataRelease" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA">544 <FIELD name="processingVersion" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA"> 545 545 <DESCRIPTION>Data release version.</DESCRIPTION> 546 546 </FIELD> -
trunk/ippToPsps/config/tables.ST.vot
r38762 r38763 110 110 <DESCRIPTION>Linear transformation matrix element between image pixel y and declination.</DESCRIPTION> 111 111 </FIELD> 112 <FIELD name=" dataRelease" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA">112 <FIELD name="processingVersion" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA"> 113 113 <DESCRIPTION>Data release version.</DESCRIPTION> 114 114 </FIELD> … … 158 158 <DESCRIPTION>Internal DVO region identifier.</DESCRIPTION> 159 159 </FIELD> 160 <FIELD name=" dataRelease" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA">160 <FIELD name="processingVersion" arraysize="1" datatype="unsignedByte" unit="dimensionless" default="NA"> 161 161 <DESCRIPTION>Data release version.</DESCRIPTION> 162 162 </FIELD> -
trunk/ippToPsps/jython/detectionbatch.py
r38761 r38763 179 179 self.scratchDb.updateAllRows("FrameMeta", "surveyID", str(self.surveyID)) 180 180 self.scratchDb.updateFilterID("FrameMeta", self.filter) 181 self.scratchDb.updateAllRows("FrameMeta", " dataRelease", str(self.skychunk.dataRelease))181 self.scratchDb.updateAllRows("FrameMeta", "processingVersion", str(self.skychunk.processingVersion)) 182 182 183 183 ''' … … 296 296 297 297 self.scratchDb.updateFilterID(tableName, self.filter) 298 self.scratchDb.updateAllRows(tableName, " dataRelease", str(self.skychunk.dataRelease))298 self.scratchDb.updateAllRows(tableName, "processingVersion", str(self.skychunk.processingVersion)) 299 299 if 'NASTRO' in header: self.totalNumPhotoRef = self.totalNumPhotoRef + int(header['NASTRO']) 300 300 self.scratchDb.replaceNullsInThisColumn(tableName, "polyOrder", "0") … … 460 460 sqlLine.group("infoFlag", "FLAGS") 461 461 sqlLine.group("infoFlag2", "FLAGS2") 462 sqlLine.group(" dataRelease", str(self.skychunk.dataRelease))462 sqlLine.group("processingVersion", str(self.skychunk.processingVersion)) 463 463 464 464 sql = sqlLine.makeRaw(") SELECT ", " FROM " + ippTableName) … … 518 518 self.scratchDb.execute(sql) 519 519 520 self.scratchDb.updateAllRows(tableName, " dataRelease", str(self.skychunk.dataRelease))520 self.scratchDb.updateAllRows(tableName, "processingVersion", str(self.skychunk.processingVersion)) 521 521 ''' 522 522 Populates the SkinnyObject table for this OTA … … 545 545 self.scratchDb.execute(sql) 546 546 547 self.scratchDb.updateAllRows(tableName, " dataRelease", str(self.skychunk.dataRelease))547 self.scratchDb.updateAllRows(tableName, "processingVersion", str(self.skychunk.processingVersion)) 548 548 549 549 ''' -
trunk/ippToPsps/jython/diffbatch.py
r38761 r38763 185 185 186 186 187 self. dataRelease = skychunk.dataRelease;187 self.processingVersion = skychunk.processingVersion; 188 188 189 189 … … 236 236 self.scratchDb.updateAllRows("DiffMeta_"+str(num), "surveyID", str(self.surveyID)) 237 237 self.scratchDb.updateFilterID("DiffMeta_"+str(num), self.filterName[num][0]) 238 self.scratchDb.updateAllRows("DiffMeta_"+str(num), " dataRelease", str(self.skychunk.dataRelease))238 self.scratchDb.updateAllRows("DiffMeta_"+str(num), "processingVersion", str(self.skychunk.processingVersion)) 239 239 self.logger.infoPair("DiffMeta_"+str(num),"done") 240 240 … … 339 339 sqlLine.group("DinfoFlag", "FLAGS") 340 340 sqlLine.group("DinfoFlag2", "FLAGS2") 341 sqlLine.group(" dataRelease", str(self.skychunk.dataRelease))341 sqlLine.group("processingVersion", str(self.skychunk.processingVersion)) 342 342 343 343 sql = sqlLine.makeRaw(") SELECT ", " FROM " + ippTableName) -
trunk/ippToPsps/jython/diffobjectbatch.py
r38723 r38763 292 292 sqlLine.group("dvoRegionID", "CAT_ID") 293 293 # sqlLine.group("skycellID", "SKYCELL_ID") 294 sqlLine.group(" dataRelease", "'" + str(self.skychunk.dataRelease) + "'")294 sqlLine.group("processingVersion", "'" + str(self.skychunk.processingVersion) + "'") 295 295 sqlLine.group("objInfoFlag", "FLAGS") 296 296 sqlLine.group("qualityFlag", "FLAGS >> 24 & 0xFF") -
trunk/ippToPsps/jython/forcedobjectbatch.py
r38736 r38763 334 334 sqlLine.group("randomForcedObjID", "RAND("+str(self.batchID)+")") 335 335 sqlLine.group("nDetections", "'0'") 336 sqlLine.group("processingVersion", str(self.skychunk.processingVersion)) 336 337 sql = sqlLine.makeRaw(") SELECT ", " FROM " + cptTableName) 337 338 … … 363 364 sqlLine.group("batchID", "batchID") 364 365 sqlLine.group("nDetections", "nDetections") 366 sqlLine.group("processingVersion", str(self.skychunk.processingVersion)) 365 367 366 368 sql = sqlLine.makeRaw(") SELECT ", " FROM ForcedMeanObject") -
trunk/ippToPsps/jython/forcedwarpbatch.py
r38759 r38763 279 279 # self.scratchDb.updateFilterID("ForcedWarpMeta", self.filterID) 280 280 self.scratchDb.updateFilterID("ForcedWarpMeta_"+forcedWarpID,self.filterName[num][0]) 281 self.scratchDb.updateAllRows("ForcedWarpMeta_"+forcedWarpID, " dataRelease", str(self.skychunk.dataRelease))281 self.scratchDb.updateAllRows("ForcedWarpMeta_"+forcedWarpID, "processingVersion", str(self.skychunk.processingVersion)) 282 282 #self.tablesToExport.append("ForcedWarpMeta") 283 283 … … 379 379 sqlLine.group("FinfoFlag","FLAGS") 380 380 sqlLine.group("FinfoFlag2","FLAGS2") 381 sqlLine.group(" dataRelease",str(self.skychunk.dataRelease))381 sqlLine.group("processingVersion",str(self.skychunk.processingVersion)) 382 382 383 383 print "got here too" … … 393 393 394 394 395 # insert the per-object data (IDs, random stack ID, dataRelease, etc)395 # insert the per-object data (IDs, random stack ID, processingVersion, etc) 396 396 #self.selectDvoObjIDs() 397 397 self.logger.infoPair("inserting dvo info: find imageID","from externID") -
trunk/ippToPsps/jython/ipptopspsdb.py
r37917 r38763 1147 1147 1148 1148 self.skychunk.basePath = rs.getString(11) 1149 self.skychunk. dataRelease= rs.getInt(12)1149 self.skychunk.processingVersion = rs.getInt(12) 1150 1150 1151 1151 self.skychunk.deleteLocal = rs.getInt(13) -
trunk/ippToPsps/jython/objectbatch.py
r38723 r38763 370 370 sqlLine.group("projectionID", "PROJECTION_ID") 371 371 sqlLine.group("skycellID", "SKYCELL_ID") 372 sqlLine.group(" dataRelease", "'" + str(self.skychunk.dataRelease) + "'")372 sqlLine.group("processingVersion", "'" + str(self.skychunk.processingVersion) + "'") 373 373 sqlLine.group("objInfoFlag", "FLAGS") 374 374 sqlLine.group("qualityFlag", "FLAGS >> 24 & 0xFF") -
trunk/ippToPsps/jython/skychunk.py
r35417 r38763 55 55 self.logger.infoPair("Publishing to PSPS as survey", self.pspsSurvey) 56 56 self.logger.infoPair("Loading epoch", self.epoch) 57 self.logger.infoPair(" Data release", "%d" % self.dataRelease)57 self.logger.infoPair("Processing Version (aka, PV3 = 3, SAS39 = 39)", "%d" % self.processingVersion) 58 58 for batchType in self.batchTypes: self.logger.infoPair("Queuing batch type", batchType) 59 59 except: -
trunk/ippToPsps/jython/stackbatch.py
r38602 r38763 252 252 sqlLine.group("skyCellID", str(self.skycellID)) 253 253 sqlLine.group("photoCalID", photoCalID) 254 sqlLine.group("analysisVer", str(self.analysisVer)) 254 sqlLine.group("analysisVer", str(self.analysisVer)) 255 sqlLine.group("completMag", self.getKeyFloat(header, "%.8f", 'FLIMIT')) 255 256 sqlLine.group("expTime", self.getKeyFloat(header, "%.5f", 'EXPTIME')) 256 257 sqlLine.group("psfModelID", psfmodel) … … 270 271 sqlLine.group("pc002001", self.getKeyFloat(header, "%.8e", 'PC002001')) 271 272 sqlLine.group("pc002002", self.getKeyFloat(header, "%.8e", 'PC002002')) 272 sqlLine.group(" dataRelease", str(self.skychunk.dataRelease))273 sqlLine.group("processingVersion", str(self.skychunk.processingVersion)) 273 274 274 275 sql = sqlLine.make(") VALUES ( ", ")") … … 288 289 self.logger.infoPair("Procesing table", "StackObjectThin") 289 290 290 # insert the per-object data (IDs, random stack ID, dataRelease, etc)291 # insert the per-object data (IDs, random stack ID, processingVersion, etc) 291 292 self.selectDvoObjIDs() 292 293 … … 363 364 # sqlLine.group("a."+filter+"skyErr", "b.SKY_SIGMA / " + str(exptime)) 364 365 sqlLine.group("a."+filter+"infoFlag", "b.FLAGS") 365 sqlLine.group("a."+filter+"infoFlag2", "b.FLAGS2 | a."+filter+"infoFlag2")366 sqlLine.group("a."+filter+"infoFlag2", "b.FLAGS2") 366 367 sqlLine.group("a."+filter+"nFrames", "b.N_FRAMES") 367 368 … … 1066 1067 ''' 1067 1068 select objID (psps object ID) from dvo restricted to this set of imageIDs. also insert 1068 ippObjID and several constants (for a skycell): surveyID, skyCellId, dataRelease1069 ippObjID and several constants (for a skycell): surveyID, skyCellId, processingVersion 1069 1070 ''' 1070 1071 def selectDvoObjIDs(self): … … 1085 1086 # sqlLine.group("projectionID", "'" + str(self.projectionID) + "'") 1086 1087 # sqlLine.group("skyCellID", "'" + str(self.skycellID) + "'") 1087 # sqlLine.group(" dataRelease", "'" + str(self.skychunk.dataRelease) + "'")1088 # sqlLine.group("processingVersion", "'" + str(self.skychunk.processingVersion) + "'") 1088 1089 # sqlLine.group("randomStackObjID", "FLOOR(RAND()*9223372036854775807)") 1089 1090 … … 1122 1123 , projectionID = '" + str(self.projectionID) + "'\ 1123 1124 , skycellID = '" + str(self.skycellID) + "'\ 1124 , dataRelease = '" + str(self.skychunk.dataRelease) +"'"1125 , processingVersion = '" + str(self.skychunk.processingVersion) +"'" 1125 1126 1126 1127 try: self.scratchDb.execute(sql)
Note:
See TracChangeset
for help on using the changeset viewer.
