Changes between Version 9 and Version 10 of Psps_MD_PV2

Timestamp:

Nov 17, 2014, 5:24:35 PM (12 years ago)

Author:

heather

Comment:

--

Psps_MD_PV2

@@ -4 +4 @@
  * as of 9-26-2014, 2,3,4,5,6 are ready to be queried
  * as of Oct 2014, all are ready to be queried.
+
+
+== Plots of coverage ==
 
 I did a selection of random 100,000 ras and decs from detectionFull, stackDetectionFull, and Object for each field. The results are plotted below, you can click on the image to make it bigger.
@@ -33 +36 @@
 || md09 ||[[Image(md09det111314.png,200px)]]  || [[Image(md09stackdet111314.png,200px)]] ||[[Image(md09obj111314.png,200px)]]  ||
 || md10 || [[Image(md10det111314.png,200px)]] || [[Image(md10stackdet111314.png,200px)]] ||[[Image(md10obj111314.png,200px)]]  ||
+
+== Plots with batchid or mag ==
+
+
+
+== Comparisions of ndetections ==
+
+Another way to check the integrity is to do comparisons of the number of detections for each batch. in the ipptopsps.batch table, there is a column (ndetections) that is the number of detections published (per batch).  The following queries make counts of the number of detections for each of stack/detection and grouped by batchid:
+
+{{{
+select batchid, count(objid) INTO mydb.[md06detcounts2] from Detection join ImageMeta on Detection.imageID = ImageMeta.imageID join FrameMeta on FrameMeta.frameID = imageMeta.frameID group by batchid
+
+select batchid, count(*) INTO mydb.[md01stackdetcounts] from StackDetectionFull join StackMeta on StackDetectionFull.StackMetaID = StackMeta.StackMetaID group by batchid
+}}}
+
+I wrote a perl script to compare the numbers between these 2 databases.  I find the following
+
+|| MD field  || Detections  || Stacks    || Objects                    ||
+|| MD01      || 1565 out of 3797 batches are missing detections            || all good ||  not done yet              ||
+|| MD02      ||   all good          || all good ||   not done yet             ||
+|| MD03      ||   all good          || all good ||  not done yet              ||
+|| MD04      ||   all good           || all good ||  not done yet              ||
+|| MD05      ||       not done yet       || all good ||  not done yet              ||
+|| MD06      ||     not done yet         || all good ||  not done yet              ||
+|| MD07      ||     not done yet         || 164 out of 321 batches have extra detections     ||  not done yet              ||
+|| MD08      ||     not done yet         || all good ||  not done yet              ||
+|| MD09      ||     not done yet         || all good ||  not done yet              ||
+|| MD10      ||     not done yet         || all good ||  not done yet              ||
+
+
+So far, MD02/MD03/MD04 are consistent (for the Stack/Detection tables)
+
+MD01 has problems with Detections
+
+MD07 has problems with Stack Detections
+