== PSPS SA9 objects/ndetections investigations == There are problems with ndetections in objects table in PSPS, there are several varieties of problems: === ndetections = -999 === How to find: {{{ select count(*) from object where ndetections = -999 }}} Heather did a slightly different version, to try to figure out where these things live: {{{ select (ippobjid/1000000000), count (*) as n from objects where ndetections = -999 group by (ippobjid/1000000000) order by n desc }}} This gives the following ( there are a lot of them these are only the top 'interesting' ones): || ippobjid thing || count(*) || batch || ||93293 || 12300 || 360500 -- this is the failed ob batch why do these go into the db?|| ||93096 || 7398 || no batch || ||18740 || 6601|| ... || ||93092|| 6577|| ||18744 ||6351|| ||93116 ||5752|| ||93120|| 5657|| ||93088|| 3902|| ||93100|| 3866|| ||18768|| 3552|| ||18748|| 3463|| ||93112|| 3323|| ||18756|| 3205|| ||18764|| 231|| ||18986|| 213 || ||etc || || The first one is interesting - it is the OB batch that failed to load. That should not be put into PSPS (heather thinks) The others, what are they? The ippobjid/1000000000 corresponds to the 'stage_id', but according to ipptopsps.batch, there is no batch with those stage ids.. I grabbed one of the fault ones: * objid = 104073276979184735 * ippobjid = 93096000007333 * ra = 327.697918 * dec = -3.27140108245 and asked which batches it could live in (based on min/max obj id). I get the following 20 batches which I downloaded: {{{ mysql> select batch_id, stage_id from batch where min_obj_id < 104073276979184735 and max_obj_id > 104073276979184735 and dvo_db = 'SAS.20120905' and batch_type = 'OB'; +----------+----------+ | batch_id | stage_id | +----------+----------+ | 359431 | 93354 | | 359433 | 93355 | | 359614 | 93157 | | 359615 | 93158 | | 359616 | 93159 | | 359617 | 93160 | | 360325 | 93259 | | 360332 | 93260 | | 360367 | 93305 | | 360373 | 93306 | | 361579 | 93307 | | 361582 | 93308 | | 361595 | 93353 | | 361676 | 93209 | | 361762 | 93257 | | 361781 | 93258 | | 362277 | 93356 | | 362355 | 93210 | | 362356 | 93211 | | 362362 | 93212 | +----------+----------+ 20 rows in set (0.14 sec) }}} i looked into each batch and I can't find that stupid objid... Where is it coming from?? i plotted ra dec of the -999 objects, see here: [[Image(canvassas.png)]] === ndetections = very large number === example: === ndetections != ng + nr + ni + nz + ny === example: