| | 25 | |
| | 26 | Lots of progress, and a major setback, getting stacks into PSPS this week. Still lots to do before Boston. |
| | 27 | |
| | 28 | * Finished remaining development work for stack batches: |
| | 29 | * questions about how to populate PSPS flux columns: Jim and Gene settled on a solution and I implemented it in code |
| | 30 | * numerous schema changes |
| | 31 | * work on GPC1 queries to list available stacks, get contributing OTAs for each |
| | 32 | * new temp Db table to store meta data from DVO, eg flags, photcode etc |
| | 33 | * redesigned ippToPsps database to keep track of batch types, processing, whether they are loaded or merged etc |
| | 34 | * fixed issue of NaNs in fits headers not writing to database |
| | 35 | * changes to lots of SQL due to Heather's changes in gpc1 addRun table |
| | 36 | * now performing clean-up in Db before export to FITS, i.e. removing NULL objIDs, NULL fluxes etc |
| | 37 | |
| | 38 | * Successfully tested loading and merging of new stack batches. Problems encountered: |
| | 39 | * missing tables: SkinnyObject, ObjectCalColor in stack batches. Added these to code. |
| | 40 | * NULLs sneaking in to new 'updated' column in Object table: we had forgotten to add a default. Changed schema |
| | 41 | * crazy -999 "NULL"s don't fit in byte field and so broke load. Fixed |
| | 42 | * merge stage was expecting all contributing images for the stack to be loaded already. Sue fixed this. |
| | 43 | |
| | 44 | * DVO speed issue |
| | 45 | * encountered a serious DVO speed issue with the new MD04 database. Way too slow for us to load enough before Boston |
| | 46 | * formed plan to pull everything we need into a MySQL database for quicker, easier access |
| | 47 | * started work coding this |
| | 48 | |
| | 49 | * the solution to the above DVO problem means my new code needs to produce detections, so: |
| | 50 | * lots of work filling in the last missing fields |
| | 51 | * porting GPC1 access methods in Jython code |
| | 52 | * laboriously comparing the output with that of the old code to verify nothing has been lost along the way |
