IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 9 and Version 10 of IPP_Progress_Report_20110418


Ignore:
Timestamp:
Apr 25, 2011, 3:57:58 PM (15 years ago)
Author:
rhenders
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • IPP_Progress_Report_20110418

    v9 v10  
    2626Lots of progress, and a major setback, getting stacks into PSPS this week. Still lots to do before Boston.
    2727
    28  * Finished remaining development work for stack batches:
    29   * questions about how to populate PSPS flux columns: Jim and Gene settled on a solution and I implemented it in code
    30   * numerous schema changes
    31   * work on GPC1 queries to list available stacks, get contributing OTAs for each
    32   * new temp Db table to store meta data from DVO, eg flags, photcode etc
    33   * redesigned ippToPsps database to keep track of batch types, processing, whether they are loaded or merged etc
    34   * fixed issue of !NaNs in fits headers not writing to database
    35   * changes to lots of SQL due to Heather's changes in gpc1 addRun table
    36   * now performing clean-up in Db before export to FITS, i.e. removing NULL objIDs, NULL fluxes etc
     28* Finished remaining development work for stack batches:
     29 * questions about how to populate PSPS flux columns: Jim and Gene settled on a solution and I implemented it in code
     30 * numerous schema changes
     31 * work on GPC1 queries to list available stacks, get contributing OTAs for each
     32 * new temp Db table to store meta data from DVO, eg flags, photcode etc
     33 * redesigned ippToPsps database to keep track of batch types, processing, whether they are loaded or merged etc
     34 * fixed issue of !NaNs in fits headers not writing to database
     35 * changes to lots of SQL due to Heather's changes in gpc1 addRun table
     36 * now performing clean-up in Db before export to FITS, i.e. removing NULL objIDs, NULL fluxes etc
    3737
    38  * Successfully tested loading and merging of new stack batches. Problems encountered:
    39   * missing tables: !SkinnyObject, !ObjectCalColor in stack batches. Added these to code.
    40   * NULLs sneaking in to new 'updated' column in Object table: we had forgotten to add a default. Changed schema
    41   * crazy -999 "NULL"s don't fit in byte field and so broke load. Fixed
    42   * merge stage was expecting all contributing images for the stack to be loaded already. Sue fixed this.
     38* Successfully tested loading and merging of new stack batches. Problems encountered:
     39 * missing tables: !SkinnyObject, !ObjectCalColor in stack batches. Added these to code.
     40 * NULLs sneaking in to new 'updated' column in Object table: we had forgotten to add a default. Changed schema
     41 * crazy -999 "NULL"s don't fit in byte field and so broke load. Fixed
     42 * merge stage was expecting all contributing images for the stack to be loaded already. Sue fixed this.
    4343
    44  * DVO speed issue
    45   * encountered a serious DVO speed issue with the new MD04 database. Way too slow for us to load enough before Boston
    46   * formed plan to pull everything we need into a MySQL database for quicker, easier access
    47   * started work coding this
     44* DVO speed issue
     45 * encountered a serious DVO speed issue with the new MD04 database. Way too slow for us to load enough before Boston
     46 * formed plan to pull everything we need into a MySQL database for quicker, easier access
     47 * started work coding this
    4848
    4949* the solution to the above DVO problem means my new code needs to produce detections, so:
    50  * lots of work filling in the last missing fields
     50 * lots of work filling-in the last missing fields
    5151 * porting GPC1 access methods in Jython code
    5252 * laboriously comparing the output with that of the old code to verify nothing has been lost along the way