IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 2 and Version 3 of ippReleaseManagement


Ignore:
Timestamp:
Sep 20, 2012, 3:22:15 PM (14 years ago)
Author:
bills
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • ippReleaseManagement

    v2 v3  
    2525 * DVO catalogs
    2626
    27 The data is the results of runs through the various stages of the IPP pipeline. For the most part the IPP does not have a very good record of which data went into the various releases. For example given a single frame detection in the IPP database, there is no direct method to determine which version of the processed pixels the detections were measured on. Making the answer to this and other similar questions easy to obtain is the primary purpose of this
     27The data is the results of runs through the various stages of the IPP pipeline. For the most part the IPP does not have a very good record of which data went into the various releases. For example, given a single frame detection in the IPP database, there is no direct method to determine which version of the processed pixels the detections were measured on. Making the answer to this and other similar questions easy to obtain is the primary purpose of this
    2828project.
    2929
     
    7070We currently have no way of tracking which of the various processing runs are intended for end user use
    7171and those that are the results of testing. The postage stamp server currently attempts to work around this
    72 problem but the results have been mixed. By specifically identifying the data that should be released this
    73 problem will be solved.
    74 
     72problem but the results have been mixed. By specifically identifying the data that should be released it
     73will be easy to indentify those runs that should not be released as well.
    7574
    7675=== Stacked Images ===
     
    9796Management of difference images is a subject for further research and will be discussed later.
    9897
     98== Definition of an IPP release ==
     99
     100A collection of data "released" to the PS1SC community will be represented in the IPP database by a row
     101in 2 new tables called "ippRelease" and "survey". Here are the proposed definitions
     102
     103{{{
     104mysql> describe survey;
     105+-------------+--------------+------+-----+---------+-------+
     106| Field       | Type         | Null | Key | Default | Extra |
     107+-------------+--------------+------+-----+---------+-------+
     108| surveyID    | tinyint(8)   | NO   | PRI | 0       |       |
     109| name        | varchar(16)  | YES  | MUL | NULL    |       |
     110| description | varchar(255) | YES  |     | NULL    |       |
     111+-------------+--------------+------+-----+---------+-------+
     1123 rows in set (0.00 sec)
     113
     114mysql> describe ippRelease;
     115+-------------+-------------+------+-----+---------+----------------+
     116| Field       | Type        | Null | Key | Default | Extra          |
     117+-------------+-------------+------+-----+---------+----------------+
     118| rel_id      | smallint(6) | NO   | PRI | NULL    | auto_increment |
     119| surveyID    | tinyint(8)  | YES  | MUL | NULL    |                |
     120| releaseName | varchar(16) | YES  | MUL | NULL    |                |
     121| state       | varchar(16) | YES  | MUL | NULL    |                |
     122| dataRelease | tinyint(8)  | YES  |     | NULL    |                |
     123+-------------+-------------+------+-----+---------+----------------+
     1245 rows in set (0.00 sec)
     125}}}
     126
     127The survey table is a copy of the PSPS table Survey. Example entries are
     128
     129{{{
     130+----------+------+------------------------------------+
     131| surveyID | name | description                        |
     132+----------+------+------------------------------------+
     133|        0 | 3PI  | PS1 3PI Survey                     |
     134|        1 | MD01 | PS1 MD01 XMM-LSS-DXS 022224-043000 |
     135+----------+------+------------------------------------+
     136}}}
     137
     138The columns in ippRelease are
     139 * rel_id primary key for the row
     140 * surveyID for to the survey that the data in a particular release contains
     141 * releaseName - human friendly identifier for the release
     142 * state - current status of the release. Several values have been identified
     143   * active - results for the release are currently available to the community
     144   * pending - release identified, construction may have begun, but the data is not yet ready to be available by default
     145   * archive - the release contains the results of a previous processing of the data that has been superseded.
     146 * dataRelease - If not null, the dataRelease value in the corresponding PSPS tables.
     147
     148{{{
     149+--------+----------+-------------+---------+-------------+
     150| rel_id | surveyID | releaseName | state   | dataRelease |
     151+--------+----------+-------------+---------+-------------+
     152|      1 |        0 | 3PI.nightly | active  |        NULL |
     153|      2 |        0 | 3PI.GR0     | active  |           0 |
     154|      3 |        0 | 3PI.GR1     | pending |           1 |
     155|      4 |        0 | SAS.V8      | archive |           8 |
     156|      5 |        0 | SAS.V9      | active  |           9 |
     157+--------+----------+-------------+---------+-------------+
     158}}}
    99159
    100160
     
    109169
    110170
    111 
    112 
    113 
    114