IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 59 and Version 60 of MD.PV2.deepstack.20130506


Ignore:
Timestamp:
Sep 12, 2014, 4:42:11 PM (12 years ago)
Author:
Mark Huber
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • MD.PV2.deepstack.20130506

    v59 v60  
    1 = Summary for MD.PV2.deepstack.20130506 (updates in progress) =
     1= Summary for MD.PV2.deepstack.20130506 =
    22[[PageOutline]]
    33
    … …  
    1515The processing sequence will be MD04, MD09, then continue in some order to finish as many as possible before the PS1SC@STSCI meeting at the end of June. This is being done to provide a comparison to recent pre-PV2 sample ([wiki:MD04.pv2_stacktest.20130903], [wiki:MD09.PV1_deepstack_tests]) as some possibly significant changes have been made.
    1616 * pixel rejection bug fixes and config modifications [wiki:MDdeeptest_pixrej_20140403]
    17  * PSPS loading of MD04 (April 2014) was for the alldeeptest example ([wiki:MD04.pv2_stacktest.20130903#All]) while the normal deep stacks will have cuts imposed, but both will have similar numbers of inputs (within ~100) to provide comparison such as if the early, questionable (2009/2010) data is a problem or not
     17 * PSPS loading of MD04 (April 2014) was for the alldeeptest example ([wiki:MD04.pv2_stacktest.20130903#All]) while the normal deep stacks will have cuts imposed. Both types of stacks will have similar numbers of inputs (within ~100) due to the alldeeptest done before the end of the survey. A comparison to do is to look at if the early, questionable (2009/2010) data is a problem or not, and so if it can be used in the stack (alldeeptest will include it, PV2 deep stack will not).
    1818 * staticsky and possibly skycal changes (i.e., MD04 has had a gross offset at least in i-band)
    1919
    20 '''need to add detail of change for MD05,06,01,02,03 when switching to the MD.PV3 tag for making the stacks only''' and also note all stack photometry uses PV3 tag
     20
     21The stack processing changed from a early-PV3 (ipp-20140506) to a later-PV3 (ipp-pv3-20140616) tag starting with MD05.
     22 * MD04, 09, 10, 08, 07 used the early-PV3 (ipp-20140506) tag with all the improvements and pixel rejection ([wiki:MDdeeptest_pixrej_20140403])
     23 * MD05, 06, 01, 02, 03 used the later-PV3 (ipp-pv3-20140616) tag that included a bscale offset correction to the input PV2 warps in order to remove the artificial background.
     24 * the final stack photometry being loaded into the PSPS (e.g., MD04.pv2.deepstack.20140506.Nx20140710sv2.cal20140719n150) used the later-PV3 tag with improvements for the recalibration
     25
    2126
    2227As was decided for the past deep test stacks, '''basic cuts will be used''' to exclude poorer data (contribute less in weighted stacks, potential for more junk, waste resources) -- likely will add summary plots on analysis page for these params for revision --
    … …  
    3338 * __datastore__: full image/pixel bundles, staticsky and skycal stack photometry
    3439  * ps1-md-deepstack -- these current full PV2 image/pixel bundles
    35   * ps1-md-staticsky -- staticsky and skycal stack photometry catalog bundles (
     40  * ps1-md-staticsky -- staticsky and skycal stack photometry catalog bundles
    3641  * ps1-md-deeptest -- image/pixel bundles for previous deep stack test versions, including the MD04 with 2009/2010 data [wiki:MD04.pv2_stacktest.20130903]
    3742
    3843 * __PSS__: selected desired image/pixels
    3944  * use the label/data_group for the desired stack
    40   * the current label/data_group name in preparation for loading into PSPS and having the best zeropoint calibration
    41 {{{
    42 MD01.pv2.deepstack.20140620.recal20140722
    43 
     45  * the current label/data_group name in preparation for loading into PSPS and having the best zeropoint calibration (corresponding to the *n150 skycal label/data_group)
     46{{{
     47MD01.pv2.deepstack.20140630.recal20140719psps
     48MD02.pv2.deepstack.20140707.recal20140719psps
     49MD03.pv2.deepstack.20140715.recal20140719psps
     50MD04.pv2.deepstack.20140506.recal20140719psps
     51MD05.pv2.deepstack.20140616.recal20140719psps
     52MD06.pv2.deepstack.20140624.recal20140719psps
     53MD07.pv2.deepstack.20140605.recal20140719psps
     54MD08.pv2.deepstack.20140529.recal20140719psps
     55MD09.pv2.deepstack.20140512.recal20140719psps
     56MD10.pv2.deepstack.20140520.recal20140719psps
    4457}}}
    4558
    … …  
    4861'''Any problems and/or issues need to be identified quickly so that changes can be made before too many MD stacks are made.'''
    4962 * skycell loss due to quality issue will be unresolved for PV2 deep stacks
    50  * background bias/offset -- two versions and still not fully corrected '''(more description needed here)'''
    51  * stack photometry -- skycal zeropoints, staticsky format, refcat problems -- big mess, '''path forward currently unclear'''
     63 * background bias/offset -- two versions and still possibly not fully corrected for with the bscale offset correction to the PV2 warps
     64 * stack photometry -- skycal zeropoints, staticsky format, refcat problems -- was big mess --
    5265 *
    5366
    5467
    55 Similar to GR0 there will be a summary for each field, but unlike GR0, will try and keep analysis and issues to other pages to reduce the length and load time for this summary page.
    56 
    57 
    58 Status:
     68Similar to GR0 there will be a summary for each field, but unlike GR0, will try and keep analysis and issues to other pages (if time to produce) to reduce the length and load time for this summary page.
     69 * example 5-sig point source depths ~25.85, 25.7, 26.0, 25.5, 24.05 for grizy respectively in MD07 with roughly typical number of input warps (431, 432, 611, 666, 529)
     70 * FWHM?
     71
     72
     73___Status:___
    5974 * '''prior to 2014''' -- several issues being worked out for PV2 and stacks (e.g., [wiki:MD04.pv2_stacktest.20130903],[wiki:MDdeeptest_pixrej_20140403])
    6075 * '''5/6''' -- MD04.pv2.deepstack.20140506 started using new tag '''ipp-20140506'''
    … …  
    8196 * '''7/20''' -- all MD.pv2 deep stack on datastore, stack photometry using previous PS1_SV2 format for loading into PSPS with new refcat (20140713) and improved skycal finished and on to datastore, updates to make all available in PSPS-PSS in progress
    8297 * '''7/22''' -- another config error, new skycal produced for all fields to be loaded into PSPS and datastore -- MD%.pv2.deepstack.<rundate>.Nx<rundate>sv2.cal20140722n150
     98 * '''finished'''
    8399
    84100
    … …  
    88104
    89105PV2 camera & warps -- PV2 warps are not cleaned up and will also be a accessible via the PSS/PSPS interface more quickly (release name MD04.PV2).
    90  * label: MD04.pv2.20130903
     106 * label: '''MD04.pv2.20130903'''
    91107
    92108PV2 deep stack:
    … …  
    104120  * MD04.pv2.deepstack.20140506.Nx20140616.cal20140704 -- rerun again to fix PV3 tag missing code.. refcat (20140605) bad so must be redone
    105121  * MD04.pv2.deepstack.20140506.Nx20140710sv2.cal20140710 -- test sample for PS1_SV2 for PSPS loading, bad refcat (20140605) and '''must be redone again..'''
    106   * MD04.pv2.deepstack.20140506.Nx20140710sv2.cal20140719n150 -- PV3 tag but older PS1_SV2 format with new fixed refcat (20140713) and improved ZPT config for PSPS
     122  * '''MD04.pv2.deepstack.20140506.Nx20140710sv2.cal20140719n150''' -- PV3 tag but older PS1_SV2 format with new fixed refcat (20140713) and improved ZPT config for PSPS
    107123
    108124
    … …  
    150166|  3328627 | MD04.pv2.deepstack.20140506 | z.00000 | skycell.082 | full  |    3006 |            12 |            220 |  0.171084 |
    151167}}}
    152  * poor pixels/regions -- more need to be listed still --
     168 * poor pixels/regions -- more need to be listed still (by request) -- as an example of likely issues in any of the MD fields as well
    153169{{{
    154170--> s012g +-streak@4108,6246 -- also s22 (same source?)
    … …  
    173189
    174190PV2 camera & warps -- PV2 warps are not cleaned up and will also be a accessible via the PSS/PSPS interface more quickly (release name MD09.PV2).
    175  * label: MD09.pv2.20131030
     191 * label: '''MD09.pv2.20131030'''
    176192
    177193PV2 deep stack:
    … …  
    185201  * MD09.pv2.deepstack.20140512.Nx20140618.cal20140618 -- extensions empty, code missing in PV3..
    186202  * MD09.pv2.deepstack.20140512.Nx20140618.cal20140704 -- rerun to fix PV3 tag missing code.. refcat (20140605) bad so must be redone
    187   * MD09.pv2.deepstack.20140512.Nx20140711sv2.cal20140719n150 -- PV3 tag but older PS1_SV2 format with new fixed refcat (20140713) and improved ZPT config for PSPS
     203  * '''MD09.pv2.deepstack.20140512.Nx20140711sv2.cal20140719n150''' -- PV3 tag but older PS1_SV2 format with new fixed refcat (20140713) and improved ZPT config for PSPS
    188204
    189205
    … …  
    229245}}}
    230246
    231  * poor pixels/regions need to be listed
     247 * poor pixels/regions need to be listed (by request)
    232248
    233249
    … …  
    291307|  3357532 | MD10.pv2.deepstack.20140520 | i.00000 | skycell.028 | full  |    3006 |            27 |            256 |  0.177312 |
    292308}}}
    293  * poor pixels/regions need to be listed
     309 * poor pixels/regions need to be listed (by request)
    294310
    295311 * clear improvements with the pixel rejection issues noted in [wiki:MD10.refstack.20130715]
    … …  
    353369|  3361456 | MD08.pv2.deepstack.20140529 | i.00000 | skycell.087 | full  |    3012 |            22 |            291 |  0.192575 |
    354370}}}
    355  * poor pixels/regions need to be listed
     371 * poor pixels/regions need to be listed (by request)
    356372
    357373
    … …  
    428444|  3361840 | MD07.pv2.deepstack.20140605 | z.00000 | skycell.086 | full  |    3012 |            10 |            306 |  0.172942 |
    429445}}}
    430  * poor pixels/regions need to be listed
     446 * poor pixels/regions need to be listed (by request)
    431447
    432448
    … …  
    490506}}}
    491507
    492  * poor pixels/regions need to be listed
    493 
    494 
    495 
    496 ''(need to load into release system when finished)''
     508 * poor pixels/regions need to be listed (by request)
     509
     510
     511
    497512
    498513----
    … …  
    544559Problems:
    545560 * none have quality issue
    546  * poor pixels/regions need to be listed
    547 
    548 
    549 
    550 ''(need to load into release system when finished)''
     561 * poor pixels/regions need to be listed (by request)
     562
     563
     564
     565
    551566
    552567----
    … …  
    597612Problems:
    598613 * none have quality issue
    599  * poor pixels/regions need to be listed
    600 
    601 
    602 
    603 ''(need to load into release system when finished)''
     614 * poor pixels/regions need to be listed (by request)
     615
     616
    604617
    605618
    … …  
    653666
    654667Problems:
    655  * poor pixels/regions need to be listed
    656 
    657 
    658 
    659 ''(need to load into release system when finished)''
     668 * poor pixels/regions need to be listed (by request)
     669
     670
     671
    660672
    661673
    … …  
    677689  * MD03.pv2.deepstack.20140715.Nx20140719sv2 -- improved PV3 tag but with PS1_SV2 older format for loading into PSPS
    678690 * skycal label/data_group:
    679   * MD03.pv2.deepstack.20140715.Nx20140719sv2.cal20140719n150 -- older PS1_SV2 format with new fixed refcat (20140713) and improved ZPT config for PSPS
     691  * '''MD03.pv2.deepstack.20140715.Nx20140719sv2.cal20140719n150''' -- older PS1_SV2 format with new fixed refcat (20140713) and improved ZPT config for PSPS
    680692
    681693
    … …  
    720732
    721733
    722 ''(need to load into release system when finished)''
    723 
    724 
    725 
    726 
    727 ----
    728 
    729 
    730 
    731 
     734
     735
     736
     737----
     738
     739
     740
     741