IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 616 and Version 617 of MD.GR0


Ignore:
Timestamp:
Feb 5, 2013, 6:09:23 PM (13 years ago)
Author:
Mark Huber
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • MD.GR0

    v616 v617  
    55(back to [wiki:MediumDeepFields] summary)
    66
    7 Summary page of information for the MD GR0 (grand reprocessing version 0) including the new reference stack in the V3 tessellation with the start of new observations of MD10 in OC142. This is version 0 as the test start of full reprocessing of the MD fields to be balanced along with other reprocessing, 3PI stacks and nightly science, generation of new reference stacks. A new ubercal reference catalog (PS1.REF.20120325) is available and applies only to MD08, MD09 uses REF.20120524, all others (MD10, 01, 02, 03, 04, 05, 06, 07) use the original synthetic catalog.
    8 
    9 Creation of the new reference stacks need to be, at the very least, made prior to the return to the particular MD field given in the current schedule
     7Summary page of information for the MD GR0 (grand reprocessing version 0) including the new reference stacks in the V3 tessellation with the start of new MD10 observations in OC142 (August 2012). This is version 0, the first start of full reprocessing of the MD fields and must be balanced along with other reprocessing, 3PI stacks, nightly science, generation of new reference stacks etc. The new ubercal reference catalog were available starting with MD08 (with PS1.REF.20120325) and MD09 (with a revised REF.20120524), but all others (MD10, 01, 02, 03, 04, 05, 06, 07) were ''originally'' processed using the original synthetic catalog.  MD01,02,03,05 were not fully reprocessed originally due to various problems, so those fields will have a mix of exposures calibrated with different catalogs. There has continued to be limited reprocessing of MD exposures in order to create new refstacks for the season so there can be exposures with multiple reprocessed versions.
     8
     9
     10Creation of the new reference stacks need to be, at the very least if possible, made a week prior to the return to the particular MD field given in the current schedule
    1011http://ps1sc.ifa.hawaii.edu/PS1wiki/index.php/Medium_Deep_Schedule. After the July, August, September time crunch of a new field a month, there should be time to continue reprocessing and creation of new reference stacks in advance.
    1112
    … …  
    2122 * ''12/20/11'' MD06 processing recoverable, refstacks proceeding.  MD08 a mess and will need to be re-run.
    2223 * ''12/31/11'' MD06 finally finished, distributed.
     24
    2325 * ''1/09/12'' MD08, 09 on hold while finishing up full reprocessing and release of V3 products now (i.e., nightly stacks, SMFs, SSdiffs).
    2426 * ''1/11/12'' MD06,04 full camera SMFs on datastore, MD07 later today. MD04 set has some duplicates with both unmagicked SMFs (data_group=MD04.GR0, sub-sample of ~150/filter best seeing) and magicked SMFs (data_group=condor_MD04.V3_01_dg, full sample of ~400/filter loaded into PSPS Nov. 2011)
    … …  
    4345 * 12/06 [wiki:MD05.refstack.20121202] to replace 2011 season refstack
    4446 * 12/21 [wiki:MD06.refstack.20121221] to replace 2011 season refstack
     47
    4548 * 01/09/13 [wiki:MD07.refstack.20130102] to replace 2011 season refstack
    46  * 01/14 re-running all staticsky+skycal stack photometry on ref+deepstack to incorporate improvements/fixes to Kron code
     49 * 01/14 re-running all staticsky+skycal stack photometry on ref+deepstack to incorporate improvements/fixes to Kron code for loading into PSPS soon
     50 * 01/28 finished staticsky+skycal version except for MD03,05 which are blocked by disk upgrade/permission issues
    4751
    4852
    … …  
    6367 
    6468DRAVG analysis/feedback
    65  * [http://ps1sc.ifa.hawaii.edu/PS1wiki/index.php/DRAVG_telecon#Medium_deep_stacks MD04 number counts]
     69 * [http://ps1sc.ifa.hawaii.edu/PS1wiki/index.php/DRAVG_telecon_2011#Medium_deep_stacks MD04 number counts]
     70 * [http://ps1sc.ifa.hawaii.edu/PS1wiki/index.php/DRAVG_telecon_2012#MD09_issues MD09 issues]
     71 * [http://ps1sc.ifa.hawaii.edu/PS1wiki/index.php/DRAVG_telecon#Medium_Deep_Oddities MD oddities]
     72 * [http://ps1sc.ifa.hawaii.edu/PS1wiki/index.php/DRAVG_telecon#Overdetection_in_the_y-band_MD_stacks MD-y overdetections]
     73 * [http://ps1sc.ifa.hawaii.edu/PS1wiki/index.php/DRAVG_telecon#False_detections_in_the_y-band_MD_stacks MD-y false detections]
     74
     75
    6676
    6777Where to find the data:
    68  * http://datastore.ipp.ifa.hawaii.edu/ps1-md-GR (full, pixel images of reprocessed nightly data products like nightly stacks)
    69  * http://datastore.ipp.ifa.hawaii.edu/ps1-md-GR-cat (cleaned, catalogs of reprocessed nightly data products like camera SMFs)
    70  * http://datastore.ipp.ifa.hawaii.edu/ps1-md-refstack (full, pixel images for updated refstacks and reftest stacks)
    71  * http://datastore.ipp.ifa.hawaii.edu/ps1-md-staticsky (cleaned, new staticsky catalogs run on the refstacks so far)
     78 * http://datastore.ipp.ifa.hawaii.edu/ps1-md-GR/  (full: pixel images of reprocessed nightly data products like nightly stacks)
     79 * http://datastore.ipp.ifa.hawaii.edu/ps1-md-GR-cat/  (cleaned: catalogs of reprocessed nightly data products like camera SMFs)
     80 * http://datastore.ipp.ifa.hawaii.edu/ps1-md-refstack/  (full: pixel images for updated refstacks and reftest stacks)
     81 * http://datastore.ipp.ifa.hawaii.edu/ps1-md-staticsky/  (cleaned: new staticsky catalogs run on the refstacks typically but may have others like from deep stacks)
     82 * http://datastore.ipp.ifa.hawaii.edu/ps1-deeptest/  (full: pixel images of deep stack tests)
     83
     84
    7285= MD.V3 Tessellation =
    73 
    7486The new V3 tessellations are defined at [wiki:PS1_Tessellations] with the following general properties:
    7587
    … …  
    115127== post-Magic January 2012 ==
    116128
     129
    117130= Reprocessed Data Products =
    118 
    119 == Chip/Warp ==
     131Each MD field has a variety of ''issues'' and details are summarized in each MD section.
     132
     133== Chip+Warp ==
    120134Currently processed but not distributed due to disk space load. Can be obtained via the Postage Stamp Server.
     135 * can be a mix of synthetic/ubercal catalog calibrations
    121136
    122137== Camera/SMFs ==
    123138Fully processed and distributed.
    124 
    125 == Nightly Stacks ==
    126 All nights reprocessed and stacked into a nightly stack using the current nightly stack configurations.
     139 * can be a mix of synthetic/ubercal catalog calibrations
     140
     141
     142== Stacks ==
     143__Night Stacks__: All nights reprocessed and stacked into a nightly stack using the current nightly stack configuration used for nightly science nightly stacks when processed, including reference catalog
    127144 * should attempt to make stack with 2 or more input warps now
    128  * some nights have >8 exposures, often in marginal conditions. Choices could/should be made in those cases (need to add details on current settings)
    129 
    130 Each MD has a variety of ''issues'' and details are summarized in each MD section.
     145 * some nights have >8 exposures, often in marginal conditions. Since marginal conditions can vary greatly, some selection should probably be made for inclusion in the nightly stack.
     146 * the sample of stacks can be a mix of synthetic/ubercal catalog calibrations but NOT for the warps going into the stack itself.
     147
     148__Reference Stacks__:
     149
     150
     151__Deep Stacks__:
     152
     153
     154
     155
     156
    131157== Difference Images ==
    132 Need to finish the convolution choice (input stack or reference stack) before started. (Need to outline interests for these if any)
    133 
    134 
    135 == Static Sky + Skycal (stack photometry) ==
    136 
     158Originally a possible reprocessing product, but was decided not useful at this time (for future reprocessing, need to outline interests for these if any). Will need to finish the convolution choice (input stack or reference stack) before started.
     159
     160
     161
     162== Stack Photometry (Static Sky + Skycal) ==
    137163Static sky (stack) photometry and recalibration (skycal) is run on refstacks, deepstacks and nightly stacks. In trying to run as a uniform group, will keep a summary of info here, but details like specific faults, poor quality etc will be in the respective MD section. For example some skycells can have a clear offset fix to the zeropoint, not actually set to 25.0 in stack.  There appears to be upwards of 3-5% error likely in the photometry across the FPA (see [wiki:MD.GR0#MD09.GR0]).
    138164
    139 '''recalibration of the stack photometry catalogs has no method for distribution''' -- email for access
     165 * '''recalibration of the stack photometry catalogs has no method for distribution''' -- email for access
    140166
    141167
    … …  
    242268 * http://ipp.ifa.hawaii.edu/mdgr0_durham2012poster/mdgr0_md07_09_posterdurham2012.pdf
    243269 * for MD10 old/new refstack comparison maps, see [wiki:MD10.refstack.20120705]
     270
    244271
    245272= Summary plan for finishing MD.GR0 through end of 2012  =
    … …  
    320347
    321348 * also initially attempted to include some rough cuts by zeropoint and background (in 20110722) but after reprocessing all exposures wouldn't be included in the stacktool selection based solely on basically FWHM major. (improvements to selection and rejection for a future test)
     349
    322350== MD10.V3 reference stack ==
    323351