IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 622 and Version 623 of MD.GR0


Ignore:
Timestamp:
Feb 6, 2013, 2:24:01 PM (13 years ago)
Author:
Mark Huber
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • MD.GR0

    v622 v623  
    5757 * 01/09/13 [wiki:MD07.refstack.20130102] to replace 2011 season refstack
    5858 * 01/14 re-running all staticsky+skycal stack photometry on ref+deepstack to incorporate improvements/fixes to Kron code for loading into PSPS soon
    59  * 01/28 finished staticsky+skycal version except for MD03,05 which are blocked by disk upgrade/permission issues
     59 * 01/28 finished revised staticsky+skycal version except for MD03,05 which are blocked by disk upgrade/permission issues
    6060
    6161
    … …  
    139139== Chip+Warp ==
    140140Currently processed but not distributed due to disk space load. Can be obtained via the Postage Stamp Server.
    141  * can be a mix of synthetic/ubercal catalog calibrations
     141 * can be a mix of synthetic/ubercal catalog calibrations except MD08, 09
    142142
    143143== Camera/SMFs ==
    144144Fully processed and distributed.
    145  * can be a mix of synthetic/ubercal catalog calibrations
     145 * can be a mix of synthetic/ubercal catalog calibrations except MD08, 09
    146146
    147147
    … …  
    156156 * out-of-season/anti-yearly refstacks, yearly refstack: on hold for MD.GR1 (would need to update/reprocess large numbers of exposures to do)
    157157
    158 __Deep Stacks (deeptest)__: Not a full production product yet. MD04 and MD09 have deep test samples so far.
     158__Deep Stacks (deeptest)__: Not a full production product yet. Test version exists for MD02.iqtest.20120927, MD10.psfrefstack.20110814.
    159159
    160160 
    161 __IQ/PSF Stack__: on hold for MD.GR1 (like out-of-season, would required many updates). A sample for MD09 done but requires development/code time.
     161__IQ/PSF Stack__: on hold until MD.GR1 (like out-of-season, would required many updates). A sample for MD09 done but requires development/code time.
    162162
    163163
    … …  
    168168
    169169== Stack Photometry (Static Sky + Skycal) ==
    170 Static sky (stack) photometry and recalibration (skycal) is run on refstacks, deepstacks and nightly stacks. In trying to run as a uniform group, will keep a summary of info here, but details like specific faults, poor quality etc will be in the respective MD section. For example some skycells can have a clear offset fix to the zeropoint, not actually set to 25.0 in stack.  There appears to be upwards of 3-5% error likely in the photometry across the FPA (see [wiki:MD.GR0#MD09.GR0]).
     170Static sky (stack) photometry and recalibration (skycal) is run on refstacks, deepstacks and nightly stacks. In trying to run as a uniform group, will keep a summary of info here, but details like specific faults, poor quality etc will be in the respective MD section. For example some skycells can have a clear offset fix to the zeropoint, not actually set to 25.0 in stack pixels, sometimes the majority of the field is off from zeropoint of 25.  There appears to be upwards of 3-5% error likely in the photometry across the FPA (see [wiki:MD.GR0#MD09.GR0]) even in the recalibration of the stack photometry (skycal stage).
    171171
    172172 * '''recalibration of the stack photometry catalogs has no method for distribution''' -- email for access
    … …  
    175175Current run planned for loading into PSPS (January 2013): stack photometry (staticsky) re-run from Summer 2012 set to incorporate improvements/fixes in the Kron code. Photometry zeropoint recalibration (skycal) re-run to incorporate various bug fixes and improved tuning (psastro running on stack catalogs). Several previous re-runs for skycal and settled on .cal20130128 version for now.
    176176
    177  * ref stack label, data_groups: includes 5-1 filter sets now under same label, staticksky data_group will indicate <N> for # filters attempted, skycal data_group will include all under 1 data_group
     177 * ref stack label, data_groups: includes 5-1 filter sets now under same label, staticksky data_group will indicate <N> for # filters attempted, skycal data_group will include all under one data_group
    178178{{{
    179 label staticsky:  MD09.refstack.20120831.Nx20130115
     179label staticsky:  MD09.refstack.20120831.Nx20130115 -- run on refstack data_group MD09.refstack.20120831, label for active refstacks is changed to MD<##>.refstack generically
    180180data_group staticsky:  MD09.refstack.20120831.<N>x20130115 -- <N> = 1,2,3,4,5 and number of filters available for the set, so 5 different data_group per MD
    181181label=data_group skycal:  MD09.refstack.20120831.Nx20130115.cal20130128 -- all N filter set is run under one data_group now per MD
    … …  
    185185label=data_group skycal:  MD04.refstack.20111012.Nx20130115.cal20130128
    186186
    187 label staticsky:  MD10.refstack.20110821.Nx20130115  (new refstack replacing MD.GR0 version since deeper)
    188 data_group staticsky: MD10.refstack.20110821.<N>x20130115 
    189 label=data_group skycal:  MD10.refstack.20110821.Nx20130115.cal20130128
    190 
    191 label staticsky:  MD01.refstack.20120803.Nx20130115  (new refstack replacing MD.GR0 version since deeper) -- skycal label=data_group, add .cal20130128
    192 label staticsky:  MD02.refstack.20120927.Nx20130115  (new refstack replacing MD.GR0 version since deeper) -- skycal label=data_group, add .cal20130128
     187label staticsky:  MD10.refstack.20120804.Nx20130115   (new refstack MD10.refstack.20110821, see [wiki:MD10.refstack.20120705], is deeper and replacing MD.GR0 version MD10.refstack.20110821)
     188data_group staticsky: MD10.refstack.20120804.<N>x20130115 
     189label=data_group skycal:  MD10.refstack.20120804.Nx20130115.cal20130128
     190
     191label staticsky:  MD01.refstack.20120803.Nx20130115  (new refstack [wiki:MD01.refstack.20120803] replacing MD.GR0 version since deeper) -- skycal label=data_group, add .cal20130128
     192label staticsky:  MD02.refstack.20120927.Nx20130115  (new refstack [wiki:MD02.refstack.20120927] replacing MD.GR0 version since deeper) -- skycal label=data_group, add .cal20130128
    193193label staticsky:  MD03.refstack.20111010.Nx20130115 -- **** stalled while file permissions messed up ****
    194194label staticsky:  MD05.refstack.20111014.Nx20130115 -- **** stalled while file permissions messed up ****
    … …  
    275275|| '''MD''' || '''Reference Stack''' || '''Deep Stack''' || '''Night Stack''' || '''Refstack Phot''' || '''Deep Phot''' || '''Night Phot''' || '''Camera/SMFs'''  || '''for PSPS''' ||
    276276|| || || || || || || || || ||
    277 || 01 || 20110820 (U) || X || done (mixed) || staticsky+skycal 20120805 || x || x || done (mixed) || SMF+ref phot ''TBD'' ||
     277|| 01 || 20110820 (U) || X || done (mixed) || MD01.refstack.20120803.Nx20130115, .cal20130128 || x || x || done (mixed) || SMF+ref phot ''TBD'' ||
    278278|| 02 || 20110907 (U) || X || done (mixed) || staticsky+skycal 20120805 || x || x || done (mixed) || SMF+ref phot ''TBD'' ||
    279279|| 03 || 20111010 (U) || X || done (mixed) || staticsky+skycal 20120805 || x || x || done (mixed) || SMF+ref phot ''TBD'' ||
    280 || 04 || 20111012 (U) || deeptest.20120727 || done || staticsky+skycal 20120805 || staticsky+skycal 20120806  || TBD || done || SMF+ref+deep+night phot ''TBD'' (secondary) ||
     280|| 04 || 20111012 (U) || deeptest.20120727 || done || staticsky+skycal 20120805 || staticsky+skycal 20120806  || ''TBD'' || done || SMF+ref+deep+night phot ''TBD'' (secondary) ||
    281281|| 05 || 20111014 (U) || X || done (mixed+full) || staticsky+skycal 20120805 || x || x || done (mixed) || SMF+ref phot ''TBD'' ||
    282282|| 06 || 20111122 (U) || X || done || staticsky+skycal 20120805 || x || x || done || SMF+ref phot ''TBD'' ||
    … …  
    285285|| 09 || 20120831 (R) || deeptest.20120727 || done  || staticsky+skycal 20120805 || staticsky+skycal 20120806  || done || done || SMF+ref+deep+night phot  (primary) ||
    286286|| 10 || 20110821 (U) || X || done || staticsky+skycal 20120805 || x || x || done || SMF+ref phot ''TBD'' ||
    287 || 11 || not to be reprocessed in MD.GR0
     287|| 11 || not reprocessed in MD.GR0
    288288|| || || || || || || || || ||
    289289|| || || || || || || || || ||
    290290|| || || || || || || || || ||
    291291|| M31 ||  briefly discussed, but likely no
    292 || STS  || briefly discussed, but likely no  ||  20120531 (MOPS needs revision) ||  X  || ?  || ?  ||  ? || ?  || ?  || ? ||
     292|| STS  also likely no  ||  20120531 (MOPS needs revision) ||  X  || ?  || ?  ||  ? || ?  || ?  || ? ||
    293293|| || || || || || || || ||
    294294
    295295__Notes__:
    296  * TBD=To Be Done/Decided by priority, X=not planned,  ?=unknown at this time
     296 * TBD=To Be Decided/Done by priority, X=not planned,  ?=unknown at this time
    297297 * 20YYMMDD date entries are part of the data_group name to access via the PSS or Datastore, i.e.,
    298   * MD01.refstack.20110820, MD09.deeptest.20120727 stacks
    299   * staticsky and skycal respectively
    300  * (U) updated -- new 2012/2013 versions exist for these refstack now (see [wiki:MediumDeepFields] but not necessarily used with staticsky/skycal for loading into PSPS (original MD.GR0 may be deeper and better to use)
    301  * (R) replaced -- MD09.refstack.20120603,
    302  * finish reprocessing all exposures to V3 for warp/nightly stack for MD01+02+03+05 =840+609+1286+1115 = 3850 (2-3 full days of --only-- MD processing) -- done
    303   * MD05 mixed -- old and new processing, so magic mix and photometry catalog mix. see specific section for detail.
    304   *
     298  * stacks -- MD01.refstack.20110820, MD09.deeptest.20120727
     299  * night stacks a mix of label, data_group formats -- see specific section
     300  * stack photometry -- originally the same date 20120805, but revised runs now have dates for each in the form staticsky x20YYMMMDD and skycal cal20YYMMDD
     301 * (U) updated -- new 2012/2013 versions exist for these refstack now (see [wiki:MediumDeepFields] but not necessarily used with staticsky/skycal for loading into PSPS (original MD.GR0 may be deeper and better to use). Newer refstack used is indicated in the Stack Photometry column
     302 * (R) replaced -- MD09.refstack.20120603 replaced by 20120831 due to variance problems.
     303 * (mixed), (full)
     304  * finish reprocessing all exposures to V3 for warp/nightly stack for MD01+02+03+05 =840+609+1286+1115 = 3850 (2-3 full days of --only-- MD processing) -- finished 12/30/13
     305  * (mixed) -- both camera/SMF and night stacks can have calibrations based on the synthetic catalogs (initial sample run) and ubercal catalogs (finish V3 run).  See specific section for detail.
     306  * MD05 (mixed+full) -- some older and newer processing, so mix of magic and photometry catalog used and then a re-reprocessing of MD05 was done on the exposures originally processed with synthetic catalog. See [wiki:MD.GR0#MD05.GR0extrareprocessedsetwithallubercalcatalog]
    305307 * stacks
    306308  * out-of-season/anti-yearly refstacks, yearly refstack: on hold for MD.GR1 (would need to update/reprocess large numbers of exposures to do).
    307   * iq/psf stack on hold for MD.GR1 (like out-of-season, would required many updates) -- should do for MD04,MD09 and requires development/code time.
    308   * deep stack for MD04,09 for MD.GR0 only, all others on hold for MD.GR1 (many many updates..).
     309  * iq/psf stack on hold until MD.GR1 (like out-of-season, would required many updates) -- should do for MD04,MD09 and requires development/code time.
     310  * deep stack for MD04,09 for MD.GR0 only, all others on hold until MD.GR1 (many many updates..).
    309311 * reminder that ubercal of pixels start with MD08 in the date sequence, finished processing of MD01,02,03,05 exposures into V3 will also be ubercal'd (including reprocessing of any needed to make the complete nightly stacks)
     312 
     313
    310314
    311315__Questions__: