Summary for MD.PV2.deepstack.20130506

This is a summary of the MD PV2 deep stack using the PV2 update reprocessing (as started with MD04 in MD04.pv2_stacktest.20130903) for all MD exposures through the end of the survey, April 2014. Because MD.PV2 is an update reprocessing method, there is a mix of photometry from PV1 and PV2 (as tracked by the data_group name summarized in the MD.PV2 wiki page), while the warp pixels used for the stacking is of PV2 quality (using the same processing tag ipp-20130712 as with LAP/3PI).

The processing sequence will be MD04, MD09, then continue in some order to finish as many as possible before the PS1SC@STSCI meeting at the end of June. This is being done to provide a comparison to recent pre-PV2 sample (MD04.pv2_stacktest.20130903, MD09.PV1_deepstack_tests) as some possibly significant changes have been made.

  • pixel rejection bug fixes and config modifications MDdeeptest_pixrej_20140403
  • PSPS loading of MD04 (April 2014) was for the alldeeptest example (MD04.pv2_stacktest.20130903#All) while the normal deep stacks will have cuts imposed. Both types of stacks will have similar numbers of inputs (within ~100) due to the alldeeptest done before the end of the survey. A comparison to do is to look at if the early, questionable (2009/2010) data is a problem or not, and so if it can be used in the stack (alldeeptest will include it, PV2 deep stack will not).
  • staticsky and possibly skycal changes (i.e., MD04 has had a gross offset at least in i-band)

The stack processing changed from a early-PV3 (ipp-20140506) to a later-PV3 (ipp-pv3-20140616) tag starting with MD05.

  • MD04, 09, 10, 08, 07 used the early-PV3 (ipp-20140506) tag with all the improvements and pixel rejection (MDdeeptest_pixrej_20140403)
  • MD05, 06, 01, 02, 03 used the later-PV3 (ipp-pv3-20140616) tag that included a bscale offset correction to the input PV2 warps in order to remove the artificial background.
  • the final stack photometry being loaded into the PSPS (e.g., MD04.pv2.deepstack.20140506.Nx20140710sv2.cal20140719n150, *.cal20140722n150) used the later-PV3 tag with improvements for the recalibration

As was decided for the past deep test stacks, basic cuts will be used to exclude poorer data (contribute less in weighted stacks, potential for more junk, waste resources) -- likely will add summary plots on analysis page for these params for revision --

  • pre-June 2010 exposures fully excluded
    • significant camera change prior 1/2010
    • baffle modifications prior 6/2010
  • ZPT > ZPTave-0.3 (grizy each by mean exposure value)
  • background < (grizy each by mean exposure value) -- TBD if consistent value works for all fields or must be empirically chosen for each field where tail begins
  • elongation < 1.5 (all by exposure value)
  • FWHM < 10 pixels (grizy each by skycell, not by full exposure value)

Data can be found on the datastore and postage stamp server (PSS) and the PSPS --

  • datastore: full image/pixel bundles, staticsky and skycal stack photometry
    • ps1-md-deepstack -- these current full PV2 image/pixel bundles
    • ps1-md-staticsky -- staticsky and skycal stack photometry catalog bundles
    • ps1-md-deeptest -- image/pixel bundles for previous deep stack test versions, including the MD04 with 2009/2010 data MD04.pv2_stacktest.20130903
  • PSS: selected desired image/pixels
    • gpc1 DB and original PSS interfaces use the label/data_group noted above for the desired stack
    • PSI/PSS access -- use the release label/data_group for the desired stack in the pull-down menu of format -- the current label/data_group name in preparation for loading into PSPS and having the best zeropoint calibration (corresponding to the *.cal20140719n150 skycal label/data_group, see PSPS list below)
      MD01.pv2.deepstack.20140630.recal20140719psps
      MD02.pv2.deepstack.20140707.recal20140719psps
      MD03.pv2.deepstack.20140715.recal20140719psps
      MD04.pv2.deepstack.20140506.recal20140719psps
      MD05.pv2.deepstack.20140616.recal20140719psps
      MD06.pv2.deepstack.20140624.recal20140719psps
      MD07.pv2.deepstack.20140605.recal20140719psps
      MD08.pv2.deepstack.20140529.recal20140719psps
      MD09.pv2.deepstack.20140512.recal20140719psps
      MD10.pv2.deepstack.20140520.recal20140719psps
      
  • _PSPS_: loading into old schema format of the deep stack and exposure photometry is in progress (Sept. 2014) -- look for the PV2 labels like PS1_M02_PV2, Medium Deep Field 02 PV2
    • the re-calibrated stack photometry loading into the PSPS is actually a rerun of the *.cal20140719n150 label/data_group in an older catalog format due to backwards compatibility issues. They should be equivalent and both have been distributed
      | MD01.pv2.deepstack.20140630.Nx20140712sv2.cal20140722n150 | 
      | MD02.pv2.deepstack.20140707.Nx20140717sv2.cal20140722n150 |
      | MD03.pv2.deepstack.20140715.Nx20140719sv2.cal20140722n150 | 
      | MD04.pv2.deepstack.20140506.Nx20140710sv2.cal20140722n150 | 
      | MD05.pv2.deepstack.20140616.Nx20140711sv2.cal20140722n150 | 
      | MD06.pv2.deepstack.20140624.Nx20140711sv2.cal20140722n150 | 
      | MD07.pv2.deepstack.20140605.Nx20140711sv2.cal20140722n150 | 
      | MD08.pv2.deepstack.20140529.Nx20140711sv2.cal20140722n150 | 
      | MD09.pv2.deepstack.20140512.Nx20140711sv2.cal20140722n150 | 
      | MD10.pv2.deepstack.20140520.Nx20140711sv2.cal20140722n150 |
      

Any problems and/or issues need to be identified quickly so that changes can be made before too many MD stacks are made.

  • skycell loss due to quality issue will be unresolved for PV2 deep stacks
  • background bias/offset -- two versions and still possibly not fully corrected for with the bscale offset correction to the PV2 warps
  • stack photometry -- skycal zeropoints, staticsky format, refcat problems -- was/is a big mess --

Similar to GR0 there will be a summary for each field, but unlike GR0, will try and keep analysis and issues to other pages (if time to produce) to reduce the length and load time for this summary page.

  • example 5-sig point source depths ~25.85, 25.7, 26.0, 25.5, 24.05 for grizy respectively in MD07 with roughly typical number of input warps (431, 432, 611, 666, 529)
  • FWHM?

_Status:_

  • prior to 2014 -- several issues being worked out for PV2 and stacks (e.g., MD04.pv2_stacktest.20130903,MDdeeptest_pixrej_20140403)
  • 5/6 -- MD04.pv2.deepstack.20140506 started using new tag ipp-20140506
  • 5/12 -- MD09.pv2.deepstack.20140512 started
  • 5/18 -- expect to start next MD10.pv2, then MD05,08,07,06 for the next month or so
  • 5/20 -- MD09 finishing, MD10.pv2.deepstack.20140520 started
  • 5/21 -- MD09 deepstack and skycal to distribution, available via PSS
  • 5/28 -- IPP systems powered down, half+ day delay with incomplete and faulted stacks -- adding possible schedule going into PS1SC@STSCI meeting
  • 5/29 -- start MD08.pv2.deepstack.20140529, stack photometry (staticsky+sky) on MD10
  • 5/30 -- distribute MD10 products
  • 6/5 -- start MD07.pv2.deepstack.20140605
  • 6/6 -- finish stack photometry and distribute MD08 products
  • 6/13 -- MD07 stack and photometry finished, distribute MD07 products. start MD04.pv2.deeptest.20140613 in g+i only to test BSCALE offset fix
  • 6/16 -- revised MD04 stack photometry (staticsky+skycal) run with new tag ipp-pv3-20140616
  • 6/17 -- start MD05.pv2.deepstack.20140616 with new PV3 tag ipp-pv3-20140616 having the BSCALE offset fix
  • 6/18 -- revised MD09,10,08,07 stack photometry (staticsky+skycal) run w/ new tag (ipp-pv3-20140616) started
  • 6/24 -- start MD06.pv2.deepstack.20140624, MD05 stacks and photometry (staticsky+skycal) finished and distributed but ZPT have problem and need to be redone
  • (6/30) -- MD01.pv2.deepstack.20140630 start
  • (7/04) -- all skycal have missing parts and had to be redone again .cal20140704 with updated tag
  • (7/07) -- MD02.pv2.20140707 queued but then system issues have delayed MD01 so won't start for few days
  • 7/10 -- new refcat found to be broken, all skycal may need to be redone again, staticsky format also not compatible with DVO schema 1 and likely all fields will need to be redone again in the older format..
  • 7/11 -- MD01.pv2.20140630 finishes, MD02.pv2.20140707 actually starts processing
  • 7/15 -- MD03.pv2.20140715 started, MD02.pv2.20140707 still running on some slower nodes -- pushing through ASAP and will do uniform stack photometry when finished with new refcat (20140713) if okay
  • 7/20 -- all MD.pv2 deep stack on datastore, stack photometry using previous PS1_SV2 format for loading into PSPS with new refcat (20140713) and improved skycal finished and on to datastore, updates to make all available in PSPS-PSS in progress
  • 7/22 -- another config error, new skycal produced for all fields to be loaded into PSPS and datastore -- MD%.pv2.deepstack.<rundate>.Nx<rundate>sv2.cal20140722n150
  • finished

MD04.pv2.deepstack.20140506

PV2 camera & warps -- PV2 warps are not cleaned up and will also be a accessible via the PSS/PSPS interface more quickly (release name MD04.PV2).

  • label: MD04.pv2.20130903

PV2 deep stack:

  • label/data_group: MD04.pv2.deepstack.20140506
  • staticsky label/data_group: (same format as other stacks -- Nx<rundate>/<#>x<rundate>)
    • MD04.pv2.deepstack.20140506.Nx20140511/MD04.pv2.deepstack.20140506.<#>x20140511 --
    • MD04.pv2.deepstack.20140506.Nx20140610 -- notes lost... likely merged changes/improvements to stack photometry for testing
    • MD04.pv2.deepstack.20140506.Nx20140616 -- improved PV3 tag
    • MD04.pv2.deepstack.20140506.Nx20140710sv2 -- improved PV3 tag but with PS1_SV2 older format for loading into PSPS
  • skycal label/data_group:
    • MD04.pv2.deepstack.20140506.Nx20140511.cal20140511 -- old refcat (20120524), used for Release/PSS and needs to be replaced w/ version for PSPS
    • MD04.pv2.deepstack.20140506.Nx20140610.cal20140610 -- new refcat (20140605) -- later found to be bad
    • MD04.pv2.deepstack.20140506.Nx20140616.cal20140616 -- extensions empty, code missing in PV3..
    • MD04.pv2.deepstack.20140506.Nx20140616.cal20140704 -- rerun again to fix PV3 tag missing code.. refcat (20140605) bad so must be redone
    • MD04.pv2.deepstack.20140506.Nx20140710sv2.cal20140710 -- test sample for PS1_SV2 for PSPS loading, bad refcat (20140605) and must be redone again..
    • MD04.pv2.deepstack.20140506.Nx20140710sv2.cal20140719n150 -- PV3 tag with new fixed refcat (20140713) and improved ZPT config for PSPS (but mistakenly on PS1_SV3 format)
    • MD04.pv2.deepstack.20140506.Nx20140710sv2.cal20140722n150 -- same as *.cal20140719n150 except on older PS1_SV2 format for PSPS

Cuts for each grizy (full exposure level values):

  • ZPT > ZPTave-0.3 > 24.11, 24.30, 24.03, 23.83, 22.67
  • background < 400,500,1800,2500,5000

Approximate input warp numbers:

  • all = every exposure available in PV2 (remember some are lost from faults and quality and FWHM>12 pixels)
  • all > Jan. 2010 = all exposures after January 1, 2010
  • cuts = numbers after ZPT, background, elongation and FWHM cuts on the all in exposure set
  • cuts > Jun. 2010 = cuts applied to all exposures after June 1, 2010 -- this is the active case for inputs going into the deepstacks
  • provides way to get values of just the cuts and losses due to the two time period cuts --
    filter: all / all > Jan. 2010 / cuts / cuts > Jun. 2010
    g: 641/601/577/418
    r: 623/591/567/417
    i: 770/691/709/430
    z: 798/734/695/494
    y: 562/498/465/301
    

Summary of stack produced:

| stack_id | label                       | filter  | skycell_id  | dtime_script | reject_images | count(warp_id) | reject_pix_mean | good_frac |
+----------+-----------------------------+---------+-------------+--------------+---------------+----------------+-----------------+-----------+
|  3317744 | MD04.pv2.deepstack.20140506 | g.00000 | skycell.035 |        21611 |            19 |            428 |            NULL |  0.987422 | 
|  3321604 | MD04.pv2.deepstack.20140506 | r.00000 | skycell.035 |        22660 |             5 |            421 |            NULL |  0.987304 | 
|  3325164 | MD04.pv2.deepstack.20140506 | i.00000 | skycell.035 |        27578 |             4 |            433 |            NULL |  0.987121 | 
|  3328591 | MD04.pv2.deepstack.20140506 | z.00000 | skycell.035 |        29868 |             7 |            495 |            NULL |  0.987102 | 
|  3330441 | MD04.pv2.deepstack.20140506 | y.00000 | skycell.035 |        14948 |             1 |            301 |            NULL |  0.987357 |

Problems:

  • more skycells having qual faults, but phot done on conv stack -- need to clear in order to have full field staticsky --
    | stack_id | label                       | filter  | skycell_id  | state | quality | reject_images | count(warp_id) | good_frac |
    +----------+-----------------------------+---------+-------------+-------+---------+---------------+----------------+-----------+
    |  3321591 | MD04.pv2.deepstack.20140506 | r.00000 | skycell.017 | full  |    3006 |             7 |            186 |  0.187052 | 
    |  3325151 | MD04.pv2.deepstack.20140506 | i.00000 | skycell.017 | full  |    3013 |             2 |            191 |  0.189333 | 
    |  3325159 | MD04.pv2.deepstack.20140506 | i.00000 | skycell.028 | full  |    3006 |             9 |            194 |  0.187476 | 
    |  3325200 | MD04.pv2.deepstack.20140506 | i.00000 | skycell.082 | full  |    3006 |             6 |            190 |  0.168054 | 
    |  3328627 | MD04.pv2.deepstack.20140506 | z.00000 | skycell.082 | full  |    3006 |            12 |            220 |  0.171084 | 
    
  • poor pixels/regions -- more need to be listed still (by request) -- as an example of likely issues in any of the MD fields as well
    --> s012g +-streak@4108,6246 -- also s22 (same source?) 
    --> s012g lower background area where bad junk was -- this may explain odd holes in FPA plot 
    --> s027g lower background bad still @4770,2294; also brighter chunk @5277,1843
    --> s025g looks like streak but edges aren't very sharp so probably real @1992,1081
    --> s023g odd lower sky area w/o brighter star @660,270
    --> s023g BS streak @5577,2006 -- this is one that was cleaned up before??
    --> s014r BS reflection arc, should also be in g and could be rejected? @2600,1260
    --> s012r also the +-streak from BS
    -->
    

MD09.pv2.deepstack.20140512

The next deep stack will be MD09 for comparison to previous version MD09.PV1_deepstack_tests

PV2 camera & warps -- PV2 warps are not cleaned up and will also be a accessible via the PSS/PSPS interface more quickly (release name MD09.PV2).

  • label: MD09.pv2.20131030

PV2 deep stack:

  • label/data_group: MD09.pv2.deepstack.20140512
  • staticsky label/data_group:
    • MD09.pv2.deepstack.20140512.Nx20140521 --
    • MD09.pv2.deepstack.20140512.Nx20140618 -- improved PV3 tag
    • MD09.pv2.deepstack.20140512.Nx20140711sv2 -- improved PV3 tag but with PS1_SV2 older format for loading into PSPS
  • skycal label/data_group:
    • MD09.pv2.deepstack.20140512.Nx20140521.cal20140521 -- old refcat (20120524), used for release/PSS and needs to be replaced w/ version for PSPS
    • MD09.pv2.deepstack.20140512.Nx20140618.cal20140618 -- extensions empty, code missing in PV3..
    • MD09.pv2.deepstack.20140512.Nx20140618.cal20140704 -- rerun to fix PV3 tag missing code.. refcat (20140605) bad so must be redone
    • MD09.pv2.deepstack.20140512.Nx20140711sv2.cal20140719n150 -- PV3 tag with new fixed refcat (20140713) and improved ZPT config for PSPS (but mistakenly on PS1_SV3 format)
    • MD09.pv2.deepstack.20140512.Nx20140711sv2.cal20140722n150 -- same as *.cal20140719n150 except on older PS1_SV2 format for PSPS

Cuts for each grizy:

  • ZPT > ZPTave-0.3 > 24.04,24.26,24.11,23.74,22.57
  • background < 400,700,2000,4000,6000

Approximate input warp numbers:

filter: all / all > Jan. 2010 / cuts / cuts > Jun. 2010
g: 770/731/614/585 
r: 742/701/620/594 
i: 824/752/697/640 
z: 951/890/817/773 
y: 889/886/631/615

Summary of stack produced:

| stack_id | label                       | filter  | skycell_id  | dtime_script | reject_images | count(warp_id) | reject_pix_mean | good_frac |
+----------+-----------------------------+---------+-------------+--------------+---------------+----------------+-----------------+-----------+
|  3331869 | MD09.pv2.deepstack.20140512 | g.00000 | skycell.035 |        36731 |            30 |            615 |            NULL |  0.987368 | 
|  3342577 | MD09.pv2.deepstack.20140512 | r.00000 | skycell.035 |        40397 |            18 |            612 |            NULL |  0.987209 | 
|  3346731 | MD09.pv2.deepstack.20140512 | i.00000 | skycell.035 |        49889 |            24 |            660 |            NULL |  0.986842 | 
|  3349368 | MD09.pv2.deepstack.20140512 | z.00000 | skycell.035 |        60121 |             6 |            768 |            NULL |  0.986966 | 
|  3349628 | MD09.pv2.deepstack.20140512 | y.00000 | skycell.035 |        44454 |            39 |            643 |            NULL |  0.987336 | 

Problems:

  • quality faults that shouldn't happen for skycell.040,050 r, 077 z --
    | stack_id | label                       | filter  | skycell_id  | state | quality | reject_images | count(warp_id) | good_frac |
    +----------+-----------------------------+---------+-------------+-------+---------+---------------+----------------+-----------+
    |  3342559 | MD09.pv2.deepstack.20140512 | r.00000 | skycell.004 | full  |    3006 |             0 |              5 |  0.001789 | 
    |  3342581 | MD09.pv2.deepstack.20140512 | r.00000 | skycell.040 | full  |    3006 |            27 |            608 |  0.479741 | 
    |  3342590 | MD09.pv2.deepstack.20140512 | r.00000 | skycell.050 | full  |    3006 |            23 |            581 |  0.478831 | 
    |  3346713 | MD09.pv2.deepstack.20140512 | i.00000 | skycell.004 | full  |    3006 |             0 |              2 |  0.003824 | 
    |  3349350 | MD09.pv2.deepstack.20140512 | z.00000 | skycell.004 | full  |    3006 |             0 |              3 |  0.001148 | 
    |  3349405 | MD09.pv2.deepstack.20140512 | z.00000 | skycell.077 | full  |    3013 |            14 |            767 |  0.559673 |
    
  • poor pixels/regions need to be listed (by request)

MD10.pv2.deepstack.20140520

PV2 camera & warps -- PV2 warps are not cleaned up and will also be a accessible via the PSS/PSPS interface more quickly (release name MD10.PV2).

  • label: MD10.pv2.20131103

PV2 deep stack:

  • label/data_group: MD10.pv2.deepstack.20140520
  • staticsky label/data_group:
    • MD10.pv2.deepstack.20140520.Nx20140529 --
    • MD10.pv2.deepstack.20140520.Nx20140619 -- improved PV3 tag
    • MD10.pv2.deepstack.20140520.Nx20140711sv2 -- improved PV3 tag but with PS1_SV2 older format for loading into PSPS
  • skycal label/data_group:
    • MD10.pv2.deepstack.20140520.Nx20140529.cal20140529 -- old refcat (20120524), used for release/PSS and needs to be replaced w/ version for PSPS
    • MD10.pv2.deepstack.20140520.Nx20140619.cal20140619 -- extensions empty, code missing in PV3..
    • MD10.pv2.deepstack.20140520.Nx20140619.cal20140704 -- rerun to fix PV3 tag missing code.. refcat (20140605) bad so must be redone
    • MD10.pv2.deepstack.20140520.Nx20140711sv2.cal20140719n150 -- PV3 tag with new fixed refcat (20140713) and improved ZPT config for PSPS (but mistakenly on PS1_SV3 format)
    • MD10.pv2.deepstack.20140520.Nx20140711sv2.cal20140722n150 -- same as *.cal20140719n150 except on older PS1_SV2 format for PSPS

Cuts for each grizy:

  • ZPT > ZPTave-0.3 > 24.09,24.25,24.16,23.79,22.67
  • background < 400, 700, 2500, 4000, 6000

Approximate input warp numbers:

filter: all / all > Jan. 2010 / cuts / cuts > Jun. 2010
g: 739/673/626/563
r: 728/656/598/550
i: 797/724/702/653
z: 957/897/808/758
y: 751/703/575/521

Summary of stack produced:

| stack_id | label                       | filter  | skycell_id  | dtime_script | reject_images | count(warp_id) | reject_pix_mean | good_frac |
+----------+-----------------------------+---------+-------------+--------------+---------------+----------------+-----------------+-----------+
|  3355748 | MD10.pv2.deepstack.20140520 | g.00000 | skycell.035 |        35099 |            26 |            577 |            NULL |   0.98741 | 
|  3356712 | MD10.pv2.deepstack.20140520 | r.00000 | skycell.035 |        38946 |            17 |            583 |            NULL |  0.987328 | 
|  3357537 | MD10.pv2.deepstack.20140520 | i.00000 | skycell.035 |        49671 |            18 |            659 |            NULL |  0.987093 | 
|  3357910 | MD10.pv2.deepstack.20140520 | z.00000 | skycell.035 |        57096 |            28 |            780 |            NULL |  0.987184 | 
|  3358253 | MD10.pv2.deepstack.20140520 | y.00000 | skycell.035 |        34415 |            30 |            541 |            NULL |  0.987369 | 

Problems:

  • quality faults that shouldn't happen --
    | stack_id | label                       | filter  | skycell_id  | state | quality | reject_images | count(warp_id) | good_frac |
    +----------+-----------------------------+---------+-------------+-------+---------+---------------+----------------+-----------+
    |  3357532 | MD10.pv2.deepstack.20140520 | i.00000 | skycell.028 | full  |    3006 |            27 |            256 |  0.177312 | 
    
  • poor pixels/regions need to be listed (by request)

MD08.pv2.deepstack.20140529

PV2 camera & warps -- PV2 warps are not cleaned up and will also be a accessible via the PSS/PSPS interface more quickly (release name MD08.PV2).

  • label: MD08.pv2.20131028

PV2 deep stack:

  • label/data_group: MD08.pv2.deepstack.20140529
  • staticsky label/data_group:
    • MD08.pv2.deepstack.20140529.Nx20140605 -- pre-PV3 tag
    • MD08.pv2.deepstack.20140529.Nx20140620 -- improved PV3 tag
    • MD08.pv2.deepstack.20140529.Nx20140711sv2 -- improved PV3 tag but with PS1_SV2 older format for loading into PSPS
  • skycal label/data_group:
    • MD08.pv2.deepstack.20140529.Nx20140605.cal20140605 -- used for release/PSS and needs to be replaced w/ version for PSPS, refcat (20140605) bad
    • MD08.pv2.deepstack.20140529.Nx20140620.cal20140620 -- extensions empty, code missing in PV3..
    • MD08.pv2.deepstack.20140529.Nx20140620.cal20140704 -- rerun to fix PV3 tag missing code.. refcat (20140605) bad so must be redone
    • MD08.pv2.deepstack.20140529.Nx20140711sv2.cal20140719n150 -- PV3 tag with new fixed refcat (20140713) and improved ZPT config for PSPS (but mistakenly on PS1_SV3 format)
    • MD08.pv2.deepstack.20140529.Nx20140711sv2.cal20140722n150 -- same as *.cal20140719n150 except on older PS1_SV2 format for PSPS

Cuts for each grizy:

  • ZPT > ZPTave-0.3 > 24.07,24.3,24.08,23.73,22.7
  • background < 400, 700, 2500, 4000, 6000

Approximate input warp numbers:

filter: all / all > Jan. 2010 / cuts / cuts > Jun. 2010
g: 673/623/553/470
r: 690/617/559/487
i: 837/732/683/592
z: 939/828/749/630
y: 1023/935/727/657

Summary of stack produced:

| stack_id | label                       | filter  | skycell_id  | dtime_script | reject_images | count(warp_id) | reject_pix_mean | good_frac |
+----------+-----------------------------+---------+-------------+--------------+---------------+----------------+-----------------+-----------+
|  3358313 | MD08.pv2.deepstack.20140529 | g.00000 | skycell.035 |        30029 |            15 |            482 |            NULL |  0.987361 | 
|  3361355 | MD08.pv2.deepstack.20140529 | r.00000 | skycell.035 |        31383 |            12 |            503 |            NULL |  0.987267 | 
|  3361415 | MD08.pv2.deepstack.20140529 | i.00000 | skycell.035 |        41809 |            27 |            616 |            NULL |  0.986949 | 
|  3361475 | MD08.pv2.deepstack.20140529 | z.00000 | skycell.035 |        44078 |            12 |            630 |            NULL |  0.987041 | 
|  3361535 | MD08.pv2.deepstack.20140529 | y.00000 | skycell.035 |        45534 |            86 |            731 |            NULL |  0.987379 | 

Problems:

  • quality faults that shouldn't happen --
    | stack_id | label                       | filter  | skycell_id  | state | quality | reject_images | count(warp_id) | good_frac |
    +----------+-----------------------------+---------+-------------+-------+---------+---------------+----------------+-----------+
    |  3361342 | MD08.pv2.deepstack.20140529 | r.00000 | skycell.017 | full  |    3006 |            21 |            259 |  0.185936 | 
    |  3361456 | MD08.pv2.deepstack.20140529 | i.00000 | skycell.087 | full  |    3012 |            22 |            291 |  0.192575 | 
    
  • poor pixels/regions need to be listed (by request)

MD07.pv2.deepstack.20140605

PV2 camera & warps -- PV2 warps are not cleaned up and will also be a accessible via the PSS/PSPS interface more quickly (release name MD07.PV2).

  • label: MD07.pv2.20131027

PV2 deep stack:

  • label/data_group: MD07.pv2.deepstack.20140605
  • staticsky label/data_group:
    • MD07.pv2.deepstack.20140605.Nx20140612 -- pre-PV3 tag
    • MD07.pv2.deepstack.20140605.Nx20140620 -- improved PV3 tag
    • MD07.pv2.deepstack.20140605.Nx20140711sv2 -- improved PV3 tag but with PS1_SV2 older format for loading into PSPS
  • skycal label/data_group:
    • MD07.pv2.deepstack.20140605.Nx20140612.cal20140612 -- used for release/PSS and needs to be replaced w/ version for PSPS, refcat (20140605) bad
    • MD07.pv2.deepstack.20140605.Nx20140620.cal20140620 -- extensions empty, code missing in PV3..
    • MD07.pv2.deepstack.20140605.Nx20140620.cal20140704 -- rerun to fix PV3 tag missing code.. refcat (20140605) bad so must be redone
    • MD07.pv2.deepstack.20140605.Nx20140711sv2.cal20140719n150 -- PV3 tag with new fixed refcat (20140713) and improved ZPT config for PSPS (but mistakenly on PS1_SV3 format)
    • MD07.pv2.deepstack.20140605.Nx20140711sv2.cal20140722n150 -- same as *.cal20140719n150 except on older PS1_SV2 format for PSPS

Cuts for each grizy:

  • ZPT > ZPTave-0.3 > 24.12,24.27,24.17,23.78,22.77
  • background < 400, 700, 2500, 4000, 6000

Approximate input warp numbers:

filter: all / all > Jan. 2010 / cuts / cuts > Jun. 2010
g: 696/655/551/431
r: 692/639/561/432
i: 953/845/766/611
z: 1010/915/826/666
y: 810/755/667/529

Summary of stack produced:

| stack_id | label                       | filter  | skycell_id  | dtime_script | reject_images | count(warp_id) | reject_pix_mean | good_frac |
+----------+-----------------------------+---------+-------------+--------------+---------------+----------------+-----------------+-----------+
|  3361601 | MD07.pv2.deepstack.20140605 | g.00000 | skycell.035 |        27354 |            15 |            445 |            NULL |  0.987358 | 
|  3361667 | MD07.pv2.deepstack.20140605 | r.00000 | skycell.035 |        26924 |            19 |            456 |            NULL |  0.987253 | 
|  3361733 | MD07.pv2.deepstack.20140605 | i.00000 | skycell.035 |        44306 |             5 |            611 |            NULL |  0.986998 | 
|  3361799 | MD07.pv2.deepstack.20140605 | z.00000 | skycell.035 |        47201 |             4 |            666 |            NULL |  0.987134 | 
|  3364854 | MD07.pv2.deepstack.20140605 | y.00000 | skycell.035 |        34684 |            41 |            563 |            NULL |  0.987355 |

Problems:

  • quality faults from Nin<30 required inputs
    | stack_id | label                       | filter  | skycell_id  | state | quality | reject_images | count(warp_id) | good_frac |
    +----------+-----------------------------+---------+-------------+-------+---------+---------------+----------------+-----------+
    |  3361580 | MD07.pv2.deepstack.20140605 | g.00000 | skycell.006 | full  |    3006 |             0 |              8 |  0.002836 | 
    |  3361646 | MD07.pv2.deepstack.20140605 | r.00000 | skycell.006 | full  |    3006 |             2 |             11 |  0.001986 | 
    |  3361712 | MD07.pv2.deepstack.20140605 | i.00000 | skycell.006 | full  |    3006 |             3 |             15 |  0.001472 | 
    |  3361778 | MD07.pv2.deepstack.20140605 | z.00000 | skycell.006 | full  |    3006 |             3 |             23 |  0.000327 | 
    |  3364833 | MD07.pv2.deepstack.20140605 | y.00000 | skycell.006 | full  |    3006 |             4 |             19 |  0.000845 | 
    
  • quality faults that shouldn't happen --
    | stack_id | label                       | filter  | skycell_id  | state | quality | reject_images | count(warp_id) | good_frac |
    +----------+-----------------------------+---------+-------------+-------+---------+---------------+----------------+-----------+
    |  3361779 | MD07.pv2.deepstack.20140605 | z.00000 | skycell.011 | full  |    3006 |             7 |            158 |  0.112796 | 
    |  3361785 | MD07.pv2.deepstack.20140605 | z.00000 | skycell.017 | full  |    3006 |            19 |            392 |  0.253089 | 
    |  3361828 | MD07.pv2.deepstack.20140605 | z.00000 | skycell.068 | full  |    3012 |            27 |            356 |  0.195776 | 
    |  3361840 | MD07.pv2.deepstack.20140605 | z.00000 | skycell.086 | full  |    3012 |            10 |            306 |  0.172942 | 
    
  • poor pixels/regions need to be listed (by request)

MD05.pv2.deepstack.20140616 -- using new ipp-pv3-20140616 tag here on

PV2 camera & warps -- PV2 warps are not cleaned up and will also be a accessible via the PSS/PSPS interface more quickly (release name MD05.PV2).

  • label: MD05.pv2.20131022

PV2 deep stack:

  • label/data_group: MD05.pv2.deepstack.20140616
  • staticsky label/data_group:
    • MD05.pv2.deepstack.20140616.Nx20140623 -- improved PV3 tag
    • MD05.pv2.deepstack.20140616.Nx20140711sv2 -- improved PV3 tag but with PS1_SV2 older format for loading into PSPS
  • skycal label/data_group:
    • MD05.pv2.deepstack.20140616.Nx20140623.cal20140623 -- very poor recalibration, will need to be redone
    • MD05.pv2.deepstack.20140616.Nx20140711sv2.cal20140719n150 -- PV3 tag with new fixed refcat (20140713) and improved ZPT config for PSPS (but mistakenly on PS1_SV3 format)
    • MD05.pv2.deepstack.20140616.Nx20140711sv2.cal20140722n150 -- same as *.cal20140719n150 except on older PS1_SV2 format for PSPS

Cuts for each grizy:

  • ZPT > ZPTave-0.3 > 24.1,24.3,24.12,23.81,22.75
  • background < 400, 700, 2500, 4000, 6000

Approximate input warp numbers:

filter: all / all > Jan. 2010 / cuts / cuts > Jun. 2010
g: 751/723/622/450
r: 710/686/567/401
i: 774/738/694/497
z: 883/831/777/564
y: 739/707/615/415

Summary of stack produced:

| stack_id | label                       | filter  | skycell_id  | dtime_script | reject_images | count(warp_id) | reject_pix_mean | good_frac |
+----------+-----------------------------+---------+-------------+--------------+---------------+----------------+-----------------+-----------+
|  3368325 | MD05.pv2.deepstack.20140616 | g.00000 | skycell.035 |        28107 |            21 |            464 |            NULL |  0.987326 |
|  3368385 | MD05.pv2.deepstack.20140616 | r.00000 | skycell.035 |        26911 |            21 |            453 |            NULL |  0.987205 |  
|  3368889 | MD05.pv2.deepstack.20140616 | i.00000 | skycell.035 |        34866 |             5 |            499 |            NULL |  0.986668 | 
|  3368949 | MD05.pv2.deepstack.20140616 | z.00000 | skycell.035 |        38078 |            35 |            602 |            NULL |   0.98675 | 
|  3369009 | MD05.pv2.deepstack.20140616 | y.00000 | skycell.035 |        26982 |            19 |            431 |            NULL |   0.98698 | 

Problems:

  • quality faults that shouldn't happen --
    | stack_id | label                       | filter  | skycell_id  | state | quality | reject_images | count(warp_id) | good_frac |
    +----------+-----------------------------+---------+-------------+-------+---------+---------------+----------------+-----------+
    |  3368420 | MD05.pv2.deepstack.20140616 | r.00000 | skycell.078 | full  |    3012 |            21 |            252 |  0.189232 | 
    
  • poor pixels/regions need to be listed (by request)

MD06.pv2.deepstack.20140624

PV2 camera & warps -- PV2 warps are not cleaned up and will also be a accessible via the PSS/PSPS interface more quickly (release name MD06.PV2).

  • label: MD06.pv2.20131025

PV2 deep stack:

  • label/data_group: MD06.pv2.deepstack.20140624
  • staticsky label/data_group:
    • MD06.pv2.deepstack.20140624.Nx20140710 -- improved PV3 tag
    • MD06.pv2.deepstack.20140624.Nx20140711sv2 -- improved PV3 tag but with PS1_SV2 older format for loading into PSPS
  • skycal label/data_group:
    • MD06.pv2.deepstack.20140624.Nx20140710.cal20140710 -- very poor recalib, will need to be redone
    • MD06.pv2.deepstack.20140624.Nx20140711sv2.cal20140719n150 -- PV3 tag with new fixed refcat (20140713) and improved ZPT config for PSPS (but mistakenly on PS1_SV3 format)
    • MD06.pv2.deepstack.20140624.Nx20140711sv2.cal20140722n150 -- same as *.cal20140719n150 except on older PS1_SV2 format for PSPS

Cuts for each grizy:

  • ZPT > ZPTave-0.3 > 24.15,24.36,24.12,23.76,22.77
  • background < 400, 700, 2500, 4000, 6000

Approximate input warp numbers:

filter: all / all > Jan. 2010 / cuts / cuts > Jun. 2010
g: 714/689/614/443
r: 727/675/600/433
i: 1017/901/858/625
z: 1053/954/862/650
y: 636/622/543/403

Summary of stack produced:

| stack_id | label                       | filter  | skycell_id  | dtime_script | reject_images | count(warp_id) | reject_pix_mean | good_frac |
+----------+-----------------------------+---------+-------------+--------------+---------------+----------------+-----------------+-----------+
|  3369070 | MD06.pv2.deepstack.20140624 | g.00000 | skycell.035 |        27051 |            29 |            463 |            NULL |  0.987417 | 
|  3369130 | MD06.pv2.deepstack.20140624 | r.00000 | skycell.035 |        26364 |            30 |            460 |            NULL |  0.987356 | 
|  3369190 | MD06.pv2.deepstack.20140624 | i.00000 | skycell.035 |        45553 |            18 |            641 |            NULL |  0.987195 | 
|  3369250 | MD06.pv2.deepstack.20140624 | z.00000 | skycell.035 |        45711 |             7 |            649 |            NULL |   0.98724 | 
|  3369310 | MD06.pv2.deepstack.20140624 | y.00000 | skycell.035 |        25126 |            19 |            413 |            NULL |   0.98737 |

Problems:

  • none have quality issue
  • poor pixels/regions need to be listed (by request)

MD01.pv2.deepstack.20140630

PV2 camera & warps -- PV2 warps are not cleaned up and will also be a accessible via the PSS/PSPS interface more quickly (release name MD01.PV2).

  • label: MD01.pv2.20131031

PV2 deep stack:

  • label/data_group: MD01.pv2.deepstack.20140630
  • staticsky label/data_group:
    • MD01.pv2.deepstack.20140630.Nx20140712sv2 -- improved PV3 tag but with PS1_SV2 older format for loading into PSPS
  • skycal label/data_group:
    • MD01.pv2.deepstack.20140630.Nx20140711sv2.cal20140712 -- poor test sample for diagnostic plots, label+workdir messed up and will be redone
    • MD01.pv2.deepstack.20140630.Nx20140712sv2.cal20140719n150 -- PV3 tag with new fixed refcat (20140713) and improved ZPT config for PSPS (but mistakenly on PS1_SV3 format)
    • MD01.pv2.deepstack.20140630.Nx20140712sv2.cal20140722n150 -- same as *.cal20140719n150 except on older PS1_SV2 format for PSPS

Cuts for each grizy:

  • ZPT > ZPTave-0.3 > 24.04,24.26,24.15,23.73,22.63
  • background < 400,700,2500,4000,6000

Approximate input warp numbers:

filter: all / all > Jan. 2010 / cuts / cuts > Jun. 2010
g: 783/663/615/515
r: 746/630/643/541
i: 923/811/825/685
z: 1228/1142/1036/877
y: 1006/974/764/698

Summary of stack produced:

| stack_id | label                       | filter  | skycell_id  | dtime_script | reject_images | count(warp_id) | reject_pix_mean | good_frac |
+----------+-----------------------------+---------+-------------+--------------+---------------+----------------+-----------------+-----------+
|  3369370 | MD01.pv2.deepstack.20140630 | g.00000 | skycell.035 |        32991 |            29 |            543 |            NULL |  0.987437 | 
|  3369430 | MD01.pv2.deepstack.20140630 | r.00000 | skycell.035 |        33824 |            13 |            547 |            NULL |  0.987279 | 
|  3369490 | MD01.pv2.deepstack.20140630 | i.00000 | skycell.035 |        51904 |            12 |            699 |            NULL |  0.987063 | 
|  3369550 | MD01.pv2.deepstack.20140630 | z.00000 | skycell.035 |        65717 |            15 |            886 |            NULL |  0.987189 | 
|  3369610 | MD01.pv2.deepstack.20140630 | y.00000 | skycell.035 |        56244 |            55 |            742 |            NULL |  0.987364 |

Problems:

  • none have quality issue
  • poor pixels/regions need to be listed (by request)

MD02.pv2.deepstack.20140707

PV2 camera & warps -- PV2 warps are not cleaned up and will also be a accessible via the PSS/PSPS interface more quickly (release name MD02.PV2).

  • label: MD02.pv2.20131101

PV2 deep stack:

  • label/data_group: MD02.pv2.deepstack.20140707
  • staticsky label/data_group:
    • MD02.pv2.deepstack.20140707.Nx20140717sv2 -- improved PV3 tag but with PS1_SV2 older format for loading into PSPS
  • skycal label/data_group:
    • MD02.pv2.deepstack.20140707.Nx20140717sv2.cal20140719n150 -- PV3 tag with new fixed refcat (20140713) and improved ZPT config for PSPS (but mistakenly on PS1_SV3 format)
    • MD02.pv2.deepstack.20140707.Nx20140717sv2.cal20140722n150 -- same as *.cal20140719n150 except on older PS1_SV2 format for PSPS

Cuts for each grizy:

  • ZPT > ZPTave-0.3 > 24.01,24.3,24.22,23.88,22.69
  • background < 400,700,2500,4000,6000

Approximate input warp numbers:

filter: all / all > Jan. 2010 / cuts / cuts > Jun. 2010
g: 508/455/393/362
r: 531/477/423/394
i: 699/642/653/555
z: 903/849/782/680
y: 823/807/658/614

Summary of stack produced:

| stack_id | label                       | filter  | skycell_id  | dtime_script | reject_images | count(warp_id) | reject_pix_mean | good_frac |
+----------+-----------------------------+---------+-------------+--------------+---------------+----------------+-----------------+-----------+
|  3369670 | MD02.pv2.deepstack.20140707 | g.00000 | skycell.035 |        21568 |            16 |            345 |            NULL |  0.987478 | 
|  3369730 | MD02.pv2.deepstack.20140707 | r.00000 | skycell.035 |        24678 |            13 |            402 |            NULL |  0.987411 | 
|  3369790 | MD02.pv2.deepstack.20140707 | i.00000 | skycell.035 |        41258 |            10 |            563 |            NULL |   0.98724 |
|  3369850 | MD02.pv2.deepstack.20140707 | z.00000 | skycell.035 |        44760 |            14 |            679 |            NULL |  0.987272 | 
|  3369910 | MD02.pv2.deepstack.20140707 | y.00000 | skycell.035 |        40585 |            20 |            627 |            NULL |   0.98742 | 

Problems:

  • poor pixels/regions need to be listed (by request)

MD03.pv2.deepstack.20140715

PV2 camera & warps -- PV2 warps are not cleaned up and will also be a accessible via the PSS/PSPS interface more quickly (release name MD03.PV2).

  • label: MD03.pv2.20131018

PV2 deep stack:

  • label/data_group: MD03.pv2.deepstack.20140715
  • staticsky label/data_group:
    • MD03.pv2.deepstack.20140715.Nx20140719sv2 -- improved PV3 tag but with PS1_SV2 older format for loading into PSPS
  • skycal label/data_group:
    • MD03.pv2.deepstack.20140715.Nx20140719sv2.cal20140719n150 -- PV3 tag with new fixed refcat (20140713) and improved ZPT config for PSPS (but mistakenly on PS1_SV3 format)
    • MD03.pv2.deepstack.20140715.Nx20140719sv2.cal20140722n150 -- same as *.cal20140719n150 except on older PS1_SV2 format for PSPS

Cuts for each grizy:

  • ZPT > ZPTave-0.3 > 24.07,24.31,23.95,23.75,22.46
  • background < 400,700,2500,4000,6000

Approximate input warp numbers:

filter: all / all > Jan. 2010 / cuts / cuts > Jun. 2010
g: 711/651/604/453
r: 698/638/615/462
i: 963/891/795/590
z: 1244/1140/1060/794
y: 1087/1055/757/659

Summary of stack produced:

| stack_id | label                       | filter  | skycell_id  | dtime_script | reject_images | count(warp_id) | reject_pix_mean | good_frac |
+----------+-----------------------------+---------+-------------+--------------+---------------+----------------+-----------------+-----------+
|  3369970 | MD03.pv2.deepstack.20140715 | g.00000 | skycell.035 |        39956 |            33 |            477 |            NULL |  0.987435 | 
|  3370030 | MD03.pv2.deepstack.20140715 | r.00000 | skycell.035 |        44516 |            10 |            493 |            NULL |  0.987356 | 
|  3370090 | MD03.pv2.deepstack.20140715 | i.00000 | skycell.035 |        59128 |            33 |            619 |            NULL |  0.987066 | 
|  3370150 | MD03.pv2.deepstack.20140715 | z.00000 | skycell.035 |        87308 |            32 |            811 |            NULL |  0.987097 | 
|  3370210 | MD03.pv2.deepstack.20140715 | y.00000 | skycell.035 |        44838 |            42 |            688 |            NULL |  0.987411 | 

Problems:

  • quality faults that shouldn't happen --
    | stack_id | label                       | filter  | skycell_id  | state | quality | reject_images | count(warp_id) | good_frac |
    +----------+-----------------------------+---------+-------------+-------+---------+---------------+----------------+-----------+
    |  3370197 | MD03.pv2.deepstack.20140715 | y.00000 | skycell.017 | full  |    3012 |            43 |            324 |  0.191099 |
    
  • poor pixels/regions need to be listed (by request)