| Version 26 (modified by , 12 years ago) ( diff ) |
|---|
Summary for MD.PV2.deepstack.20130506 (in progress)
- MediumDeepFields summary page and quick links to all processing and up to date refstacks
- MD.GR0 summary page -- summary of all reprocessing details and 2011/2012 refstacks and some deepstack samples
- MD.PV1 summary page -- the data set that PV2 update reprocessing is based on
- MD09.PV1_deepstack_tests summary of MD09 PV1 deep test stacks
- MD04.pv2_stacktest.20130903 -- pre-PV2 and deep test stacks
- MD.PV2 summary page -- PV2 warp updates for the stacks
- MDdeeptest_pixrej_20140403 -- bug and config modifications for stacking
This is a summary of the MD PV2 deep stack using the PV2 update processing (as started with MD04 in MD04.pv2_stacktest.20130903) for all MD exposures through the end of the survey, April 2014 (a handful of exposures after this date still to be incorporated).
The processing sequence will be MD04, MD09, then continue in some order to finish as many as possible before the PS1SC@STSCI meeting at the end of June. This is being done to provide a comparison to recent pre-PV2 sample (MD04.pv2_stacktest.20130903, MD09.PV1_deepstack_tests) as some possibly significant changes have been made.
- pixel rejection bug fixes and config modifications MDdeeptest_pixrej_20140403
- PSPS loading of MD04 (April 2014) was for the alldeeptest example (MD04.pv2_stacktest.20130903) while the normal deep stacks will have cuts imposed, but both will have similar numbers of inputs (within ~100) to provide comparison such as if the early, questionable (2009/2010) data is a problem or not
- staticsky and possibly skycal changes (i.e., MD04 has had a gross offset at least in i-band)
As was decided for the past deep test stacks, basic cuts will be used to exclude poorer data (contribute less in weighted stacks, potential for more junk, waste resources) -- likely will add summary plots on analysis page for these params for revision --
- pre-June 2010 exposures fully excluded
- significant camera change prior 1/2010
- baffle modifications prior 6/2010
- ZPT > ZPTave-0.3 (grizy each by mean exposure value)
- background < (grizy each by mean exposure value) -- TBD if consistent value works for all fields or must be empirically chosen for each field where tail begins
- elongation < 1.5 (all by exposure value)
- FWHM < 10 pixels (grizy each by skycell, not by full exposure value)
Data can be found on the datastore and postage stamp server (PSS) --
- datastore: full image/pixel bundles, staticsky and skycal stack photometry
- ps1-md-deepstack -- these current full PV2 image/pixel bundles
- ps1-md-staticsky -- staticsky and skycal stack photometry catalog bundles (
- ps1-md-deeptest -- image/pixel bundles for previous deep stack test versions, including the MD04 with 2009/2010 data MD04.pv2_stacktest.20130903
- PSS: selected desired image/pixels
- use the label/data_group for the desired stack
Any problems and/or issues need to be identified quickly so that changes can be made before too many MD stacks are made.
Similar to GR0 there will be a summary for each field, but unlike GR0, will try and keep analysis and issues to other pages to reduce the length and load time for this summary page.
Status:
- prior to 2014 -- several issues being worked out for PV2 and stacks (e.g., MD04.pv2_stacktest.20130903,MDdeeptest_pixrej_20140403)
- 5/6 -- MD04.pv2.deepstack.20140506 started
- 5/12 -- MD09.pv2.deepstack.20140512 started
- 5/18 -- expect to start next MD10.pv2, then MD05,08,07,06 for the next month or so
- 5/20 -- MD09 finishing, MD10.pv2.deepstack.20140520 started
- 5/21 -- MD09 deepstack and skycal to distribution, available via PSS
- 5/28 -- IPP systems powered down, half+ day delay with incomplete and faulted stacks -- adding possible schedule going into PS1SC@STSCI meeting
- 5/29 -- hopefully start MD08.pv2.deepstack.20140529 and distributed MD10 products
- 6/7 -- start MD07.pv2.deepstack.20140607 and distribute MD08 products?
- 6/15 -- start MD05.pv2.deepstack.20140615 and distribute MD07 products?
- 6/23 -- start MD06.pv2.deepstack.20140623 and distribute MD05 products?
MD04.pv2.deepstack.20140506
PV2 camera & warps -- PV2 warps are not cleaned up and will also be a accessible via the PSS/PSPS interface more quickly (release name MD04.PV2).
- label: MD04.pv2.20130903
PV2 deep stack:
- label/data_group: MD04.pv2.deepstack.20140506
- staticsky label/data_group: MD04.pv2.deepstack.20140506.Nx20140511.cal20140511/MD04.pv2.deepstack.20140506.<#>x20140511.cal20140511
- skycal label/data_group: MD04.pv2.deepstack.20140506.Nx20140511.cal20140511
Cuts for each grizy (full exposure level values):
- ZPT > ZPTave-0.3 > 24.11, 24.30, 24.03, 23.83, 22.67
- background < 400,500,1800,2500,5000
Approximate input warp numbers:
- all = every exposure available in PV2 (remember some are lost from faults and quality and FWHM>12 pixels)
- all > Jan. 2010 = all exposures after January 1, 2010
- cuts = numbers after ZPT, background, elongation and FWHM cuts on the all in exposure set
- cuts > Jun. 2010 = cuts applied to all exposures after June 1, 2010 -- this is the active case for inputs going into the deepstacks
- provides way to get values of just the cuts and losses due to the two time period cuts --
filter: all / all > Jan. 2010 / cuts / cuts > Jun. 2010 g: 641/601/577/418 r: 623/591/567/417 i: 770/691/709/430 z: 798/734/695/494 y: 562/498/465/301
Summary of stack produced:
| stack_id | label | filter | skycell_id | dtime_script | reject_images | count(warp_id) | reject_pix_mean | good_frac | +----------+-----------------------------+---------+-------------+--------------+---------------+----------------+-----------------+-----------+ | 3317744 | MD04.pv2.deepstack.20140506 | g.00000 | skycell.035 | 21611 | 19 | 428 | NULL | 0.987422 | | 3321604 | MD04.pv2.deepstack.20140506 | r.00000 | skycell.035 | 22660 | 5 | 421 | NULL | 0.987304 | | 3325164 | MD04.pv2.deepstack.20140506 | i.00000 | skycell.035 | 27578 | 4 | 433 | NULL | 0.987121 | | 3328591 | MD04.pv2.deepstack.20140506 | z.00000 | skycell.035 | 29868 | 7 | 495 | NULL | 0.987102 | | 3330441 | MD04.pv2.deepstack.20140506 | y.00000 | skycell.035 | 14948 | 1 | 301 | NULL | 0.987357 |
Problems:
- more skycells having qual faults, but phot done on conv stack -- need to clear in order to have full field staticsky --
| stack_id | label | filter | skycell_id | state | quality | reject_images | count(warp_id) | good_frac | +----------+-----------------------------+---------+-------------+-------+---------+---------------+----------------+-----------+ | 3321591 | MD04.pv2.deepstack.20140506 | r.00000 | skycell.017 | full | 3006 | 7 | 186 | 0.187052 | | 3325151 | MD04.pv2.deepstack.20140506 | i.00000 | skycell.017 | full | 3013 | 2 | 191 | 0.189333 | | 3325159 | MD04.pv2.deepstack.20140506 | i.00000 | skycell.028 | full | 3006 | 9 | 194 | 0.187476 | | 3325200 | MD04.pv2.deepstack.20140506 | i.00000 | skycell.082 | full | 3006 | 6 | 190 | 0.168054 | | 3328627 | MD04.pv2.deepstack.20140506 | z.00000 | skycell.082 | full | 3006 | 12 | 220 | 0.171084 |
- poor pixels/regions -- more need to be listed still --
--> s012g +-streak@4108,6246 -- also s22 (same source?) --> s012g lower background area where bad junk was -- this may explain odd holes in FPA plot --> s027g lower background bad still @4770,2294; also brighter chunk @5277,1843 --> s025g looks like streak but edges aren't very sharp so probably real @1992,1081 --> s023g odd lower sky area w/o brighter star @660,270 --> s023g BS streak @5577,2006 -- this is one that was cleaned up before?? --> s014r BS reflection arc, should also be in g and could be rejected? @2600,1260 --> s012r also the +-streak from BS -->
MD09.pv2.deepstack.20140512
The next deep stack will be MD09 for comparison to previous version MD09.PV1_deepstack_tests
PV2 camera & warps -- PV2 warps are not cleaned up and will also be a accessible via the PSS/PSPS interface more quickly (release name MD09.PV2).
- label: MD09.pv2.20131030
PV2 deep stack:
- label/data_group: MD09.pv2.deepstack.20140512
- staticsky label/data_group: MD09.pv2.deepstack.20140512.Nx20140521
- skycal label/data_group: MD09.pv2.deepstack.20140512.Nx20140521.cal20140521
Cuts for each grizy:
- ZPT > ZPTave-0.3 > 24.04,24.26,24.11,23.74,22.57
- background < 400,700,2000,4000,6000
Approximate input warp numbers:
filter: all / all > Jan. 2010 / cuts / cuts > Jun. 2010 g: 770/731/614/585 r: 742/701/620/594 i: 824/752/697/640 z: 951/890/817/773 y: 889/886/631/615
Summary of stack produced:
| stack_id | label | filter | skycell_id | dtime_script | reject_images | count(warp_id) | reject_pix_mean | good_frac | +----------+-----------------------------+---------+-------------+--------------+---------------+----------------+-----------------+-----------+ | 3331869 | MD09.pv2.deepstack.20140512 | g.00000 | skycell.035 | 36731 | 30 | 615 | NULL | 0.987368 | | 3342577 | MD09.pv2.deepstack.20140512 | r.00000 | skycell.035 | 40397 | 18 | 612 | NULL | 0.987209 | | 3346731 | MD09.pv2.deepstack.20140512 | i.00000 | skycell.035 | 49889 | 24 | 660 | NULL | 0.986842 | | 3349368 | MD09.pv2.deepstack.20140512 | z.00000 | skycell.035 | 60121 | 6 | 768 | NULL | 0.986966 | | 3349628 | MD09.pv2.deepstack.20140512 | y.00000 | skycell.035 | 44454 | 39 | 643 | NULL | 0.987336 |
Problems:
- quality faults that shouldn't happen --
| stack_id | label | filter | skycell_id | state | quality | reject_images | count(warp_id) | good_frac | +----------+-----------------------------+---------+-------------+-------+---------+---------------+----------------+-----------+ | 3342559 | MD09.pv2.deepstack.20140512 | r.00000 | skycell.004 | full | 3006 | 0 | 5 | 0.001789 | | 3342581 | MD09.pv2.deepstack.20140512 | r.00000 | skycell.040 | full | 3006 | 27 | 608 | 0.479741 | | 3342590 | MD09.pv2.deepstack.20140512 | r.00000 | skycell.050 | full | 3006 | 23 | 581 | 0.478831 | | 3346713 | MD09.pv2.deepstack.20140512 | i.00000 | skycell.004 | full | 3006 | 0 | 2 | 0.003824 | | 3349350 | MD09.pv2.deepstack.20140512 | z.00000 | skycell.004 | full | 3006 | 0 | 3 | 0.001148 | | 3349405 | MD09.pv2.deepstack.20140512 | z.00000 | skycell.077 | full | 3013 | 14 | 767 | 0.559673 |
- poor pixels/regions need to be listed
MD10.pv2.deepstack.20140520
PV2 camera & warps -- PV2 warps are not cleaned up and will also be a accessible via the PSS/PSPS interface more quickly (release name MD10.PV2).
- label: MD10.pv2.20131103
PV2 deep stack:
- label/data_group: MD10.pv2.deepstack.20140520
- staticsky label/data_group: TBD
- skycal label/data_group: TBD
Cuts for each grizy:
- ZPT > ZPTave-0.3 > 24.09,24.25,24.16,23.79,22.67
- background < 400, 700, 2500, 4000, 6000
Approximate input warp numbers:
filter: all / all > Jan. 2010 / cuts / cuts > Jun. 2010 g: 739/673/626/563 r: 728/656/598/550 i: 797/724/702/653 z: 957/897/808/758 y: 751/703/575/521
Summary of stack produced:
Problems:
- poor pixels/regions need to be listed
(need to load into release system when finished)
MD08
PV2 camera & warps -- PV2 warps are not cleaned up and will also be a accessible via the PSS/PSPS interface more quickly (release name MD08.PV2).
- label: MD08.pv2.20131028
PV2 deep stack:
- label/data_group: MD08.pv2.deepstack.20140529 TBD
- staticsky label/data_group: TBD
- skycal label/data_group: TBD
Cuts for each grizy:
- ZPT > ZPTave-0.3 > 24.07,24.3,24.08,23.73,22.7
- background < 400, 700, 2500, 4000, 6000
Approximate input warp numbers:
filter: all / all > Jan. 2010 / cuts / cuts > Jun. 2010 g: 673/623/553/470 r: 690/617/559/487 i: 837/732/683/592 z: 939/828/749/630 y: 1023/935/727/657
Summary of stack produced:
Problems:
- poor pixels/regions need to be listed
(need to load into release system when finished)
MD07
PV2 camera & warps -- PV2 warps are not cleaned up and will also be a accessible via the PSS/PSPS interface more quickly (release name MD07.PV2).
- label: MD07.pv2.20131027
PV2 deep stack:
- label/data_group: MD07.pv2.deepstack. TBD
- staticsky label/data_group: TBD
- skycal label/data_group: TBD
Cuts for each grizy:
- ZPT > ZPTave-0.3 > 24.12,24.27,24.17,23.78,22.77
- background < 400, 700, 2500, 4000, 6000
Approximate input warp numbers:
filter: all / all > Jan. 2010 / cuts / cuts > Jun. 2010 g: 696/655/551/431 r: 692/639/561/432 i: 953/845/766/611 z: 1010/915/826/666 y: 810/755/667/529
Summary of stack produced:
Problems:
- poor pixels/regions need to be listed
(need to load into release system when finished)
MD05
PV2 camera & warps -- PV2 warps are not cleaned up and will also be a accessible via the PSS/PSPS interface more quickly (release name MD05.PV2).
- label: MD05.pv2.20131022
PV2 deep stack:
- label/data_group: MD05.pv2.deepstack. TBD
- staticsky label/data_group: TBD
- skycal label/data_group: TBD
Cuts for each grizy:
- ZPT > ZPTave-0.3 > 24.1,24.3,24.12,23.81,22.75
- background < 400, 700, 2500, 4000, 6000
Approximate input warp numbers:
filter: all / all > Jan. 2010 / cuts / cuts > Jun. 2010 g: 751/723/622/450 r: 710/686/567/401 i: 774/738/694/497 z: 883/831/777/564 y: 739/707/615/415
Summary of stack produced:
Problems:
- poor pixels/regions need to be listed
(need to load into release system when finished)
MD06
PV2 camera & warps -- PV2 warps are not cleaned up and will also be a accessible via the PSS/PSPS interface more quickly (release name MD06.PV2).
- label: MD06.pv2.20131025
PV2 deep stack:
- label/data_group: MD06.pv2.deepstack. TBD
- staticsky label/data_group: TBD
- skycal label/data_group: TBD
Cuts for each grizy:
- ZPT > ZPTave-0.3 > 24.15,24.36,24.12,23.76,22.77
- background < 400, 700, 2500, 4000, 6000
Approximate input warp numbers:
filter: all / all > Jan. 2010 / cuts / cuts > Jun. 2010 g: 714/689/614/443 r: 727/675/600/433 i: 1017/901/858/625 z: 1053/954/862/650 y: 636/622/543/403
Summary of stack produced:
Problems:
- poor pixels/regions need to be listed
(need to load into release system when finished)
MD01
PV2 camera & warps -- PV2 warps are not cleaned up and will also be a accessible via the PSS/PSPS interface more quickly (release name MD01.PV2).
- label: MD01.pv2.20131031
PV2 deep stack:
- label/data_group: MD01.pv2.deepstack.201405xx -- TBD
- staticsky label/data_group: TBD
- skycal label/data_group: TBD
Cuts for each grizy:
- ZPT > ZPTave-0.3 >
- background <
Approximate input warp numbers:
filter: all / all > Jan. 2010 / cuts / cuts > Jun. 2010
Summary of stack produced:
Problems:
- poor pixels/regions need to be listed
(need to load into release system when finished)
