| 11 | | This is a overview summary of the MD.PV3 full pixel reprocessing. Start date and schedule a mess with the unstable processing 12/01/2014. |
| 12 | | |
| 13 | | This processing will also involve other MD-like fields, including CNP (M31 and STS if time allows). Each field can be similar and different to the typical MD criteria for the stacks and diffims, summaries |
| | 11 | This is a overview summary of the full pixel reprocessing of the Medium Deep Survey version 3 (MD.PV3, similar code base to 3PI.PV3). Schedule outline and completion date is currently being revised yet again, loading/release of catalog products in the PSPS will follow after the 3PI DR2 public release. |
| | 12 | |
| | 13 | The MD.PV3 processing will also include the CNP (Celestial North Pole) observations as it is also a targeted field with many exposures and a very deep stack possible. M31 and STS may be done at a later time, but is not part of this reprocessing. The MD and CNP will have its own configuration and summary analysis |
| 18 | | * '''10/1''' start chip-warp for MD should be possible, STS+M31 sample should be possible -- new refcat responding different w/ past configs, verification necessary |
| 19 | | * 11/4 -- MD PV3 tag made for processing -- ipp-mdpv3-20141104 |
| 20 | | * 11/07 -- MD chip-warp started with MD04 -- label: MD##.PV3.20141104 |
| 21 | | * 11/11 -- CNP chip-warp started -- label: CNP.PV3.20141104 |
| 22 | | * 11/20 -- MD04 chip-warp finished |
| 23 | | * 11/23 -- CNP chip-warp finished |
| 24 | | * 12/16 -- CNP deepstack started -- label: CNP.PV3.deepstack.20141104 |
| 25 | | * 1/2/2015 -- all MD chip-warp ~finished |
| 26 | | * 1/6 -- MD09 deepstack started |
| 27 | | * 1/14 -- MD09 deepstack ~finished after multiple faults and problems due to overloaded system for LAP/3PI processing |
| 28 | | * '''01/15 all MD.PV3 processing suspended''' |
| 29 | | * 2/24 -- limited number of high-mem nodes returned to MD for deep stack processing |
| 30 | | * 4/01 -- setting up using UH HPC for seasonal refstacks, then night stacks -- refstacks running |
| 31 | | * 4/26 -- UH HPC now dominated by 3PI-full forced jobs -- no nodes available |
| 32 | | * night stacks processing on local machines -- problem with excess rejection and edge loses due to poor warp PSF models, will need development/code work to fix |
| 33 | | * 6/04 -- night stack ~50% finished in bulk, still problem with excess edge loss and fields not complete until fixed -- timeframe estimated end of June with ref stack verification |
| 34 | | * 08/22 -- 3PI mostly finished, MD to start up again soon |
| 35 | | * 8/28 -- on hold again, once stsci data nodes disconnected and shipped, turns out some warp files are not available to continue MD processing |
| 36 | | * 10/4 -- MD.PV3 warp files still missing and disk space is not available to finish stacking -- WSdiffs do not save large files for PV3 and can easily be reverted once missing files recovered, so it has been started instead (MD01,MD02 mostly finished), estimate that processing to finish mid-October |
| 37 | | * 10/7 -- MD thrown under the bus again.. WS mostly setup and will trickle along as much as possible with files still missing |
| 38 | | * 04/2016 -- close to restart now that 3PI.PV3 is finished and loading starting, hardware issues preventing access to data currently -- estimate 1-2 wks before restart |
| | 19 | |
| | 20 | * 09/20/2017 -- full file scan integrity check summary -- |
| | 21 | * 04/16/2017 -- still on hold -- entire cluster hardware moved Maui->Oahu finished, intermediate product loss to be evaluated and code issues to be addressed over next few months -- will not be loaded into PSPS until after DR2 (only MD01-10, CNP to be done) |
| | 22 | |
| 40 | | * 04/16/2017 -- still on hold -- entire cluster hardware moved Maui->Oahu finished, intermediate product loss to be evaluated and code issues to be addressed over next few months -- will not be loaded into PSPS until after DR2 |
| 41 | | |
| 42 | | ---- |
| 43 | | |
| | 24 | * 04/01/2016 -- close to restart now that 3PI.PV3 is finished and loading starting, hardware issues preventing access to data currently -- estimate 1-2 wks before restart |
| | 25 | |
| | 26 | * 10/07/2015 -- WS mostly setup and will trickle along as much as possible with files still missing |
| | 27 | * 10/04/2015 -- MD.PV3 warp files still missing and disk space is not available to finish stacking -- WSdiffs do not save large files for PV3 and can easily be reverted once missing files recovered, so it has been started instead (MD01,MD02 mostly finished), estimate that processing to finish mid-October |
| | 28 | * 08/28/2015 -- on hold again, once stsci data nodes disconnected and shipped, turns out some warp files are not available to continue MD processing |
| | 29 | * 08/22/2015 -- 3PI mostly finished, MD to start up again soon |
| | 30 | * 06/04/2015 -- night stack ~50% finished in bulk, still problem with excess edge loss and fields not complete until fixed -- timeframe estimated end of June with ref stack verification |
| | 31 | * 04/26/2015 -- UH HPC now dominated by 3PI-full forced jobs -- no nodes available |
| | 32 | * 04/01/2015 -- setting up using UH HPC for seasonal refstacks, then night stacks -- refstacks running |
| | 33 | * 02/24/2015 -- limited number of high-mem nodes returned to MD for deep stack processing |
| | 34 | * '''01/15/2015 all MD.PV3 processing suspended''' |
| | 35 | * 01/14/2015 -- MD09 deepstack ~finished after multiple faults and problems due to overloaded system for LAP/3PI processing |
| | 36 | * 01/06/2015 -- MD09 deepstack started |
| | 37 | * 01/02/2015 -- all MD chip-warp ~finished |
| | 38 | |
| | 39 | * 12/16/2014 -- CNP deepstack started -- label: CNP.PV3.deepstack.20141104 |
| | 40 | * 11/23/2014 -- CNP chip-warp finished |
| | 41 | * 11/20/2014 -- MD04 chip-warp finished |
| | 42 | * 11/11/2014 -- CNP chip-warp started -- label: CNP.PV3.20141104 |
| | 43 | * 11/07/2014 -- MD chip-warp started with MD04 -- label: MD##.PV3.20141104 |
| | 44 | * 11/04/2014 -- MD PV3 tag made for processing -- ipp-mdpv3-20141104 |
| | 45 | * '''10/01/2014''' start chip-warp for MD should be possible, STS+M31 sample should be possible -- new refcat responding different w/ past configs, verification necessary |
| | 46 | |
| | 47 | |
| | 48 | ---- |
| | 49 | ---- |
| | 50 | currently being revised below |
| | 51 | ---- |
| | 52 | ---- |
