Changes between Version 13 and Version 14 of MD.PV3

Timestamp:

Sep 23, 2014, 5:14:03 PM (12 years ago)

Author:

Mark Huber

Comment:

--

MD.PV3

@@ -10 +10 @@
 
 This processing will also involve other MD-like fields, including M31, STS and CNP. Criteria for the stacks and diffims are '''TBD'''.
-From Ken's talk at PS1SC@STSCI meeting in June 2014:
+From Ken's talk at PS1SC@STSCI meeting in June 2014, the diffims described there may need to modifications:
  * stack:
   * MDN -- night stack
@@ -17 +17 @@
   * MDT -- iq stack
  * diffim: 
-  * warp-stack (WS) -- (warp-ref), no (warp-deep) 
-  * stack-stack (SS) -- (night-ref), no (stack-deep)
+  * warp-stack (WS) -- (warp-ref) only, no (warp-deep) or only for CNP?
+  * stack-stack (SS) -- must add (night-ref) but no (stack-deep)
 
 || '''field''' || '''stage''' || '''N imfile/skycells''' || '''ave_dtime(s)''' || '''sig_dtime(s)''' || '''status''' || '''comment''' || '''label/data_group, release name''' ||
 || || || || || || || ||
-|| MD || chip/camera/warp || ~2500k/41717/2500k || 130/610/85 || 130/500/65 || TBD || 41717 exposures *60 imfiles/55-60 skycells || ||
+|| MD || chip/camera/warp || ~2500k/41717/2500k || 130/610/85 || 130/500/65 || TBD || 41717 exposures *60 imfiles/55-60 skycells || MD<f#>.pv3.20141001? ||
 || || night stk || ~291k || 860 || 500 || TBD || typically 8 inputs, sometimes >20 in marginal nights, ~4849*55-60 skycells || ||
 || || ref stk || 15141 || 6700 || 1500 || TBD || Nin~80, 5 seasons ||
@@ -38 +38 @@
 || || deep skycal || 3008 || 31 || 8 || TBD || ||
 || || iq skycal || 3018 || 40 || 34 || TBD || ||
-|| || full-forced phot || ~41717 || ? || ? || TBD || ||
+|| || full-forced phot || 2500k || ? || ? || TBD || ||
 || || || || || || || ||
-|| CNP || chip/camera/warp || 2695 || ~115/410/60 || 150/430/125 || TBD || ||
-|| || ref/deep stk || ~500? || X || x || TBD || Nin~ ||
+|| CNP || chip/camera/warp || /2695/ || ~115/410/60 || 150/430/125 || TBD || ||
+|| || ref/deep stk || ~500? || X || x || TBD || Nin~ , seasons (first/last month for ref?)||
 || || WSref/deep diff || ~2695 || X || X || TBD || ||
 || || ref/deep staticsky || 
@@ -47 +47 @@
 || || full-forced phot || || ? || ? || TBD || ||
 || || || || || || || ||
-|| M31 || chip/camera/warp || 4347 || 129/624/62 || 190/313/30 || TBD || 
+|| M31 || chip/camera/warp || /4347/ || 129/624/62 || 190/313/30 || TBD || 
 || || background restore ||
 || || ref stk || ~500? || X || x || TBD || Nin~?, 4 seasons ||
@@ -56 +56 @@
 || || full-forced phot ||  || ? || ? || TBD || ||
 || || || || || || || || 
-|| STS || chip/camera/warp || 16606 || 210/1200/100 || 120/575/70 || TBD || Nin~?, 4 seasons||
+|| STS || chip/camera/warp || /16606/ || 210/1200/100 || 120/575/70 || TBD || Nin~?, 4 seasons||
 || || ref stk || ~3500? || X || x || TBD || Nin~ ||
 || || deep stk || ? 
@@ -65 +65 @@
 || || || || || || || ||
 
- * label/data_group, release name -- for specific postage-stamp server (PSS) access and general gpc1 DB queries
+ * label/data_group, release name -- for gpc1 DB queries/datastore identification and specific postage-stamp server (PSS) association
  * ave/sig_dtime -- roughly the dtime_script for the jobs in the gpc1 DB
+ * 
 
 
 If run only on the 15 ippsXX machines with high memory, 12 cores -- individual processing estimates only, some can be run ~same time like deep+iq/night/dif/staticsky/skycal possibly
- * MD: 
-  * chip/cam/warp ~6 jobs/node ~90 jobs, 
+ * MD: will be run one field at a time to limit the queued jobs
+  * chip/cam/warp ~6 jobs/node ~90 jobs, ~42+3+27 ~72 days
   * iq stack ~4 jobs/node ~60 jobs, 
   * night stack ~4 jobs/node ~60 jobs, 
@@ -89 +90 @@
  * chip-warp:
   * refcat oddities in field
-  * background restore and masking for M31/STS -- test samples to be run
+  * background restore M31 and masking for M31/STS -- test samples to be run
  * stack  
   * stack quality fault
@@ -101 +102 @@
   * verify similar photometry
   * verify similar detections/coverage (no sig loss on edges)
+  * test samples for CNP,M31,STS 
  * full-forced photometry -- unknown, untested still