Changes between Version 9 and Version 10 of MD.PV3

Timestamp:

Sep 23, 2014, 1:20:37 PM (12 years ago)

Author:

Mark Huber

Comment:

--

MD.PV3

@@ -22 +22 @@
 || '''field''' || '''stage''' || '''N exposures/units''' || '''ave_dtime(s)''' || '''sig_dtime(s)''' || '''status''' || '''comment''' || '''label/data_group''' ||
 || || || || || || || ||
-|| MD || chip/camera/warp || 41717 || 130/610/85 || 130/500/65 || TBD ||
-|| || iq stk || ~600 ||
-|| || night stk || ~ || 
-|| || ref stk || 15141 ||| 6700 || 1500 || TBD ||
+|| MD || chip/camera/warp || 41717 || 130/610/85 || 130/500/65 || TBD || ||
+|| || iq stk || 3325 || 2215 || 310 || TBD || edge skycells of course run faster ||
+|| || night stk || ~4849 || 860 || 500 || TBD || typically 8 inputs, sometimes >20 in marginal nights ||
+|| || ref stk || 15141 ||| 6700 || 1500 || TBD || 5 seasons ||
 || || deep stk || 3033 || 37.5k* || 13k || TBD || *using 8 theads ||
-|| || WSref diff || ~ ||
-|| || WSdeep diff || ~ ||
-|| || SS diff || ~ || 
+|| || WSref diff || 41717 || ? || ? || TBD || done by season, same number as warps ||
+|| || WSdeep diff || x || x || x || x || not going to do? ||
+|| || SS diff || ~4849 || ? || ? || TBD || done by season, same number as night stacks ||
 || || iq staticsky ||
 || || iq skycal ||
-|| || night staticsky || ~ || 110 || 40 || TBD ||
+|| || night staticsky || ~4849 || 110 || 40 || TBD || same number as night stacks (no filter groups) ||
 || || night skycal || 
-|| || ref staticsky ||
-|| || ref skycal || ~ || 37 || 29 || TBD ||
-|| || deep staticsky ||
-|| || deep skycal || ~ || 30 || 7 || TBD || 
+|| || ref staticsky || 3025 || 4960 || 1700 || TBD || ||
+|| || ref skycal || ~ || 37 || 29 || TBD || ||
+|| || deep staticsky || 1458 || 6300 || 2550 || TBD || ||
+|| || deep skycal || ~ || 30 || 7 || TBD || ||
 || || full-forced phot || ~41717 || ? || ? || TBD || ||
 || || || || || || || ||
 || CNP || chip/camera/warp || 2695 || ~115/410/60 || 150/430/125 || TBD || ||
-|| || ref stk || ~500? || X || x || TBD || Nin~ ||
-|| || WSref diff || ~2695 || X || X || TBD || ||
+|| || ref/deep stk || ~500? || X || x || TBD || Nin~ ||
+|| || WSref/deep diff || ~2695 || X || X || TBD || ||
 || || ref staticsky || 
 || || ref skycal || ~ || ~37 || ~29 || TBD ||
@@ -49 +49 @@
 || M31 || chip/camera/warp || 4347 || 129/624/62 || 190/313/30 || TBD || 
 || || background restore ||
-|| || ref stk || ~500? || X || x || TBD || Nin~ ||
+|| || ref stk || ~500? || X || x || TBD || Nin~?, 4 seasons ||
 || || WSref diff || ~ || X || X || TBD || ||
 || || ref staticsky ||
@@ -55 +55 @@
 || || full-forced phot ||  || ? || ? || TBD || ||
 || || || || || || || || 
-|| STS || chip/camera/warp || 16109 || 210/1200/100 || 120/575/70 || TBD || ||
+|| STS || chip/camera/warp || 16606 || 210/1200/100 || 120/575/70 || TBD || Nin~?, 4 seasons||
 || || ref stk || ~3500? || X || x || TBD || Nin~ ||
 || || WSref diff || ~ || X || X || TBD || ||
@@ -63 +63 @@
 || || || || || || || ||
 
-If run only on ippsXX machines for high memory, 12 cores --
+If run only on ippsXX machines for high memory, 12 cores -- individual processing estimates only, some can be run ~same time like deep+iq/night/dif/staticsky/skycal possibly
  * MD:
-  * chip/cam/warp ~5x12/4x15 ~200 jobs/hr max possible, ~210 hrs
+  * chip/cam/warp ~5x12/4x15 ~200 jobs/hr max possible in general?, ~8-9 days
   * iq stack
   * night stack