Changes between Version 11 and Version 12 of MD.PV3

Timestamp:

Sep 23, 2014, 3:05:18 PM (12 years ago)

Author:

Mark Huber

Comment:

--

MD.PV3

@@ -22 +22 @@
 || '''field''' || '''stage''' || '''N imfile/skycells''' || '''ave_dtime(s)''' || '''sig_dtime(s)''' || '''status''' || '''comment''' || '''label/data_group, release name''' ||
 || || || || || || || ||
-|| MD || chip/camera/warp || / || 130/610/85 || 130/500/65 || TBD || 41717 exposures || ||
-|| || night stk || ~291k || 860 || 500 || TBD || typically 8 inputs, sometimes >20 in marginal nights, ~4849*60 skycells || ||
-|| || ref stk || 15141 || 6700 || 1500 || TBD || 5 seasons ||
+|| MD || chip/camera/warp || ~2500k/41717/2500k || 130/610/85 || 130/500/65 || TBD || 41717 exposures *60 imfiles/55-60 skycells || ||
+|| || night stk || ~291k || 860 || 500 || TBD || typically 8 inputs, sometimes >20 in marginal nights, ~4849*55-60 skycells || ||
+|| || ref stk || 15141 || 6700 || 1500 || TBD || Nin~80, 5 seasons ||
 || || deep stk || 3033 || 37.5k* || 13k || TBD || *using 8 theads ||
-|| || iq stk || 3325 || 2215 || 310 || TBD || edge skycells of course run faster ||
-|| || WSref diff ||  || ? || ? || TBD || done by season, same number as warps ||
+|| || iq stk || 3325 || 2215 || 310 || TBD || edge skycells of course run faster in all stacks||
+|| || WSref diff || 2500k || ? || ? || TBD || done by season, same number as warps ||
 || || WSdeep diff || x || x || x || x || not going to do ||
 || || SS diff || ~291k || ? || ? || TBD || done by season, same number as night stacks ||
@@ -71 +71 @@
 If run only on ippsXX machines for high memory, 12 cores -- individual processing estimates only, some can be run ~same time like deep+iq/night/dif/staticsky/skycal possibly
  * MD:
-  * chip/cam/warp ~5x12/4x15 ~200 jobs/hr max possible in general?, ~8-9 days
-  * iq stack
-  * night stack
-  * ref stack
-  * deep stack
-  * WSref diff
-  * SSref diff
-  * all staticsky + skycal ~ 
+  * chip/cam/warp ~5x12/4x15 ~225 jobs, ~17+1.5+11 ~30 days
+  * iq stack ~5x12/4x15 ~225 jobs, ~9 hrs
+  * night stack ~5x12/4x15 ~225 jobs, ~13 days
+  * ref stack ~5x12/4x15 ~225 jobs, ~5 days
+  * deep stack ~1x15 ~15 jobs, ~88 days (pv2 took ~70d, may take longer for pv3 if don't let as much get clipped for Nin on edge skycells)
+  * WSref diff ~5x12/4x15 ~225 jobs,
+  * SSref diff ~5x12/4x15 ~225 jobs,
+  * all staticsky + skycal ~5x12/4x15 ~225 jobs,
   * total ~
  * CNP: