Changes between Version 51 and Version 52 of MD.PV3

Timestamp:

May 13, 2016, 5:05:56 PM (10 years ago)

Author:

Mark Huber

Comment:

--

MD.PV3

@@ -291 +291 @@
 
 
-== Processing Notes ==
-
-Section for local processing details/notes -- not for general users
+== Local IPP -- Processing Notes ==
+
+Section for local processing details/notes -- not useful for general users
 
 pantasks_server nodes for ippmd user -- will keep current for own sanity and may change often due to task shuffling
  * ipps00 -- ~ippmd/deepstack -- high memory stacks
- * ipps01 -- ~ippmd/stdscience -- ---chip-cam-warp--- (finished), diffim, staticsky+skycal
+ * ipps01 -- ~ippmd/stdscience -- chip-cam-warp (finished), diffim, staticsky+skycal
  * ipps02 -- ~ippmd/distribution -- reference and night stacks for transients group, possible skycal before loading into PSPS
  * ipps03 -- ~ippmd/stack -- lower memory, faster running iq, night and probably reference stacks 
+ * ipps04 -- ~ippmd/refstack -- for fixing missing md03 notyr5 stacks and CNP refstack
  * ippc29 -- ~ippmd/uhhpc_stack -- remote processing on uh cray, also used for test runs + debugging
 
 host groups -- nodes that specifically have to be used for deep stack processing
- * m0 = ipps00--s04 (12 core, 144G, very efficient machines)
- * m1 = ipps05--s14 ((12 core, 96G, very efficient machines)
- * x0b,x1b = ippx037-x040, x041-x044 (12 core, 96G) 
- * s4 = ipp067--071 (12 core, 132G) -- data nodes and used for nightly science processing so only 10hr/day available
- * s5 = ipp072--095 (12 core, 198G) -- data nodes and used for nightly science processing so only 10hr/day available 
- 
-data node targeting -- helps to have data going to same machine 
+ * m0 = ipps00--s04 (12 core, 148G, ~650GB tmp disk, very efficient machines)
+ * m1 = ipps05--s14 ((12 core, 98G, ~650GB tmp disk, very efficient machines)
+ * x0b,x1b = ippx037-x040, x041-x044 (12 core, 96G, 2TB tmp disk) 
+ * s4 = ipp067--071 (12 core, 132G) -- data nodes and used for nightly science processing so only 10hr/day available -- also for ipptopsps so avoid
+ * s5 = ipp072--097 (12 core, 198G) -- data nodes and used for nightly science processing so only 10hr/day available -- also for ipptopsps so avoid
+ * s6 = ipp100--104 (12 core, 198G) -- data nodes and used for nightly science processing so only 10hr/day available -- also for ipptopsps so avoid
+
+
+data node targeting -- helps to have data going to same machine (need to update)
  * ~ippmd/src/ipp-mdpv3-20141104/ippTasks/ipphosts.mhpcc.config -- defaults to nightly processing allocation, after building ippmd tag, need to replace
   * ~ippmd/psconfig/ipp-mdpv3-20141104.lin64/share/pantasks/modules/ipphosts.mhpcc.config with
@@ -317 +320 @@
  * ipp067--081 are nearly full and need to have lighter allocations
  * ipp082-095 various levels of larger free space and should have higher allocations
+ * ipp100-104 large amount of disk space, ipptopsps using heavily
 
 processing loads/schedule groups --