| Version 17 (modified by , 12 years ago) ( diff ) |
|---|
Creating this page to more easily track and visualize what system/group/wave is being used where in the ~ipp/ippconfig/pantasks_hosts.input file. seem to recall was done before but cannot find ...
Node group summary:
- wave1 (w1): ipp008--021, 8 core, 24G
- wave2 (w2): ipp023--036, 8 core, 32G
- wave3 (w3): ipp037--053, 8 core, 24/32G
- wave4 (w4): ipp054--066, 12 core, 49G
- compute (c): ippc01-c19 -- many are ignored_, 8 core, 32G
- compute2 (c2): ippc20--c29, 12 core, 24G (c26-c28 49G, c29 73G)
- compute3 (c3): ippc30--c63, 12 core, 49G
- stare (s): stare00-04: 12 core, 97G
- stsci (st): stsci00-19, 12 core, 49G -- not to be used in processing
Other special (sub)groups:
- dvo/ignore: ipp004-007
- apache: ippc01-c09
- wave1_weak -- weak meaning cannot have full loads (i.e., lost CPU or other issue): ipp010-012,018
- wave2_weak: ipp023,027,028,029,032,033
- wave3_weak: ipp047
- compute3_weak:
- compute2_himem -- c2 w/ extra RAM: ippc26-c28, c29 (c29 typically out of processing for very deep stack tests)
- deepstack: typically used by deepstack pantasks w/ 2x c3, but modified again for other uses (LAP staticsky 3x c3, 4x stare)
testing 2014 nightly+LAP+staticsky
Want to balance for more staticsky progress now.
- ipptopsps also will not be running for a bit so can use more of the system.
- have noticed staticsky reaching >10G, will want to keep off lower RAM systems with data.
- c was overloaded before, ease up some on it since it hosts apache as well
| pantasks | w1 | w1w | w2 | w2w | w3 | w3w | w4 | c | c2 | c3 | c3w | stare | comment |
| stdscience | 5 | 2 | 4 | 2 | 4 | 3 | 4 | 4 | 2 | 2 | 3 | 100% use, LAP + updates light, nightly moder, N=291? (need >200) | |
| stack | 1 | 2 | 1 | 3 | 100% use, LAP/nightly heavy, N~73 (need >60) | ||||||||
| summitcopy | 1 | 1 | 1 | 1 | nightly, need N>30 | ||||||||
| registration | 1 | 1 | 1 | 1 | 1 | nightly | |||||||
| distribution | 1 | 1 | 1 | 1 | nightly | ||||||||
| pstamp | 2 | 2 | regular | ||||||||||
| cleanup | 1 | 1 | 1 | 1 | 1 | regular | |||||||
| publishing | 1 | nightly, light | |||||||||||
| ippsky/staticsky | 3 | 4 | 100% use, LAP, heavy+very long running, N=127 (+20*80% for overloaded stare) ? | ||||||||||
| equiv. totals | x | x | x | x | x | x | x | x | x | x | x | x | |
| replication | 1 | 1 | 1 | 1 | light load, not always in use -- rebalance when in use | ||||||||
| deepstack | 2 | heavy+very long running, not always in use, -2x c3 from stack/staticsky | |||||||||||
| detrend | 1 | 1 | 1 | 1 | light load, not always in use -- rebalance when in use | ||||||||
Load level
- light = ~1 thread equiv, fairly quick runtime (x1)
- moder = ~1-4 thread, moderately fast runtime (x1-2)
- heavy = mostly 2-4 thread, longer runtime (x3-4)
When ipptopsps loaders not in use -- ipp045-ipp066 (half wave3+wave4), stare
- overloaded stare (+4x) nodes for staticsky
Cleanup possible to add to stsci nodes for local delete?
late 2013
A reconfiguration once ipptopsps and loaders running full time.
- stare fully allocated to PSPS
- w1-4 reduced to account for extra load to data nodes
| pantasks | w1 | w1w | w2 | w2w | w3 | w3w | w4 | c | c2 | c3 | c3w | stare | comment |
| stdscience | 3 | 2 | 3 | 2 | 3 | 3 | 3 | 4 | 4 | 5 | 3 | ||
| stack | 2 | 2 | 2 | 2 | 2 | ||||||||
| summitcopy | 1 | 1 | 1 | 1 | |||||||||
| registration | 1 | 1 | 1 | 1 | 1 | ||||||||
| distribution | 1 | 1 | 1 | 1 | |||||||||
| pstamp | 2 | 2 | |||||||||||
| update | 1 | 1 | |||||||||||
| cleanup | 1 | 1 | 1 | 1 | |||||||||
| publishing | 1 | ||||||||||||
| equiv. totals | x | x | x | x | x | x | x | x | x | x | x | x | |
| replication | 1 | 1 | 1 | 1 | |||||||||
| deepstack | 2 | ||||||||||||
| detrend | 1 | 1 | 1 | 1 | |||||||||
Note:
See TracWiki
for help on using the wiki.
