Creating this page to more easily track and visualize what system/group/wave is being used where in the ~ipp/ippconfig/pantasks_hosts.input file. seem to recall was done before but cannot find ...
Node group summary:
| node group | hostnames | typical cores | typical RAM | comments |
| wave1 (w1) | ipp008--021 | 8 cores | 24G | |
| wave2 (w2) | ipp023--036 | 8 cores | 32G | |
| wave3 (w3) | ipp037--053 | 8 cores | 24/32G | |
| wave4 (w4) | ipp054--066 | 12 cores | 49G | |
| compute (c) | ippc01--c19 | 8 cores | 32G | many are ignored_ |
| compute2 (c2) | ippc20--c29 | 12 cores | 24G (c26-c28 49G, c29 73G) | |
| compute3 (c3) | ippc30--c63 | 12 cores | 49G | |
| stare (s) | stare00--04 | 12 cores | 97G | |
| stsci (st) | stsci00--19 | 12 cores | 49G | not to be used in processing |
Other special (sub)groups:
- dvo/ignore: ipp004-007
- apache: ippc01-c09
- wave1_weak -- weak meaning cannot have full loads (i.e., lost CPU or other issue): ipp010-012,018
- wave2_weak: ipp023,027,028,029,032,033
- wave3_weak: ipp047
- compute3_weak:
- compute2_himem -- c2 w/ extra RAM: ippc26-c28, c29 (c29 typically out of processing for very deep stack tests)
- deepstack: typically used by deepstack pantasks w/ 2x c3, but modified again for other uses (LAP staticsky 3x c3, 4x stare)
2/13/2014 nightly+LAP+staticsky
Gene heavily shuffled allocation, heavily weighted to staticsky and stack. Few weak systems being fully loaded, crash+burn and taking out processing. Since only few, taking back out of processing (MEH 2/19)
2/4/2014 nightly+LAP+staticsky
Want to balance for more staticsky progress now.
- ipptopsps also will not be running for a bit so can use more of the system.
- have noticed staticsky reaching >10G, will want to keep off lower RAM systems with data.
- c was overloaded before, ease up some on it since it hosts apache as well, c2 also could be overloaded some with stacks as was in past
- suspect w1-4 could be loaded further but should monitor nightly processing use first
- want to wait for full cab/serial control mapping before overloading key nodes, if go down want to be able to reboot them quickly
| pantasks | w1 | w1w | w2 | w2w | w3 | w3w | w4 | c | c2 | c3 | c3w | stare | comment |
| stdscience | 5 | 2 | 4 | 2 | 4 | 3 | 4 | 4 | 2 | 2 | 3 | 100% use, LAP + updates light, nightly moder, N=291? (need >200) | |
| stack | 1 | 2 | 1 | 3 | 100% use, LAP/nightly heavy, N~73 (need >60) | ||||||||
| summitcopy | 1 | 1 | 1 | 1 | nightly, need N>30 | ||||||||
| registration | 1 | 1 | 1 | 1 | 1 | nightly | |||||||
| distribution | 1 | 1 | 1 | 1 | nightly | ||||||||
| pstamp | 2 | 2 | regular | ||||||||||
| cleanup | 1 | 1 | 1 | 1 | 1 | regular | |||||||
| publishing | 1 | nightly, light | |||||||||||
| ippsky/staticsky | 3 | 4 | 100% use, LAP, heavy+very long running, N=127 (+20*80% for overloaded stare) ? | ||||||||||
| equiv. totals | x | x | x | x | x | x | x | x | x | x | x | x | |
| replication | 1 | 1 | 1 | 1 | light load, not always in use -- rebalance when in use | ||||||||
| deepstack | 2 | heavy+very long running, not always in use, -2x c3 from stack/staticsky | |||||||||||
| detrend | 1 | 1 | 1 | 1 | light load, not always in use -- rebalance when in use | ||||||||
Load level
- light = ~1 thread equiv, fairly quick runtime (x1)
- moder = ~1-4 thread, moderately fast runtime (x1-2)
- heavy = mostly 2-4 thread, longer runtime (x3-4)
When ipptopsps loaders not in use -- ipp045-ipp066 (half wave3+wave4), stare
- overloaded stare (+4x) nodes for staticsky
Cleanup possible to add to stsci nodes for local delete?
late 2013
A reconfiguration once ipptopsps and loaders running full time.
- stare fully allocated to PSPS
- w1-4 reduced to account for extra load to data nodes
| pantasks | w1 | w1w | w2 | w2w | w3 | w3w | w4 | c | c2 | c3 | c3w | stare | comment |
| stdscience | 3 | 2 | 3 | 2 | 3 | 3 | 3 | 4 | 4 | 5 | 3 | ||
| stack | 2 | 2 | 2 | 2 | 2 | ||||||||
| summitcopy | 1 | 1 | 1 | 1 | |||||||||
| registration | 1 | 1 | 1 | 1 | 1 | ||||||||
| distribution | 1 | 1 | 1 | 1 | |||||||||
| pstamp | 2 | 2 | |||||||||||
| cleanup | 1 | 1 | 1 | 1 | |||||||||
| publishing | 1 | ||||||||||||
| update | 1 | 1 | |||||||||||
| equiv. totals | x | x | x | x | x | x | x | x | x | x | x | x | |
| replication | 1 | 1 | 1 | 1 | |||||||||
| deepstack | 2 | ||||||||||||
| detrend | 1 | 1 | 1 | 1 | |||||||||
