| 39 | | The storage nodes status can be queried with the command {{{cluster_status.py}}}. Get its help with {{{cluster_status.py -h}}} |
| | 39 | The storage nodes status can be queried with the command {{{cluster_status.py}}}. Get its help with {{{cluster_status.py -h}}}. The storage nodes can be queried individually, by groups, or by using predefined aliases like {{{mphcc}}}, {{{atrc}}}... For instance, let's get information about the ipp053 node: |
| | 40 | |
| | 41 | The command line is: |
| | 42 | {{{ |
| | 43 | ipp@ippc18:/home/panstarrs/ipp> ./cluster_status.py ipp053 |
| | 44 | }}} |
| | 45 | |
| | 46 | The first line provides information on the completion status of the files monitoring: |
| | 47 | {{{ |
| | 48 | Node ipp053.0: 99.9% done |
| | 49 | }}} |
| | 50 | This means that 99.9% of the files have been classified and "monitored" (that is their size and their md5sum are known). |
| | 51 | |
| | 52 | The next lines provides information by role (see ): |
| | 53 | {{{ |
| | 54 | ### By role (in gigs / relative % / in teras) |
| | 55 | kernel: 62.4 0.4% 0.1 |
| | 56 | mdl: 25.2 0.2% 0.0 |
| | 57 | ptn: 21.1 0.1% 0.0 |
| | 58 | skycell: 1.5 0.0% 0.0 |
| | 59 | mdc: 158.7 1.1% 0.2 |
| | 60 | bttable: 28.5 0.2% 0.0 |
| | 61 | miscfits: 293.0 2.0% 0.3 |
| | 62 | weight: 580.8 4.0% 0.6 |
| | 63 | stats: 4.8 0.0% 0.0 |
| | 64 | compfits: 534.7 3.6% 0.5 |
| | 65 | unknown: 130.1 0.9% 0.1 |
| | 66 | b2jpg: 0.2 0.0% 0.0 |
| | 67 | b2fits: 0.5 0.0% 0.0 |
| | 68 | trace: 0.3 0.0% 0.0 |
| | 69 | psf: 115.8 0.8% 0.1 |
| | 70 | bundle: 332.0 2.3% 0.3 |
| | 71 | catalog: 1286.4 8.8% 1.3 |
| | 72 | b1jpg: 209.9 1.4% 0.2 |
| | 73 | fits: 9185.2 62.6% 9.0 |
| | 74 | png: 1.5 0.0% 0.0 |
| | 75 | log: 342.4 2.3% 0.3 |
| | 76 | mask: 989.3 6.7% 1.0 |
| | 77 | logupdate: 8.6 0.1% 0.0 |
| | 78 | b1fits: 358.5 2.4% 0.4 |
| | 79 | Total: 14671.4 14.3 |
| | 80 | |
| | 81 | ### By stage (in gigs / relative % / in teras) |
| | 82 | magic: 1.4 0.0% 0.0 |
| | 83 | raw: 8907.9 60.7% 8.7 |
| | 84 | unknown: 131.0 0.9% 0.1 |
| | 85 | chip: 1439.4 9.8% 1.4 |
| | 86 | warp: 786.4 5.4% 0.8 |
| | 87 | detrend: 140.0 1.0% 0.1 |
| | 88 | cam: 1425.6 9.7% 1.4 |
| | 89 | diff: 599.2 4.1% 0.6 |
| | 90 | stack: 999.8 6.8% 1.0 |
| | 91 | dist: 237.8 1.6% 0.2 |
| | 92 | destreak: 2.9 0.0% 0.0 |
| | 93 | Total: 14671.4 14.3 |
| | 94 | |
| | 95 | |
| | 96 | ### Interpolated Sizes (in gigs), if all nodes were all 100% done |
| | 97 | magic raw unknown chip warp detrend cam diff stack dist destreak |
| | 98 | ptn - - - 21.1 - - - - - - - |
| | 99 | mdl - - 0.0 24.6 0.0 - - 0.6 - - - |
| | 100 | kernel - - - - - - - 52.0 10.4 - - |
| | 101 | skycell - - 0.0 - 1.5 - - - - - - |
| | 102 | mdc - - 0.0 62.8 67.7 - 1.6 25.5 1.1 0.0 - |
| | 103 | bttable - 28.5 - - - - - - - - - |
| | 104 | miscfits - - - - - - - - 293.0 - - |
| | 105 | weight - - - 203.9 91.7 - - 16.4 268.7 - - |
| | 106 | stats - - 0.0 2.4 0.7 0.2 0.4 0.7 0.1 - 0.2 |
| | 107 | compfits - 534.7 - - - - - - - - - |
| | 108 | unknown 0.1 - 130.0 0.0 0.0 - - 0.0 - - - |
| | 109 | b2jpg - - - - 0.0 0.0 0.0 0.2 0.0 - - |
| | 110 | b2fits - - - 0.5 0.0 0.0 - 0.0 0.0 - - |
| | 111 | trace - - 0.0 0.0 0.2 0.0 0.0 0.1 0.0 - - |
| | 112 | psf - - 0.0 61.3 39.3 - - 15.0 0.2 - - |
| | 113 | bundle - - - 65.6 - - 5.0 24.7 - 236.6 - |
| | 114 | catalog - - 0.0 299.2 367.2 - 486.4 129.9 3.7 - - |
| | 115 | b1jpg - - - - 23.4 0.6 15.2 165.1 5.7 - - |
| | 116 | fits 0.9 8154.3 0.8 351.7 99.2 132.6 - 53.2 392.5 - - |
| | 117 | png 0.5 - - 1.0 0.0 - - - - - - |
| | 118 | log 0.0 190.6 0.1 37.4 22.3 0.7 3.7 82.5 1.4 1.1 2.6 |
| | 119 | mask - - 0.0 31.7 18.7 0.0 913.3 3.3 22.3 - - |
| | 120 | logupdate - - - 5.1 2.4 - - 1.1 - - - |
| | 121 | b1fits - - 0.0 270.9 52.1 5.9 - 28.8 0.8 - - |
| | 122 | |
| | 123 | ### Sizes (in gigs) |
| | 124 | magic raw unknown chip warp detrend cam diff stack dist destreak |
| | 125 | ptn - - - 21.1 - - - - - - - |
| | 126 | mdl - - 0.0 24.6 0.0 - - 0.6 - - - |
| | 127 | kernel - - - - - - - 52.0 10.4 - - |
| | 128 | skycell - - 0.0 - 1.5 - - - - - - |
| | 129 | mdc - - 0.0 62.8 67.7 - 1.6 25.5 1.1 0.0 - |
| | 130 | bttable - 28.5 - - - - - - - - - |
| | 131 | miscfits - - - - - - - - 293.0 - - |
| | 132 | weight - - - 203.9 91.7 - - 16.4 268.7 - - |
| | 133 | stats - - 0.0 2.4 0.7 0.2 0.4 0.7 0.1 - 0.2 |
| | 134 | compfits - 534.7 - - - - - - - - - |
| | 135 | unknown 0.1 - 130.0 0.0 0.0 - - 0.0 - - - |
| | 136 | b2jpg - - - - 0.0 0.0 0.0 0.2 0.0 - - |
| | 137 | b2fits - - - 0.5 0.0 0.0 - 0.0 0.0 - - |
| | 138 | trace - - 0.0 0.0 0.2 0.0 0.0 0.1 0.0 - - |
| | 139 | psf - - 0.0 61.3 39.3 - - 15.0 0.2 - - |
| | 140 | bundle - - - 65.6 - - 5.0 24.7 - 236.6 - |
| | 141 | catalog - - 0.0 299.2 367.2 - 486.4 129.9 3.7 - - |
| | 142 | b1jpg - - - - 23.4 0.6 15.2 165.1 5.7 - - |
| | 143 | fits 0.9 8154.3 0.8 351.7 99.2 132.6 - 53.2 392.5 - - |
| | 144 | png 0.5 - - 1.0 0.0 - - - - - - |
| | 145 | log 0.0 190.6 0.1 37.4 22.3 0.7 3.7 82.5 1.4 1.1 2.6 |
| | 146 | mask - - 0.0 31.7 18.7 0.0 913.3 3.3 22.3 - - |
| | 147 | logupdate - - - 5.1 2.4 - - 1.1 - - - |
| | 148 | b1fits - - 0.0 270.9 52.1 5.9 - 28.8 0.8 - - |
| | 149 | |
| | 150 | ### By node: Mine neb-df Difference (compared to disk size) "Non-nebulous" space |
| | 151 | ipp053.0: 14671.39 19923.56 -25.71% 5252.17 |
| | 152 | --------------------------------------------------- |
| | 153 | Total: 14671.39 19923.56 -25.71% 5252.17 |
| | 154 | Total*: 14671.39 19923.56 -25.71% 5252.17 |
| | 155 | Total* = Total excluding nodes: ['ipp004.0', 'ipp005.0', 'ipp064.0'] |
| | 156 | }}} |
