IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 5 and Version 6 of ThroughputDemo_20091104


Ignore:
Timestamp:
Nov 6, 2009, 10:59:54 AM (17 years ago)
Author:
eugene
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • ThroughputDemo_20091104

    v5 v6  
    122122
    123123 * there are a number of chipRuns that have not finished: 37 exposures
    124 are still pending.  This is basically because of point 2:
     124 are still pending.  This is basically because of point 2:
    125125
    126126 * ipp014 is unhappy: it is not so unhappy that it has been kicked out
    127 of nebulous, but files on it are giving I/O errors.  The failing chips
    128 are being caused by this, but coupled to a lingering nebulous error:
    129 the rules are forcing nebulous to return the ipp014 instance rather
    130 than randomize among the instances.  i'm going to reboot ipp014 and
    131 kick it out of nebulous for now.
     127 of nebulous, but files on it are giving I/O errors.  The failing chips
     128 are being caused by this, but coupled to a lingering nebulous error:
     129 the rules are forcing nebulous to return the ipp014 instance rather
     130 than randomize among the instances.  i'm going to reboot ipp014 and
     131 kick it out of nebulous for now.
    132132
    133133I'm attaching a snapshot of the ganglia load for the past 24 hours.
     
    142142or because of poor data distribution.  this is something we need to
    143143investigate.
     144
     145[[Image(ganglia-throughput-20091104.png)]]
    144146
    145147=== update ===
     
    171173yesterday.  You can see that we start at about the 13/bin rate for the
    172174first period of the test, during which I had jobs running on 137
    173 nodes[1].  You can see the period around 6pm last night when I crashed
     175nodes^*^.  You can see the period around 6pm last night when I crashed
    174176pantasks and waited a bit to restart the system.  Then you can see the
    175177rate goes up to about 20/bin for the last part of the test, during
     
    194196[[Image(throughput.20091104.camera.png)]]
    195197
    196 [[Image(ganglia-throughput-20091104.png)]]
    197 
    198 [1] -- roughly : ipp005 and ipp039 came in and out of the list at
     198^*^ roughly : ipp005 and ipp039 came in and out of the list at
    199199different times.