Changes between Version 7 and Version 8 of IPP_Progress_Report_20101129

Timestamp:

Dec 15, 2010, 2:42:06 PM (16 years ago)

Author:

eugene

Comment:

--

IPP_Progress_Report_20101129

@@ -5 +5 @@
 
 === Eugene Magnier ===
+
+I spent much of the week preparing for the board meeting.  On friday, with no new data from the summit, we spent much of the day running an interesting experiment to judge the system throughput and bottlenecks.  We queued up a bunch of exposures for processing, and only allowed the chip stage to run.  We started with 12 active node connections, and every so often increased the number of available nodes.  As the number of nodes went from 12 to 102, there was a nearly linear growth in the number of jobs processed per unit time.  At 180, there was some degradation, and by 231, we were basically saturated.  At that point, adding more nodes was not increasing the total processed exposures.  There were three likely limiting factors: 1) the nebulous mysql, 2) the processing mysql, 3) pantasks.  It turns out that an artificial limit in pantasks was the initial culprit: there is a limit to the number of jobs which request a specific machine (even if they revert to another).  Increasing this limit increased the processing rate so that, with 273 nodes, we were able to process more jobs per node than in the first pass with 231 nodes.  At this point, we were probably limited by the nebulous mysql throughput, but we ended the experiment for they day before exploring any further.
 
 === Serge Chastel ===
@@ -14 +16 @@
  * Helped Heather with perl problems.
  * MOPS czar (and therefore IPP crypto-czar at least to speed up OSS data processing);
+
 === Heather Flewelling === 
 
@@ -25 +28 @@
 
 Vacation all week.
+
 === Bill Sweeney ===
  * Moved postage stamp server off of ippdb02 to its new (and hopefully permanent home) ippc17. First did a trial transfer Found many hundreds of GB old crufty data. Doing the transition and cleaning that stuff up took the better part of Monday. On Tuesday the actual transition appeared to go smoothly. Unfortunately one piece of the configuration was not updated so distribution posted file sets to the old database. Publishing and postage stamp server are configured differently so they worked fine. Since we had bad weather nobody noticed that nothing was getting distributed. Finally on Monday Dec 6 Mark Huber reported the problem. Fixed this by updating the incorrect table, setting faults on the incorrectly posted file sets and letting revert do the registration over again. All fixed within 15 minutes.
@@ -35 +39 @@
  * Spent Friday and some time on the weekend as processing czar.
 
-
-
 === Chris Waters ===