| 68 | 68 | * 06:15 EAM : I spent some time looking into the system throughput. last night, I turned off the LAP label for processing, in order to let the nightly processing catch up. Over night the mean processing rate was down in the 20 exp/hour range. After looking into things a bit, I suspect that this was limited by download. summitcopy was running, but a few attempts were taking 5-10 minutes. these seem to be in cases where there is an intermittent NFS glitch. In one example, a machine was trying to place results on /data/ipp018.0, and that machine had an nfs hang. While I looked into it, the hang eventually cleared without any real action on my part, but the message above about a blocked mount job seemed to have the correct timing. In summary, I suspect we are suffering these kinds of problems frequently, but the sheer number of machines and the LAP processing somewhat hide them. If LAP had been on, we probably would have had much closer to 100 exp/hour since chip, etc were running along well. |
