IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 17 and Version 18 of PS1_IPP_Czarlog_20140106


Ignore:
Timestamp:
Jan 10, 2014, 2:55:13 PM (13 years ago)
Author:
watersc1
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • PS1_IPP_Czarlog_20140106

    v17 v18  
    2929 * 11:45 CZW: That didn't seem to work as well as I'd hoped, as the load on stsci02 immediately shot back up to 258.  I'm doing the umount -f thing on all hosts that are accessing stsci02.
    3030 * 14:00 CZW: stsci02 is still running with a load of 260, and the force umounting has done nothing to fix things.  The /var/log/messages contain entries like {{{Jan 10 13:45:01 stsci02 [10083.305233] Controller in crit error}}} which google suggests are RAID issues.  I'm beginning to suspect that this is causing all disk accesses to hang, and that's causing the problems.  I have stsci02 set to repair in nebulous, which should prevent things from writing new data there.  Since the remaining nightly data downloaded after I did this, we should be able to complete that without much difficulty. 
     31 * 14:54 CZW: Haydn reports that the raid on stsci02 is having problems, so I've set it to down in nebulous.
    3132=== Saturday : 2014-01-11 ===
    3233