IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 50 and Version 51 of PS1_IPP_Czarlog_20121008


Ignore:
Timestamp:
Oct 11, 2012, 5:36:10 PM (14 years ago)
Author:
Mark Huber
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • PS1_IPP_Czarlog_20121008

    v50 v51  
    5555 * 08:00 (bill): restarted pstamp and update pantasks. Their pcontrols were limiting throughput I think.
    5656 * 10:25 MEH: stdscience <50% loaded, doing regular restart. looks like ipp020 has been a problem node with jobs taking long time to run on it, going to drop from stdscience processing. probably needs to be checked/rebooted.
    57  * 16:40 MEH: not sure where the disk space disappeared to on ippc01, should be 10-15GB left... removing from the nebserver list in .tcshrc to see if helps the Cannot write to '/tmp/nebulous_server.log' error in stdscience. restarting stdscience and seems to. probably need to restart all pantasks...
     57 * 16:40 MEH: ippc01 should have ~10-15GB left on /, not sure where the disk space disappeared to and / is 100% full causing problems... removing from the nebserver list in .tcshrc to see if helps the Cannot write to '/tmp/nebulous_server.log' error in stdscience. restarting stdscience and seems to. probably need to restart all pantasks for ippc01 to be removed...
    5858 * 17:15 MEH: ipp020 looks like mounts are messed up, don't want to reboot remotely before nightly science if not have to, so isolate -- remove from all processing  (was already set to neb-repair before for some reason).
    5959  * too late.. looks like at least a registration job got stalled on it... will see if can fix