Changes between Version 50 and Version 51 of PS1_IPP_Czarlog_20121008
- Timestamp:
- Oct 11, 2012, 5:36:10 PM (14 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
PS1_IPP_Czarlog_20121008
v50 v51 55 55 * 08:00 (bill): restarted pstamp and update pantasks. Their pcontrols were limiting throughput I think. 56 56 * 10:25 MEH: stdscience <50% loaded, doing regular restart. looks like ipp020 has been a problem node with jobs taking long time to run on it, going to drop from stdscience processing. probably needs to be checked/rebooted. 57 * 16:40 MEH: not sure where the disk space disappeared to on ippc01, should be 10-15GB left... removing from the nebserver list in .tcshrc to see if helps the Cannot write to '/tmp/nebulous_server.log' error in stdscience. restarting stdscience and seems to. probably need to restart all pantasks...57 * 16:40 MEH: ippc01 should have ~10-15GB left on /, not sure where the disk space disappeared to and / is 100% full causing problems... removing from the nebserver list in .tcshrc to see if helps the Cannot write to '/tmp/nebulous_server.log' error in stdscience. restarting stdscience and seems to. probably need to restart all pantasks for ippc01 to be removed... 58 58 * 17:15 MEH: ipp020 looks like mounts are messed up, don't want to reboot remotely before nightly science if not have to, so isolate -- remove from all processing (was already set to neb-repair before for some reason). 59 59 * too late.. looks like at least a registration job got stalled on it... will see if can fix
