== PS1 IPP Czar Logs for the week 2015.01.26 - 2015.02.01 == [[PageOutline]] (Up to [wiki:PS1_IPP_CzarLogs PS1 IPP Czar Logs]) === Monday : 2015.01.26 === * 04:30 EAM: ipp044 crashed, nothing on console. rebooting. * 04:45 EAM: ipp044 having trouble on reboot. I set it down in nebulous. * 05:00 EAM: ipp044 still not returning. i've shutdown stdscience and i'm clearing hung nfs mounts * 05:40 EAM: ipp044 mounts on the storage nodes are clear, stdscience restart. clearing computes as well * 05:50 EAM: looks like everything is clear, ipp044 is still down. stdscience, stdlocal, stdlanl are all back up and running. * 07:30 MEH: manually had to clear exposure fault in registration for o7048g0547o {{{ regtool -dbname gpc1 -revertprocessedexp -exp_id 863126 }}} * 08:00 EAM: stopping and restarting stdlocal (110k warps) === Tuesday : YYYY.MM.DD === === Wednesday : YYYY.MM.DD === === Thursday : YYYY.MM.DD === === Friday : YYYY.MM.DD === === Saturday : YYYY.MM.DD === === Sunday : YYYY.MM.DD ===