[[PageOutline]] (Up to [wiki:PS1_IPP_CzarLogs PS1 IPP Czar Logs]) === Monday : 2012-10-29 === Serge is czar * 06:05: Still copying data from the summit (about 60 images). Nothing to worry about. * 06:10: Cleaning gpc1 of old backups preventing mysql slave to run and backups to be successfully performed. * 08:50: Nightly processing complete * 15:45 MEH: stdscience needs regular restart. will start to feed in MD05 reprocessing === Tuesday : 2012.10.30 === * 00:20 MEH: made mistake of looking at processing.. looks like ipp016 has lost it around 22:30, cannot ssh into and jobs (registration/stdscience) running there stalled but disk seems to be available (but in repair). will try to isolate for processing tonight to get going again.. then reboot. [wiki:Ipp016-crash-20121029] * MD03 also removed from nightly diffs until refstack is made. === Wednesday : YYYY.MM.DD === === Thursday : YYYY.MM.DD === === Friday : YYYY.MM.DD === === Saturday : YYYY.MM.DD === === Sunday : YYYY.MM.DD ===