== PS1 IPP Czar Logs for the week 2014-02-24 - 2014-03-02 == [[PageOutline]] (Up to [wiki:PS1_IPP_CzarLogs PS1 IPP Czar Logs]) === Monday : 2014-02-24 === * 10:37 Bill set stdscience to stop. It is desperately in need of a restart. * serge came by and reported that the postage stamp server is slow. Restarted it and added a set of compute3 nodes. * 10:44 stdscience restarted with standard (low power host set) * restarting staticsky * 14:45 CZW: quick note on how I investigated the issue from last night: * Step 1: check that registration was working correctly: {{{ regpeek.pl }}} * Step 2: investigate the state of diffs: {{{ nightly_science.pl --debug --verbose --queue_diffs --date 2014-02-24 }}} This command does not actually execute any commands, but does the full logic check to see what's up. The interesting line is: {{{ diff_queue: Number of input warps to make diffs is not even for target OSS and object ps1_14_1783! 4 : I should declare an exposure to be qualityy. }}}, which despite the spelling error, points out that object ps1_14_1783 has 5 warps, and so it needs to exclude one (because diffs require an even number of exposures). However, this is done based on exp_id (for historical reasons), which kicks out the visit 1 instance. === Tuesday : 2014-02-25 === * 10:54 Bill: daily restart of pstamp server * 11:27 Bill: stopping staticsky in preparation to rebuild the tag to support distribution of full force runs * back to run I will do this after lunch. === Wednesday : YYYY.MM.DD === === Thursday : YYYY.MM.DD === === Friday : YYYY.MM.DD === === Saturday : YYYY.MM.DD === === Sunday : YYYY.MM.DD ===