PS1 IPP Czar Logs for the week YYYY.MM.DD - YYYY.MM.DD

(Up to PS1 IPP Czar Logs)

Monday : 2012.02.27

• 08:30 Mark: stdscience struggling, restarting. some misc camera runs @20ks

Tuesday : 2012.02.28

• 15:35 CZW: ipp039 was unresponsive, and causing large numbers of faults. Cycled the power via the console (no messages).
• 16:09 CZW: ipp009 refused to communicate with anyone as well, although this time there were messages to be saved. I'm cycling the power on it now.
• 16:25 CZW: I think everything is back online now and working ok.

Wednesday : 2012.02.29

• 06:13 Bill repaired 4 XY26 rawImfiles which had a bad copy and replicated one that only had a single instance on ippb02 that I found accidentally by entering the wrong exp_id.
• 06:20 Bill killed a couple of processes that were stuck for thousands of seconds. It looks like there may be something wrong with the psphot threading. In psphotGuessModels all threads were sleeping waiting for something to happen and not doing any work. One was a ppSub one was a ppImage. After killing and reverting the jobs completed.
• 06:30 There are many incorrect entries in the stdscience books. Pantasks has lost track of several jobs. According to the database they are full but they still have entries in the books. Time to restart stdscience.
• 06:37 Set all data with the ps_ud labels to be cleaned.

Thursday : 2012.03.01

Friday : 2012.03.02

Saturday : 2012.03.03

Sunday : 2012.03.04