PS1 IPP Czar Logs for the week 2014-03-10 - 2014-03-16

(Up to PS1 IPP Czar Logs)

Monday : 2014-03-10

Bill is czar today

• 10:15 moved pstamp pantasks back to ippc17 so that the save.status task could succeed. Currently the /data partitions are not visible from the node
• 10:30 removed minimum ra cut from staticsky pantasks. This will cause a number of northern skycells between ra 16 - 18 to be processed "out of order" but once those are done the march across the sky will continue in the expected order.
• 13:16 set staticsky to stop in preparation for the network port swaps scheduled for 14:30
• 14:40 stopped the other pantasks execept replication which isn't in the list in the check_system script. Stopped it around 15:20
• 17:30 all pantasks restarted with default host configuration.... well replication is not in the list. Will check with Chris
  • replication set to run by Chris
• 20:30 some new data from summit. IPP seems to be running smoothly so far.

Tuesday : 2014-03-11

Bill is czar today

• 06:36 storage.hosts.on in staticsky
  • that macro actually doesn't work quite right. Gene repaired things around 09:28
• 11:30 cleared staticsky faults
  • fault 3 by deleting inputs with good_frac < 0.05
  • fault 4 for sky_id 477800, 477809, and 477818 by changing label to M31.LAP.ThreePi.20130717 We plan to change code to avoid model fits in the M31 region, but not right now
  • other fault 4s were reverted as there was nothing special in the logs probably died due to cluster problems
  • fault 5s all look like nfs problems so reverted those
• 15:45 restarted stdscience and pstamp pantasks

Wednesday : 2014-03-12

Thursday : 2014-03-13

Friday : 2014-03-14

Saturday : 2014-03-15

Sunday : 2014-03-16