PS1 IPP Czar Logs for the week 2014.05.26 - 2014.06.01

(Up to PS1 IPP Czar Logs)

Monday : 2014.05.26

Tuesday : 2014.05.27

Wednesday : 2014.05.28

• 07:40 EAM : stdscience running a bit slow so I'm restarting it.
• 11:45 EAM : graceful shutdown of cluster for planned power outage at MRTC-B
• 16:15 CZW : All hosts back online, nebdiskd restarted, czartool scripts restarted, all pantasks servers restarted.
• 16:30 CZW : I've stopped pantasks servers to see if memory issues Mark has noticed will be fixed.
• 17:00 CZW : Haydn has fixed the ippdb01 memory issue, which was the biggest concern. I've set the pantasks servers to run.
• 17:15 MEH: rebooted ippc58 to get the memory back -- restarting staticsky now -- no, concerned with setup to use --

  #PV2 staticsky build
  set build = ipp-20140114
  # sas test build
  set build = ipp-trunk-20140404
  

Thursday : 2014.05.29

• 20:50 MEH: stack nodes idle w/o LAP stacks now, reallocating for MD refstack and staticsky unless nightly MD06 stacks need to be made
  • it wasn't noted that LAP staticsky was using the stack nodes.. slight overload going on now..

Friday : 2014.05.30

Saturday : 2014.05.31

Sunday : 2014.06.01