PS1 IPP Czar Logs for the week 2017-05-08 - 2017-05-14

(Up to PS1 IPP Czar Logs)

Monday : 2017-05-08

• 15:30 CZW: I have set ipp091 to repair, as it has had the problem parts replaced.
• 16:30 CZW: Restarting ippitc pantasks.

Tuesday : 2017-05-09

• 16:45 CZW: Restarting ippitc pantasks.

Wednesday : 2017.05.10

• MEH: now that ipp5x,6x,7x,8x,9x,10x back online at ITC, restarting the stalled cleanup of data blocking updates for stamps
• MEH: sending the missed x.20170504 data to cleanup (should have been triggered on 20170505) -- the czar on days w/ hardware interrupts and/or pantasks being down in afternoon MUST check that cleanup for the day has been triggered...
• MEH: cleaning up the distribution mess for 20170505 caused by the czar putting the past problematic ipp121 neb-host up rather than repair and ipp121.0 raid having issues even before nightly processing started according to the /var/log/messages and went unchecked until morning
  • also had some cleanup errors to fix too
• MEH: noticed odd faults for ippc64 -- looks like /local/ipp/tmp link was setup wrong

  lrwxrwxrwx 1 eugene   24 Jun 14  2013 tmp -> /export/ippc40.1/ipp/tmp
  -- changed to 
  lrwxrwxrwx 1 root     24 May 10 12:29 tmp -> /export/ippc64.1/ipp/tmp/
  

Thursday : YYYY.MM.DD

• 15:00 CZW: Restarted retired host reinsert process. ipptest user, stare02, in a screen session.

Friday : 2017.05.12

• MEH: Weryk adding ippc42-c51, ipps08-s14 to his nice'd processing set (ippc76-ippc126)
  • ippc42-c63 needed chmod 1777 done to /local/tmp, Gavin fixed ippc43 trying to mount ippc19 for homedir
• HAF: 2:45pm pantasks restart

Saturday : YYYY.MM.DD

Sunday : YYYY.MM.DD