PS1 IPP Czar Logs for the week 2017-05-08 - 2017-05-14

(Up to PS1 IPP Czar Logs)

Monday : 2017-05-08

  • 15:30 CZW: I have set ipp091 to repair, as it has had the problem parts replaced.
  • 16:30 CZW: Restarting ippitc pantasks.

Tuesday : 2017-05-09

  • 16:45 CZW: Restarting ippitc pantasks.

Wednesday : 2017.05.10

  • MEH: now that ipp5x,6x,7x,8x,9x,10x back online at ITC, restarting the stalled cleanup of data blocking updates for stamps
  • MEH: sending the missed x.20170504 data to cleanup (should have been triggered on 20170505) -- the czar on days w/ hardware interrupts and/or pantasks being down in afternoon MUST check that cleanup for the day has been triggered...
  • MEH: cleaning up the distribution mess for 20170505 caused by the czar putting the past problematic ipp121 neb-host up rather than repair and ipp121.0 raid having issues even before nightly processing started according to the /var/log/messages and went unchecked until morning
    • also had some cleanup errors to fix too
  • MEH: noticed odd faults for ippc64 -- looks like /local/ipp/tmp link was setup wrong
    lrwxrwxrwx 1 eugene   24 Jun 14  2013 tmp -> /export/ippc40.1/ipp/tmp
    -- changed to 
    lrwxrwxrwx 1 root     24 May 10 12:29 tmp -> /export/ippc64.1/ipp/tmp/

Thursday : YYYY.MM.DD

  • 15:00 CZW: Restarted retired host reinsert process. ipptest user, stare02, in a screen session.

Friday : 2017.05.12

  • MEH: Weryk adding ippc42-c51, ipps08-s14 to his nice'd processing set (ippc76-ippc126)
    • ippc42-c63 needed chmod 1777 done to /local/tmp, Gavin fixed ippc43 trying to mount ippc19 for homedir
  • HAF: 2:45pm pantasks restart

Saturday : YYYY.MM.DD

Sunday : YYYY.MM.DD