PS1 IPP Czar Logs for the week YYYY.MM.DD - YYYY.MM.DD

(Up to PS1 IPP Czar Logs)

Monday : 2018.11.10

• MEH: running gpc2 test chunk in ippps2:stdscience
• MEH: ippb21 ganglia reporting down still -- needs gmond service manually restarted again after if was down a few days ago
• MEH: ippc97 has been down for 6 days, but power still on -- if a machine goes down we need to check in on it in case it wants to catch fire (if it doesn't boot on power cycle, turn off power and let the group know) -- remove from processing group ci1 (~ippitc/ippconfig/pantasks_hosts.input)
  • power cycle didn't boot >5 min, tried again and took 3-5 min before finally did boot -- should keep an eye on -- was only up for a 10 min or so.. turning power off to it
• MEH: pstamp faults should be cleared after problem resolved (Weryk resubmitted request since the auto-restart of pantasks isn't respecting jobs in progress still and still breaking the pstamp requests) --

  pstamptool -dbname ippRequestServer -dbserver ipp113 -updatereq  -set_state stop -req_id 910578
  pstamptool -dbname ippRequestServer -dbserver ipp113 -updatereq  -set_state stop -req_id 910579
  

  • because >15 days now, need to send to cleanup so all images that did succeed don't waste space on ipp113

    pstamptool -dbname ippRequestServer -dbserver ipp113 -updatereq  -set_state goto_cleaned -req_id 910578
    pstamptool -dbname ippRequestServer -dbserver ipp113 -updatereq  -set_state goto_cleaned -req_id 910579
    

Tuesday : 2018.11.20

Wednesday : YYYY.MM.DD

Thursday : YYYY.MM.DD

Friday : YYYY.MM.DD

Saturday : YYYY.MM.DD

Sunday : YYYY.MM.DD