IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links
wiki:PS1_IPP_Czarlog_20150406

Version 10 (modified by eugene, 11 years ago) ( diff )

--

PS1 IPP Czar Logs for the week 2015.04.06 - 2015.04.13

    1. PS1 IPP Czar Logs for the week 2015.04.06 - 2015.04.13
      1. Monday : 2015.04.06
      2. Tuesday : 2015.04.07
      3. Wednesday : YYYY.MM.DD
      4. Thursday : YYYY.MM.DD
      5. Friday : YYYY.MM.DD
      6. Saturday : YYYY.MM.DD
      7. Sunday : YYYY.MM.DD

(Up to PS1 IPP Czar Logs)

Monday : 2015.04.06

  • 15:30 MEH: starting the regular restart of nightly pantasks
  • 15:40 MEH: ippc0x apache servers low on disk space, restarting apache and purging old log
  • 15:50 Haydn reports ipp017 back up, put into neb-host repair
    • clearing old and then stalled WS diff distribution -- files got cleaned again.. so update again
  • 17:30 MEH: ipp088,090,093,095,097 all in repair -- put to neb-host up and see if past getting slammed since earlier storage nodes are red..
  • 19:50 MEH: slow processing, nightly nodes still on in PV3 diff
  • 20:50 MEH: reg fault backing up processing?
  • 22:55 MEH: killed long running thread db00

Tuesday : 2015.04.07

  • 09:25 EAM : today, we are changing the nebulous database mysql master from ippdb00 (nearly full disk) to ippdb08 (new hardware). Here are my notes on the process:
    • 09:25 EAM : stopping the various pantasks (~ipp/*, ~ipptest/pv3diff*, ~ipplanl)

Wednesday : YYYY.MM.DD

Thursday : YYYY.MM.DD

Friday : YYYY.MM.DD

Saturday : YYYY.MM.DD

Sunday : YYYY.MM.DD

Note: See TracWiki for help on using the wiki.