IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links
wiki:PS1_IPP_Czarlog_20180820

Version 2 (modified by eugene, 8 years ago) ( diff )

--

PS1 IPP Czar Logs for the week 2018.08.20 - 2018.08.26

    1. PS1 IPP Czar Logs for the week 2018.08.20 - 2018.08.26
      1. Monday : YYYY.MM.DD
      2. Tuesday : YYYY.MM.DD
      3. Wednesday : 2018.08.22
      4. Thursday : YYYY.MM.DD
      5. Friday : YYYY.MM.DD
      6. Saturday : YYYY.MM.DD
      7. Sunday : YYYY.MM.DD

(Up to PS1 IPP Czar Logs)

Monday : YYYY.MM.DD

Tuesday : YYYY.MM.DD

Wednesday : 2018.08.22

  • 16:50 EAM : with Hurricane Lane approaching, we have shutdown most of the IPP services. Here is the current status:
    • compute nodes shutdown
      • ippc20 - ippc69, ippc78 - ippc256 (all ex. ippc18, ippc19, ippc70-c77)
      • ippx001 - ippx088
      • ipps00 - ipps14
      • stare00 - stare04
      • ippb04 - ippb23
    • datastore requests were causing hung disk load on ipp113 (because ippc64 is offline?). I shutdown the apache on ipp113 temporarily, then disabled the proxy on ippops1 (by moving 07_datastore... to .disable).
    • nebulous slaves on ippdb01, ippdb06, ipp121 stopped (save a clean snapshot); mysql on the slave machines shutdown (to prevent corruption)
    • gpc1 mysql slaves on ippdb05 and ipp116 stopped (save a clean snapshot); mysql on the slave machines shutdown (prevent corruption)

Thursday : YYYY.MM.DD

Friday : YYYY.MM.DD

Saturday : YYYY.MM.DD

Sunday : YYYY.MM.DD

Note: See TracWiki for help on using the wiki.