Changes between Version 107 and Version 108 of PS1_IPP_Czarlog_20141201

Timestamp:

Dec 6, 2014, 3:07:21 PM (12 years ago)

Author:

Mark Huber

Comment:

--

PS1_IPP_Czarlog_20141201

@@ -183 +183 @@
  * 12:50 MEH: systems turning back on but nothing should be started until deal with nebulous db log -- will send out email when ready to go
   * ipp055,057 recovered some memory lost from before the shutdown, yay
-  * ipp054 lost some memory -- powercycle to try to recover
-  * stsci12 booting but will need to be taken down again to replace a power supply
+  * ipp054 lost some memory -- powercycle to try to recover -- done and ok now
+  * stsci12 booting but will need to be taken down again to replace a power supply -- done
  * 14:40 MEH: db machines up and logs seem okay (slave positions match etc) except lately (since 10/14) the nebulous mysqld.err log has many many such entries
 {{{
@@ -190 +190 @@
 InnoDB: many active transactions running concurrently?
 }}}
+  * ippc17 mysql seems okay
   * ipp067,stsci09 still down?
   * compute nodes booting, so many nodes..
   * starting slow scan for all data node mounts  
   * stsci12 power supply replaced
+  * when all datanodes up, ipp will start nebdiskd on ippdb00
+
+
 === Sunday : 2014.12.07 ===