Changes between Version 77 and Version 78 of PS1_IPP_Czarlog_20121126

Timestamp:

Nov 29, 2012, 10:45:18 AM (14 years ago)

Author:

Mark Huber

Comment:

--

PS1_IPP_Czarlog_20121126

@@ -83 +83 @@
  Mark is czar
  * 06:45 Bill: ipp011 is not a good nebulous host. Killed stuck registration jobs there. restarted registration. In the process of checking the burntool states
- * 07:00 MEH: ipp011 was another lm_sensors module/kernel issue crash [wiki:ipp011-crash-20121129] -- don't reboot until after stdscience is done. 
+ * 07:00 MEH: ipp011 was another lm_sensors module/kernel issue crash [wiki:ipp011-crash-20121129] -- don't reboot until after stdscience is done, to avoid breaking anything since data disks are still accessible if necessary
   * tally of similar machines having this problem recently -- ipp011, 012, 010, 016, 013, 014, 018, may be others but not enough info added to ippXXX_log or czarlog pages to tell
  * 07:02 Bill: stopped pantasks. summit copy is totally clogged with stuck ipp011 jobs. Will restart once the jobs clear.
@@ -92 +92 @@
   * LAP+MD01 labels out so only nightly science is processing
  * 09:27 Serge notes that a common czartool/page stall is from one of the mysql replication servers being stuck (usually will get email about "Copy failed") because the partition where it is at is full. Was the case for ipp001 today, freeing space on the partition solved the problem.
- * 10:35 Serge suggests stopping cleanup to see if speeds up nightly science.
+ * 10:35 Serge suggests stopping cleanup to see if speeds up nightly science --
 === Friday : 2012.11.29 ===