Changes between Version 18 and Version 19 of PS1_IPP_Czarlog_20150810

Timestamp:

Aug 13, 2015, 12:28:47 AM (11 years ago)

Author:

Mark Huber

Comment:

--

PS1_IPP_Czarlog_20150810

@@ -48 +48 @@
  * 16:45 MEH: ipp074 has been in repair since last saturday due to concern w/ VFS: file-max limit, putting back up -- if it needs to be rebooted we need to reboot, but keeping nodes in repair like this creates an unbalance of space and part of the problem ending up with few nodes (with lots of space) for data and decimating nightly processing..
  * 20:20 MEH: processing faults all over, ipp062 disk unavailable -- XFS failure -- luckily in repair for nightly processing, neb-host down, all jobs need to be removed, addstar stopped, and at some point xfs_repair done.. hopefully not file lost case like ipp018 [wiki:PS1_IPP_Czarlog_20150105]
-  * had to reboot on console to umount disk -- also need to turn off swap before umount because swap is on that disk -- 
+  * had to reboot on console to umount disk -- /var/log/messages likely doing the metadata recovery needed
+{{{
+Aug 12 22:46:31 ipp062 [   18.101291] XFS (sda4): Mounting Filesystem
+Aug 12 22:46:31 ipp062 [   18.372863] XFS (sda4): Starting recovery (logdev: internal)
+Aug 12 22:46:31 ipp062 [   51.890507] XFS (sda4): Ending recovery (logdev: internal)
+}}}
+  * need to turn off swap before umount because swap is on that disk -- 
 {{{
 swapoff -a