Changes between Version 2 and Version 3 of CZW_notes

Timestamp:

Dec 18, 2013, 1:20:59 PM (13 years ago)

Author:

watersc1

Comment:

--

CZW_notes

@@ -59 +59 @@
 
 The paused/new hosts are in that state as it seems that running more than ~5-6 of these cause the entire cluster to have issues.  It looks like the replications put the disks under slightly more load then they can handle while staying in processing.  The other issue is that the scan goes very quickly until ~2012, at which point the previous backup nodes were full, and second copies began being placed on other storage nodes.  The upside of this is that when the rawcheck task gets to this point, it will have less work to do on these nodes, as they will already have constructed their required backup node instance.
+
+== extra cleanup ==
+
+I have a label goto_cleaned_redo that I've been adding to the cleanup pantasks when it doesn't have any other jobs to do.  This is re-cleaning all the old chip data, with the goal of removing chip CMF files that have a valid SMF file.  This should gain a reasonable amount of disk space, but the operation is slow (there are currently 360k runs to work through).  Because this label will flood out the standard cleanups (which remove images and are therefore more effective at freeing space), it can't be left in the pantasks permanently.