Changeset 28427 for trunk/ippTasks

Timestamp:

Jun 22, 2010, 6:20:00 PM (16 years ago)

Author:

watersc1

Message:

Extensive update to nightly processing code:

• Add task and automation handler to queue dqstats runs.
• Fix ns.detrends.load trange bug.
• Alter how cleanup automation happens to implement distribution cleanup and allow for finer grained controls in target/mode pairs.
• Re-enable the definition of diff cleans in the config file, but set the retention time negative to disallow it.
• Move SweetSpot from NOCLEAN to standard clean with a warp retention time of two months.

Implement new dqstats bundle code for automation, and change the acceptance criteria to be more realistic.

File:

• trunk/ippTasks/nightly_stacks.pro (modified) (4 diffs)

trunk/ippTasks/nightly_stacks.pro

@@ -6 +6 @@
     ns.initday.on
     ns.detrends.off
+    ns.dqstats.on
     ns.registration.on
     ns.burntool.on
@@ -51 +52 @@
 end
 
+macro ns.dqstats.on
+  task ns.dqstats.load
+    active true
+  end
+end
+
 macro ns.registration.on
   task ns.registration.load
@@ -92 +99 @@
 macro ns.detrends.off
   task ns.detrends.load
+    active false
+  end
+end
+
+macro ns.dqstats.off
+  task ns.dqstats.load
     active false
   end
@@ -227 +240 @@
   task.exit       0
     # nothign to do here
+  end
+  # locked list
+  task.exit       default
+    showcommand failure
+  end
+  task.exit       crash
+    showcommand crash
+  end
+  # operation times out
+  task.exit       timeout
+    showcommand timeout
+  end
+end
+
+#
+# Queue dqstats runs
+#
+task              ns.dqstats.load
+  host            local
+  periods         -poll 3600
+  periods         -exec $LOADEXEC
+  periods         -timeout 30
+  trange          22:00:00 23:59:59
+  trange          00:00:00 10:00:00
+  npending        1
+
+  task.exec
+    stdout $LOGDIR/ns.dqstats.log
+    stderr $LOGDIR/ns.dqstats.log
+    $today = `date +%Y-%m-%d`
+
+    command automate_stacks.pl --queue_dqstats --date $today
+  end
+
+  task.exit       0
+    # nothing to do here
   end
   # locked list