IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links
wiki:PS1_IPP_Czarlog_20130805

Version 15 (modified by watersc1, 13 years ago) ( diff )

--

PS1 IPP Czar Logs for the week 2013.08.05 - 2013.08.11

(Up to PS1 IPP Czar Logs)

Monday : 2013.08.05

Bill is czar today.

  • 09:00 queued M31 r band exposures from 2010-11-15 - 2012-12-31
  • 09:30 Rita is shutting down ipp031 and ipp032
  • 12:40 MEH: 2x compute3 off in stack and 1x compute3 deepstack for MD01 refstack - will turn off and on when finished/as needed
  • 13:06 stopping processing for schema update (ippRelease and relExp tables only)
  • 13:38 rebuilt tag with schema changes psbuild -start glueforge . Restarting pantasks except for deepstack whose running processes survived the rebuild. Since Ohana was not rebuilt the pantasks processes should be fine.

Tuesday : 2013.08.06

  • 09:02 Bill queued m31 rband exposures from 2011
  • 13:50 MEH: if compute3 is off in stack, then they are in use for deepstack. will try to squeeze in runs while M31 (ie no LAP stacks) running
  • 15:07 Bill rebuilt tag to add relExp.mcal column to schema. Restarted stdscience.
  • 15:50 Bill is running a script on ippc30 that will run a couple hundred thousand releasetool -updaterelexp commands. It is unlikely that this will affect anything.

Wednesday : 2013.08.07

  • 09:04 Bill nightly science is bogged down with warps wanting to put data on stsci07 and stsci17. Setting chip.off and bg.off. Perhaps we should turn off the warp.bg tasks when processing nightly science.
  • 09:25 CZW: Since the load on the stsci nodes is basically zero, I increased the "unwant" parameter in stdscience: "controller parameters unwanted_host_jobs = 10". This was 7, and my hope is that we can get through the backlog for the stsci node jobs by increasing the number of remote jobs that will write to those disks. This assumes that the stsci nodes continue to have low loads.

Thursday : 2013.08.08

Friday : 2013.08.09

Saturday : 2013.08.10

Sunday : 2013.08.11

Note: See TracWiki for help on using the wiki.