IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 10 and Version 11 of PS1_IPP_Czarlog_20161128


Ignore:
Timestamp:
Dec 1, 2016, 4:48:17 PM (10 years ago)
Author:
Mark Huber
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • PS1_IPP_Czarlog_20161128

    v10 v11  
    3232  * 12:10 CZW: I'm increasing the loading of the ipptest/replication pantasks to speed up the MRTCB->ITC raw shuffle.  This increase will use 6 times loading of the x2 and x3 nodes.  The notes for this process are listed [wiki:ITC_shuffle on the wiki here].  It would be helpful if czars can check on this pantasks every day or so, and try to kill hung jobs.  The standard execution time is about 400-600s, so jobs with times in the 6000+s range are probably having mount issues.  The wiki page discusses the ways I've been dealing with this (kill the jobs, restart nfs if needed to clear bad mounts).  Although it's best to have things complete, failed jobs can be easily retried. 
    3333  * 15:20 CZW: I began getting concerned that the czartool page hadn't noted that those new nebulous volumes were up.  Restarted czartool and roboczar scripts.
    34   * MEH: large set QUB warp updates started and targeting ipp100+ 
     34  * MEH: large set QUB/MOPS warp updates started and targeting ipp100+, running ~ippmops/stdscience using ipps nodes (for now)
    3535=== Friday : 2016.12.02 ===
    3636