IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 67 and Version 68 of PS1_IPP_Czarlog_20131028


Ignore:
Timestamp:
Nov 2, 2013, 4:58:48 AM (13 years ago)
Author:
Mark Huber
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • PS1_IPP_Czarlog_20131028

    v67 v68  
    6060 * 16:45 everything is running again. We're still getting a significant number of faults. Now they seem to be failures to update the database due to deadlock or dropped connection.
    6161 * 19:32 since rebooting ipp060-62 progress has been smoother. Still, 50% of deepstack jobs have been failing. Currently 355 good 323 fail.
     62  * large failure is expected. this is not just deep but other refstacks etc having to be manually killed for various reasons as well (ie counter in pantasks not really meaningful)
    6263 * 22:18 reverted fault 2 stacks for label MD04.alldeeptest.20131010
     64  * thanks, but manually managing this and not necessary to revert
    6365 * 22:41 sometimes it's better not to look. The postage stamp server is clogged because Niall has a request that wants the same data that LAP is trying to process. Unfortunately for Niall, LAP has a lot of data in the queue and his jobs aren't running. This has caused the server to stop because he has the dependency queue filled up due to time of request, but is deadlocked by LAP. Lowered the priority of the PSI.BIG label to be lower than WEB.BIG so (hopefully) another user can get their jobs requested. (HINT: small jobs have a lower chance of getting blocked)
    6466  * yes that seems to be working