== PS1 IPP Czar Logs for the week YYYY.MM.DD - YYYY.MM.DD == 
[[PageOutline]]

(Up to [wiki:PS1_IPP_CzarLogs PS1 IPP Czar Logs])

=== Monday : 2014.02.03 ===
 * 08:20 MEH: stdsci is down since 0330? 
{{{
[2014-02-03 03:33:29] pantasks_server[24697]: segfault at 639c2d8 ip 0000000000407d98 sp 000000004145ff50 error 4 in pantasks_server[400000+13000]
}}} 
 * 10:20 MEH: like yesterday, seeing ipp040,043,050,052 getting hung up at the end of chip_imfile.pl (sync?) and ganglia shows high cpu_wait often on them (and ipp053). taken 2/3 out of stdsci processing, that wave may also be overloaded thread-wise.
 * 17:00 MEH: adjusting the hosts being used -- while loaders down, trying to allocate back to processing with focus on more staticsky progress
  * stare 3x to staticsky
  * 
=== Tuesday : 2014.02.04 ===
 * 09:00 MEH: continuing to sort nodes in use
 * 11:00 MEH: fixed LAP camera missing .trace.update file, neb-mv file to file.bad (to add details )h
 * 21:00 MEH: difficult to fully balance w/o night data, LAP entering GC, and staticsky nearing Plane. Revised notes and table at [wiki:pantasks_hosts_summary]
  * wave3 running stack may be too much during night processing
=== Wednesday : YYYY.MM.DD ===

=== Thursday : YYYY.MM.DD ===

=== Friday : YYYY.MM.DD ===

=== Saturday : YYYY.MM.DD ===

=== Sunday : YYYY.MM.DD ===