== PS1 IPP Czar Logs for the week YYYY.MM.DD - YYYY.MM.DD == 
[[PageOutline]]

(Up to [wiki:PS1_IPP_CzarLogs PS1 IPP Czar Logs])

=== Monday : 2014.06.16 ===
mark is czar
 * 09:10 MEH: dupe warp_id for couple exposures confusing OSS.WS diffims -- Bill notes that timeout in the faketool errors in the stdsci logs probable cause
 * 09:15 Serge also reports have messed up the required WW diffims for MOPS (v2-v3 and not the v1-v2,v3-v4) -- will need to requeue manually
 * 11:00 MEH: requeued diffims for stdsci processing after turning off all s0,s1 being used for other processing by Gene
{{{
| pub_id | client_id | stage_id | label              | state |
+--------+-----------+----------+--------------------+-------+
| 897818 |         5 |   566155 | OSS.nightlyscience | full  | 
| 897819 |         5 |   566156 | OSS.nightlyscience | full  | 
| 897820 |         5 |   566157 | OSS.nightlyscience | full  | 
| 897821 |         5 |   566158 | OSS.nightlyscience | full  | 
}}}
 * 12:00 MEH: regular restart of pantasks for the week
 * 12:25 MEH: ippc02 /tmp had ~6.5G available, flushed nebulous_server.log and restarted apache. others have ~13G 
 * 12:40 MEH: ippc18 homedir needs cleanup ~18G available -- start archive of pantasks logs
 * 17:45 CZW: Promoted images in state compressed to state goto_lossy and enabled lossy compression in cleanup in attempt to recover disk space.
 * 20:10 MEH: system overloaded.. 4x4theaded loading of stacks on systems w/ 8 cores and needed for summitcopy+registration+stdscience. registration taking >1ks, stopping to clear. stdsci stop until stacks clear
 * 20:30 back on
=== Tuesday : YYYY.MM.DD ===

 * 16:11 HAF - I stopped the slave on ipp001 to ingest a copy of gpc1 (this is for multiple purposes, to have a spare gpc1 database to play with for forcedwarp addstar, and to recover from my own stupidity involving updating a minidvodb table yesterday...)
=== Wednesday : YYYY.MM.DD ===

=== Thursday : YYYY.MM.DD ===

=== Friday : YYYY.MM.DD ===

=== Saturday : YYYY.MM.DD ===

=== Sunday : YYYY.MM.DD ===