== PS1 IPP Czar Logs for the week 2017-08-21 - 2017-08-28 == [[PageOutline]] (Up to [wiki:PS1_IPP_CzarLogs PS1 IPP Czar Logs]) === Monday : YYYY.MM.DD === === Tuesday : 2017-08-22 === * 16:33 CZW: Restarting ippitc pantasks. === Wednesday : 2017-08-23 === * 04:00 MEH: ipp104 having issues and blocking processing -- load is very very high, dmesg log looks like XFS errors/kernel panic -- set neb-host repair and try to clear -- email sent for czar to look into * 16:36 CZW: Restarting ippitc pantasks. === Thursday : 2017.08.24 === * MEH: manually clearing junk teet file mis-lablelled K2 from afternoon of 8/22... set obs_mode engineering, exp_type bad, chip label+data_group mislabel.junk, mislabel.K2.20170823.junk -- unclear why czar didn't deal with on 8/22 or 8/34 since showing red fault in chip stage on ippmonitor for the couple days {{{ | exp_name | dateobs | epoch | comment | +-------------+---------------------+---------------------+------------------+ | o7988g0001o | 2017-08-23 02:25:56 | 2017-08-22 16:29:06 | K2 C15p24 z band | }}} === Friday : YYYY.MM.DD === === Saturday : YYYY.MM.DD === === Sunday : 2017.08.27 === * MEH: some datanodes filling up, set to repair to keep some space for HAF/dvopsps work -- ipp100.0,102.0,103.0,104.0,117.0