PS1 IPP Czar Logs for the week 2017-08-21 - 2017-08-28

(Up to PS1 IPP Czar Logs)

Monday : YYYY.MM.DD

Tuesday : 2017-08-22

• 16:33 CZW: Restarting ippitc pantasks.

Wednesday : 2017-08-23

• 04:00 MEH: ipp104 having issues and blocking processing -- load is very very high, dmesg log looks like XFS errors/kernel panic -- set neb-host repair and try to clear -- email sent for czar to look into
• 16:36 CZW: Restarting ippitc pantasks.

Thursday : 2017.08.24

• MEH: manually clearing junk teet file mis-lablelled K2 from afternoon of 8/22... set obs_mode engineering, exp_type bad, chip label+data_group mislabel.junk, mislabel.K2.20170823.junk -- unclear why czar didn't deal with on 8/22 or 8/34 since showing red fault in chip stage on ippmonitor for the couple days

  | exp_name    | dateobs             | epoch               | comment          |
  +-------------+---------------------+---------------------+------------------+
  | o7988g0001o | 2017-08-23 02:25:56 | 2017-08-22 16:29:06 | K2 C15p24 z band | 
  

Friday : YYYY.MM.DD

Saturday : YYYY.MM.DD

Sunday : 2017.08.27

• MEH: some datanodes filling up, set to repair to keep some space for HAF/dvopsps work -- ipp100.0,102.0,103.0,104.0,117.0