PS1 IPP Czar Logs for the week YYYY.MM.DD - YYYY.MM.DD

(Up to PS1 IPP Czar Logs)

Monday : 20130506

• CZW 11:50: over the weekend, I noticed that a large number of warp jobs were failing on ipp030. I disabled that host in my pantasks, and ignored it. Looking at the logs today, it appears that /local/ipp was a symlink pointing to the non-existant /export/ipp053.0/ipp. I pointed this to the correct /export/ipp030.0/ipp, and it should work again.
• 15:50 SC: Restored apache configuration on ippc01, c02, and c03 and gracefully restarted apache there. More reasonable number of active connections now.
• 15:55 SC: Changed the configuration of ippdb00 to allow up to 1300 connections: 1300 = 10 apache clients * 128 connections + 20 extra-connections. I haven't restarted the mysql server though:

  mysql> show variables like "max_connections";
  +-----------------+-------+
  | Variable_name   | Value |
  +-----------------+-------+
  | max_connections | 1024  | 
  +-----------------+-------+
  1 row in set (0.00 sec)
  
  mysql> set global max_connections = 1300;
  Query OK, 0 rows affected (0.02 sec)
  
  mysql> show variables like "max_connections";
  +-----------------+-------+
  | Variable_name   | Value |
  +-----------------+-------+
  | max_connections | 1300  | 
  +-----------------+-------+
  1 row in set (0.00 sec)
  

Tuesday : YYYY.MM.DD

• 01:20 MEH: looks like missing exposures from last night, adding to registration register.add.date 2013-05-06 gpc1 14. few burntool fix and faulted chip from missing from OTIS report now moving through as well as some reverts to clean up the red.

Wednesday : YYYY.MM.DD

• 05:45 CZW: registration crashed again around 2AM. Restarted.
• 13:44 Bill: stopping processing for rebuild.

Thursday : YYYY.MM.DD

Friday : YYYY.MM.DD

Saturday : YYYY.MM.DD

Sunday : YYYY.MM.DD