PS1 IPP Czar Logs for the week YYYY.MM.DD - YYYY.MM.DD

(Up to PS1 IPP Czar Logs)

Monday : YYYY.MM.DD

• 22:45 MEH: power cycle ippdb01, nothing on console
  • takes ~3 min to get through mem test w/ static boot screen.. looked like one of the raids may be degraded? mysql crash seems to have recovered /var/log/mysql/mysqld.err

Tuesday : 2014.06.03

mark is czar

• 00:10 MEH: summitcopy and registration jobs stalling 7ks, pztool revert commonfaults and revert reg seems to clear but still not moving.. been long time since restart anyways, restart summitcopy, registration, stdsci. might finally be moving again after manually resetting pending_burntool for a few exposures
• 00:30 MEH: czarpoll and roboczar crash on ippc11 from ippdb01 crash -- restarted
• 00:50 MEH: since watching things still, might as well restart distribution and pstamp since have also been a while
• 08:30 MEH: repeat warp fault for memory issue -- faulting on ipp063, turned that machine off and it ran on ipp042 successfully

  o6811g0522o 	747855 	1006029 	975131 	951386 	957441 	skycell.1225.068 
  

• 08:50 MEH: looks like exposure o6811g0389o is stuck being registered -- exposure gone from summit, was bad exposure and had repeat obs for o6811g0390o. need to drop
  • pzDownloadExp already set to drop.. odd?
  • obs_type is DARK and where "missing" dark from -- set to broken

    update summitExp set exp_type = 'broken', imfiles=0, fault =0 where exp_name = 'o6811g0389o'; 
    

Wednesday : YYYY.MM.DD

Thursday : YYYY.MM.DD

Friday : YYYY.MM.DD

Saturday : YYYY.MM.DD

Sunday : YYYY.MM.DD