IPP Progress Report for the week 2011-09-26 - 2011-10-02

(Up to IPP Progress Reports)

Eugene Magnier

vacation

Serge Chastel

Heather Flewelling

• helped serge with condor stuff (queueing of JT stacks for testing, answered many questions)
• helped roy with dvodb stuff
• investigated GALFit (via Jim) as a sanity check against our code
• czar 1 day
• cleaned up ipp006 when I discovered it was full (why was it full?)
• sick 1 day

Roy Henderson

• huge speed-up for ipptopsps by using multiple 'clients'. This included:
  • lots of headaches with TRANSACTIONS and LOCK TABLES to protect the critical section of the database when queuing multiple clients
  • with a mysql LOCK in place, it was necessary to speed-up a lot of my queuing queries to avoid deadlock
  • each process now stores its PID and hostname for unique log-naming
  • lots of monitoring to check things were running smoothly
  • some tricky clean-up after a screw-up before mutex was properly implemented

• other ipptopsps development:
  • added coordinate constraints to queuing query so we can load certain regions of old 3PI data
  • datastore class now takes an ipptopsps database object to constructor so it can update the database itself
  • changes to cleanup code: now only deletes from local disk batches that have been merged

• other:
  • duplicate exp_ids in DVO broke merge, some cleanup work with Sue was required
  • more cleanup work with Sue later in the week when DXLayer stopped and local files were deleted
  • filled up /var with mysql logs: Gavin kindly moved mysql data dir to data partition, and reduces logging retention time
  • some help getting DXLayer to start again: too many subdirs
  • changes to PSPS news page to reflect current status after the merge

Mark Huber

Bill Sweeney

• medical leave for surgery
• start work on reprocessing the 2010 M31 data with the new tessellation.

Chris Waters