IPP Progress Report for the week 2010.03.29 - 2010.04.02

(Up to IPP Progress Reports)

Eugene Magnier

Heather Flewelling

• vacation Mon-Wed.
• moved into new office on Thus
• working on ISP issues

Bill Giebink

• Dealt with DNSM hydraulic fluid leak
  • Fixed leak by tightening cover plate
  • Refilled fluid to proper level
  • Cleaned up spilled oil
• Purchased spare oil filters for DNSM hydraulics
• Restarted DNSM system after power failure
• Posted photos of PS2 dome/cooling system
• Traced cabling from meteorological stations on Airglow and posted photos
• MHPCC work
  • Replaced motherboard/CPU fans in IPP 018 and 037
  • Installed new RAID card in IPP037
  • Updated BIOS setting for serial console ops on IPP 018 and 037
  • Put IPP 008, 018, and 037 in cabinets
  • Diagnosed array fan error in IPP014

Roy Henderson

• PSPS
  • Loaded yet more simulation data to Maui cluster after changes by Sue at JHU
  • Committed schema changes: some merge issues which took a little time
  • Loaded data on JHU sandbox with new schema: dealing with inevitable issues
  • PSPS meeting regarding PSI interface

• IPP
  • Learned about role of processing czar
  • Finished changes to ippToPsps after PSPS schema change

• Other stuff
  • Root canal surgery on Tuesday
  • Power cut on Wednesday

Paul Price

• SMF file corruption:
  • Sifting through SMF files to identify bad files.
  • Discovered new destreaking bug: some exposures have more than 50 chips masked in SMF, not due to NFS glitches. Occurs when skycell to chip mapping isn't identical between diff inputs. Fixed magicdstool.
• Added code for automated deletion of diff convolved images
• Shepherding M31 and STS data through the pipeline
• Added extra fields to MOPS product
• Chasing down pipeline bugs
  • Discovered pole bug in getstar or astrometric reference catalogue --> Gene
  • Changed psastro to flag exposure as bad quality when astrometry fails (since this will generally be due to there being insufficient stars), to prevent these from being reverted and repeated forever.
  • Marked SweetSpot.nightlyscience chip/cam/warp on TJD5269 as dropped because the camera warmed up (30 degrees!) and some exposures were making psphot go crazy. We need protection in the pipeline against this sort of thing!
  • Little fixes to prevent aborts and assertion failures all over
  • Newton-Raphson method for radius determination in pmModel_PS1_V1.c is failing and producing aborts; fixed by Gene
• Bundled Microtest magic clusters from 2010-03-26 and sent to Camera team
• Queued 4045 gri 3pi exposures from Demo Month for reprocessing; mainly for MOPS
• Discovered that at least some 3pi warp-warp diffs are being done against themselves. These are identifiable by fault=1, due to out-of-bounds variance renormalisation (factors ranging from 0.14 to 0.0003).

Bill Sweeney

• Most of the week was spent being processing shepherd.
  • Recovered STS template warps that were destreaked by mistake.
  • searched for data that can be cleaned up to make room for new processing
  • debugged causes of processing failures and had Paul fix them
  • managed labels and survey task inputs to match the ever changing priorities
  • various changes to the ippTools to help manage data flow.
• Reorganized the way the distribution bundles are distributed over the cluster to avoid uneven use of space.
• Installed test postage stamp server and data store to avoid debugging on the live system.
• Modified the stub detectability query implementation to be compatible with current workflow.
• Half a holiday on Friday.

Chris Waters

• vacation Wed+Thu
• sent out notification of detrend distribution
• defined MD07 reference stacks