IPP Progress Report for the week 2010.03.15 - 2010.03.19

(Up to IPP Progress Reports)

Eugene Magnier

Heather Flewelling

Bill Giebink

Roy Henderson

• Maui loading:
  • Finished converting all of Jim's simulation data for loading to the cluster
  • Lots of time spent attempting to submit to ODM on Maui. Worked through the various issues with Sue:
    • Path/permissions issues
    • ODM bugs
    • Time consuming Db reset: involved logging in to 6 separate Windows machines accessed via JHU
    • Batches now successfully merging (apart from object batches, which are missing a table)

• JHU sandbox loading
  • Generated some medium deep data, but not able to load: changes needed at JHU

• IPP side:
  • Some work needed on diff code: hadn't looked at it in awhile
  • Speed concerns: large DVO Db = large lookup times. Did some tests to confirm: 16 secs with one-exposure DVO Db vs. 11 mins with current 3PI Db.
  • Values like filterID, surveyID etc now looked-up from 'init' XML config
  • Finally checked code into SVN
  • Finally got some documentation written on the Wiki
  • Improved pspsSchema2Xml script to find the relevant *.sql file for each table

Paul Price

• Queued M31 and STS processing; babysitting
• ppStack development:
  • Verified fixing half-pixel warp bug improves stacks without need for astrometry tuning
  • Fixed sign bug in ppStack transparency correction
  • Investigating stack clipping: PS1_V1 target PSF is better
  • Plugged memory leaks in ppStack that were blowing up the memory footprint
  • Reorganised flow of ppStack so that convolved and unconvolved stacks aren't both in memory at the same time
  • Made growth of rejected pixels optional, and only used for convolved stack; verified unconvolved rejected pixels are not grown
• Set up Transients data store, published demonstration set.
• Fixed camera script: was skipping chips when it couldn't find the CMF file
• Fixed destreaking scripts: was assuming we always have a dynamic mask
• Ran psphot on SAS.123 unconvolved stacks, built DVO catalogue, shipped
• New program: ppSubConvolve. This applies the (previously calculated) convolution kernel to an image, allowing quick reproduction of an inConv or refConv image.

Bill Sweeney

Chris Waters

• Processing monitoring: First set of old raw file compression is nearly finished. Monitored science processing progress.
• OTIS interface: Updated IPP->OTIS interface code, and added more control to the configuration file. Tested and confirmed that a test table uploaded to the datastore correctly.
• Detectibility server: confirmed that psphotForced calculates the values needed for this, and started work on the scripts and interface with the postage stamp server.
• Started work on a script to bundle detrend images for distribution.