== IPP Progress Report for the week 2010.03.15 - 2010.03.19 == [[PageOutline]] (Up to [wiki:IPP_Progress_Reports IPP Progress Reports]) === Eugene Magnier === === Heather Flewelling === === Bill Giebink === === Roy Henderson === * Maui loading: * Finished converting all of Jim's simulation data for loading to the cluster * Lots of time spent attempting to submit to ODM on Maui. Worked through the various issues with Sue: * Path/permissions issues * ODM bugs * Time consuming Db reset: involved logging in to 6 separate Windows machines accessed via JHU * Batches now successfully merging (apart from object batches, which are missing a table) * JHU sandbox loading * Generated some medium deep data, but not able to load: changes needed at JHU * IPP side: * Some work needed on diff code: hadn't looked at it in awhile * Speed concerns: large DVO Db = large lookup times. Did some tests to confirm: 16 secs with one-exposure DVO Db vs. 11 mins with current 3PI Db. * Values like filterID, surveyID etc now looked-up from 'init' XML config * Finally checked code into SVN * Finally got some documentation written on the Wiki * Improved pspsSchema2Xml script to find the relevant *.sql file for each table === Paul Price === * Queued M31 and STS processing; babysitting * ppStack development: * Verified fixing half-pixel warp bug improves stacks without need for astrometry tuning * Fixed sign bug in ppStack transparency correction * Investigating stack clipping: PS1_V1 target PSF is better * Plugged memory leaks in ppStack that were blowing up the memory footprint * Reorganised flow of ppStack so that convolved and unconvolved stacks aren't both in memory at the same time * Made growth of rejected pixels optional, and only used for convolved stack; verified unconvolved rejected pixels are not grown * Set up Transients data store, published demonstration set. * Fixed camera script: was skipping chips when it couldn't find the CMF file * Fixed destreaking scripts: was assuming we always have a dynamic mask * Ran psphot on SAS.123 unconvolved stacks, built DVO catalogue, shipped * New program: ppSubConvolve. This applies the (previously calculated) convolution kernel to an image, allowing quick reproduction of an inConv or refConv image. === Bill Sweeney === === Chris Waters === * Processing monitoring: First set of old raw file compression is nearly finished. Monitored science processing progress. * OTIS interface: Updated IPP->OTIS interface code, and added more control to the configuration file. Tested and confirmed that a test table uploaded to the datastore correctly. * Detectibility server: confirmed that psphotForced calculates the values needed for this, and started work on the scripts and interface with the postage stamp server. * Started work on a script to bundle detrend images for distribution.