IPP Progress Report for the week 2010.08.16 - 2010.08.20

(Up to IPP Progress Reports)

Eugene Magnier

Serge Chastel

Heather Flewelling

Roy Henderson

• PSPS
  • generated test batches from new SAS DVO Db (see below) and converted to csv-per-frame files for Jim.
  • lots more loading of 3PI from new DVO Db. Requires a certain amount of hand-holding
  • testing of new SCR 'survey' with Sue on sandbox
  • testing then loading of SCR on Maui. Encountered big problem with duplicate batches (my fault). Sue to the rescue...
  • changes to DXLayer so that it doesn't quit when failing to contact datastore or has problems downloading

• IPP
  • fixed bug in addstar_run.pl script (non-mini DVO path was wrong)
  • SAS DVO Db creation fun with Heather
  • added framework to addstar to filter detections based on user-supplied mask in config
  • ippToPsps
    • ODM polling script now deletes from datastore once a batch is successfully loaded to ODM and merge worthy
    • investigated failures from loading: fixed one bug when zero-row detection tables cause fault at load stage
  • czartool
    • now using stacked histograms for pending/processed/faults

Bill Sweeney

• enhanced the distribution system to deal with the new "static sky" stage.
• changed psphotStack to save the configuration in a file. This is needed for distribution processing
• enhanced dvo to allow mextract to return the extrernal image id that corresponds to a given measurement. This will enable users to more easily create postage stamp requests based on data extracted from DVO.
• changed distribution of background restored data to include the variance images from the original chip and warp runs. The M31 team needs these images.
• wrote and executed scripts to bundle up the missing variance images for data distributed prior to the work discussed in the last item.
• various other bug fixes.
• looked into problem of streaky stacks reported by a user. The problem is a race condition in our processing. Destreak does not wait for nightly stacks to be completed.
• 1 day vacation, 1 day state holiday

Chris Waters

• Automation: added handlers to pass macros to pantasks at the end of each stage. This allows us to turn on and off destreak between chip queuing and stack finishing. This should fix the issue of destreaking warps before they have been stacked.
• Linearity: worked on implementation of software linearity fix for ppImage. Added linearity correction detrend information to database.