IPP Progress Report for the week 2010.04.19 - 2010.04.23

(Up to IPP Progress Reports)

Eugene Magnier

Heather Flewelling

Bill Giebink

Roy Henderson

• PSPS
  • Worked a lot with Sue, specifically the reload of real data and working through bugs in flux calibration code
  • DXLayer not remembering previously loaded batches: fixed (temporarily)
  • Created new datastore product for JHU testing for Maria. Loaded with real data minus those with invalid flux values (see below).

• IPP
  • Wrote 'czartool' script to help with duties as...
  • Processing czar on Friday
  • Created SAS data for loading to PSPS
  • Investigated flux issue: now discarding detections where flux==0 and flux==NULL

Paul Price

• Investigating impact of fix to diff variance/covariance:
  • Magic on a single, skycell of synthetic data: very small increase in number of streaks, 98 --> 100 (large number presumably due to lots of unsubtracted fake transient sources in diff), though only a 0.18 mag increase in depth.
  • Verified magic calculation of variance by reproducing thresholded image.
  • Magic on a single skycell produces more clusters and streaks, but not unreasonable (triggering on artifacts: ghost, bad cell bottom).
  • Magic on a single exposure produces more streaks (5 --> 37), most due to pattern row noise, cell edges, ghosts. Some were for no apparent reason.
  • Fill factor is difficult to measure due to small number statistics, and in any case it's relative to MOPS' understanding of the area of an exposure which should be larger than the actual area of GPC1 on the sky.
  • Verified from error distribution of fake asteroid detections that the error in the noise model was causing detections to be treated as lower significance.
  • Comparison of psphot detection efficiency estimates of the limiting magnitude with empirical measurements of the noise in the image reveal problems in the noise model.
  • Corrected diff noise model using simulated data. Magnitude limit of diff is now 0.4 mag brighter than warp. Still worried about warp noise model.
  • Fixed warp noise model: covariance needs to be resampled when changing the plate scale.
  • Magic on the same exposure as before now produces 9 streaks, all are due to ghosts except 1 burn
  • Asteroid limiting magnitude is now ~ 21.7 mag, compared to ~ 22 mag before the warp fix (which was unrealistic).
• Processing czar
  • magic_id = 25663, skycell_id = skycell.1353.072 has corrupted input, cannot recreate since warps unavailable; set to drop.
  • Manually recreated input for magic 40212, skycell.1547.025.
  • Changed scripts to add date of processing to log.
  • MD pre-DM stacks completed. 36/7687 (0.5%) failed because most of the inputs were magicked.
• Queued lots of cleanups
• Added function PS::IPP::Metadata::Config->parse_list to quickly parse a list of metadatas; applied to ipp_cleanup.pl
• Fixed photometry in ppSub: analysis metadata was getting clobbered.

Bill Sweeney

Chris Waters