Current Tasks for the IPP Team

(Up to Main Page)

Tasks for the Immediate Future

• finish work on the kernels as a function of input IQ (PAP - done?)
• demo test through magic with full updated code + updated detrends (PAP / HAF)

• double-check the masks / comparison with old masks (HAF / CZW)
• check on excess source detections in flatcorr.20100124 chips (CZW)
• generate the y-band master fringe frame (req. flat-field corrections in y) (CZW)

• update ppImage to apply PATTERN to specific chips/cells only (PAP)
• update the camera format to recognize the 'raw' temperature values for the near term. (PAP)
• update camera format / camera config to have the 'PATTERN' applied in full to data pre-Dec 9 (PAP -- ok after Wed)

• psphot work:
  • update the CR masking code to be faster (using pointers, not psImageGet/Set) (EAM)
  • update the source size classifications to limit the number of candidates CRs (limit by brightness?) (EAM)
  • limit max source detections is psphot (EAM)
  • finish other psphot mods (perhaps after Wed & merge) (EAM)
  • merge our working branch into the mainline (PAP / EAM)

• apply the new darks, flats, masks to the flat-field calibration data and generate flat-corrections
  • check on results / fix errors / finish (EAM)
• apply the updated flat corrections to the flats (EAM)

Eugene Magnier

• extended sources
  • set upper limits on Petrosian radii
  • make sure new structures are linked into output functions
  • generate a more complete test set & run tests
• more data organization work on Manoa & MHPCC clusters
• ingest giebink stuff into svn trunk

Heather Flewelling

• set up ps1 ifa ippMonitor pointing at local updated copy
• double-check masks
• work with Paul on small demo set through magic
• learn & run addstar

Bill Giebink

• DIMM work
• psLib & psModules test code
• build a "realtest"

Roy Henderson

• PSPS interface bugs
• demo samples
• IPP-PSPS stack output

Paul Price

• code fixes above
• -photometry bug (pswarp?)
• run dual-diffs tests

Bill Sweeney

• move datastore to ippcNN
• fix 'update' mode
• get data for MPG
• addstar DVO data
• destreak cleanup (minor bug fix)
• pstamp
  • meet with NCU folks on pstamp web interface
  • update user documentation
  • stamps from cleaned runs - write tasks for detecting update completion
  • enhance web interface with new features

Chris Waters

• check into excess detections
• double-check masking
• source size examination
• assessment of stacking detection limits

Natalia Primak

• simtest input / output consistency checks
• simtest visualizations

Cindy Giebink & Steph Mohr

• memtests on ippdb02 (after ippdb00 neb swap)
• cluster upgrade (ippdb01)
• debug hardware problems on ipp005, 8, 9, 14, 16, 18
• move homedirs to ippc18
• areca scripts for automatic verify

KPAT / DRAVG Priority Issues (+ Notes)

• latency
  • we have performed a throughput demonstration which meets requirements.

• magic masking
  • the latest large-scale run had a median streak count of 8.
  • we need to make an assessment of the current state of masking by masking bit (both warp and chip)
    • Heather has made an initial assessment of the masking using ~100 individual chips and warps. If this was done for 100 chip Files (not chip Runs) and equivalently for warps, then we need more statistics to say something useful.

• stacking: noise correlation
  • we believe this has been addressed by Paul's recent work
    • we need an independent assessment if this is still an issue
  • Nigel is concerned about the photometry of psfs in the stacks
    • Nigel and Paul have both been investigating the situation. Some conclusions:
      1. the latest version of the code (eg, stack_id 25532) results in scatter in psf magnitudes which are larger than the warp-warp photometry (0.04 vs 0.03).
      2. the aperture magnitudes seem to be in better agreement, which says the pixels are probably OK
      3. Paul started to use simtest to verify the quality of the pixel photometry

• diff images: residuals and noise correlation
  • we have made some good progress on this with the dual convolution technique, and will generate a set of test images this week.
    • this is critical : as of 2009/11/23 this has not been done
  • another significant source of residuals comes from poor astrometry
    • Gene has investigated the astrometry failures and improved the analysis (outlier clipping). Also, several cases of poor astrometry resulted from stars being falsely identified as cosmic rays and the wings being used in the fit instead. this should now be fixed in psphot.
  • we also also working on improving the quality of the detection analysis and the associated photometry in the diff images
    • Gene will be making this top priority again week of 2009/11/23 (this has been on the back burner while the astrometry issues were studied)

• astrometry: some catastrophic failures (offsets>3")
  • some progress made in some extreme fields (M42). this may also result in improvements in other poor situations. otherwise under investigation.
  • Gene has included a number of fixes. there is a bit more work to make sure the warps do not use poor astrometry results.

• xtalk artifacts.
  • for the near term, we will address this by masking the worst offenders in the camera masking stage.
  • still need to pin down the xtalk rules, but we can implement the xtalk we know.
  • as of 2009/11/23, this xtalk masking has been implemented by Chris, but with only limited testing to date.
  • Mark Huber says (preliminarily) it is looking good

• other image artifacts.

• photometric calibration
  • the zero point is now being calculated from the 'blue edge' of the ref - raw magnitude distribution to reduce the impact of halo stars. The error analysis is now done using bootstrap-resampling, but this can only tell us about the random errors, not the systematic errors from field-to-field.

• star/galaxy separation
  • Eddie has made some plots of the quality of the current S/G flag: PS1_rates. The rules still need to be tweaked.

Other Near-Term Goals

• address warp failures (photometry problem on 3 warps in throughput test)
• someone needs to put together code that feeds back quality info to summit

• make white light dome flats (including w)
• make new flat-field corrections
• make new masks
• iterate on the darks