IPP Progress Report for the week 2010.04.12 - 2010.04.16

(Up to IPP Progress Reports)

Eugene Magnier

Heather Flewelling

• processing czar 04-12-2010
• Taught Roy about processing tasks as they came up.
• sorted out ISP summitcopy - datastore issues. Erik Small made ISP datastore behave more like gpc1, Bill figured out how to get around problems like this in the future.
• ISP registration - ISP images now register to camera stage, with camera label (only the OBJECT ones, ones which could potentially be processable), ISP registration merged in with gpc1
• created ISP wiki of everything I could think of about ISP processing:
  • ​http://svn.pan-starrs.ifa.hawaii.edu/trac/ipp/wiki/ISP_Information
• stack test of different plate scale (0.0258): label is MD04.20100415.scaletest.0258 , consists of 8 MD04 z band images from
  20100412. These are stuck due to failed warps (I need to sort this out). TESS_ID is MD04.V1
• answered UIP's questions about processing ISP data - this is still in progress
• added tess directories to ifaps1 (to make it more useable)
• answered ifaps1 user questions throughout the week
• Helped prepare for IFA Open House
• manned PanSTARRS booth at IFA Open House
• Helped Mike Lum (VYSOS data reduction) - this is still in progress

Bill Giebink

• Prepped PS2 pier for ground penetrating radar team
• Swapped ipp037 CPUs for new ones
• Worked with radar team to map pier

Roy Henderson

• PSPS
  • Installed the DXLayer on Maui cluster (a few issues, nothing major)
  • Created and loaded 1000 batches of real data. Handful of errors: see below

• IPP
  • Added to processing czar wiki page
  • Improvements to error handling in ippToPsps
  • Changes to arguments for ippToPsps run-script (can run for a single exposure rather than whole label)
  • PSPS survey 'type' now taken from the gpc1 Db (using 'dist_group')
  • Bugs uncovered from PSPS loading:
    • Empty ImageMeta tables created if chip extension missing from input FITS: fixed
    • NULL values in smf files going into FITS output and getting blocked by loader: fixed
    • 0.00 values for flux getting blocked by loader: investigating

Paul Price

• MOPS detection woes:
  • Inserted fake asteroids from Larry into chip stage products, manually ran through warp and diff, and shipped results. Based on detection efficiency measurement in psphot, only about 35% of asteroids (about 100 asteroids) from the input set are bright enough for detection.
  • Found SDSS report of 0.4 mag bias in asteroid photometry catalogues
  • MOPS photometry corrections don't appear to correspond to asteroid colours measured by SDSS
  • Re-running fake asteroid data with larger (10x) set of inputs from Larry
  • Depth of diff photometry appears to be g ~ 21 mag --> V ~ 20.6 mag. Chip is going to g ~ 21.9 mag, so should be doing better.
  • Shallow depth appears to be resolved with more careful combination of variance+covariance at diff stage. Recovered around 0.8 mag. Sent detailed report to ps-ipp-users and ps-mops-dev. Requires further work before merging into production system, especially worried about impact on Magic
  • Determined correct photometric corrections for MOPS: 1 mag offset in g appears to be ~0.4 mag catalogue bias + 0.5 mag photometric correction error.
• Discovered a bug in "stacktool -definebyquery": wasn't grouping by tess_id. Inputs to MD.preDM.20100409 stacks have heterogeneous tess_ids, but this hasn't affected the stacks produced because "stacktool -inputskyfile" ensures the correct tessellation is used. Set failures (from insufficient inputs with the correct tess_id) to 'drop'.

Bill Sweeney

Chris Waters