
IPP Subsystems Outstanding Tasks
 - work still to be done
 * who / effort (* : day; ** : week)

Build / Config / PSLib 
 - add static IPP, Ohana-stand-alone builds
 * EAM +

Detrend Construction
 - tweak parameters
 * WS ++ 

Single Science Image Analysis

 - determine photmetry zero point in psastro
 * EAM +

 - more robustness for psphot / psastro
   (substantial work done; more needed)
 * EAM ++

 - psphot optimization and threading 
   (some work done; more needed)
 * EAM ++

 - control psphot memory footprint
 * EAM ++

 - threading for ppImage
 * PAP ++

Image Combinations
 - top-level automation and recipe tuning (extended sources ON)
 * PAP ++
 * JH ++

 - input source lists / forced photometry
 * at large +

Magic
 - Integration
 * WS ++ (2x)

Calibration
 - finish outlier flagging in relphot
 * EAM +

 - measure 2D color-correction model
 * EAM ++

 - finish absphot
 * EAM ++

Postage Stamp Server
 - finish web pages / cleanups
 * WS ++

 - magic interface / release flags / re-processing
 * WS ++

DVO
 - optimizations for Image / Object / Detection indexes
 * EAM ++

 - various minor bugs
 * EAM ++

Output Tables
 - PSPS : extract calibration from DVO
 * EAM +

Automation 
 - high level automation needed
 * at large ++

OT Guiding Issues
 - test kernel generation / application
 * PAP ++

Cleanup / Reprocess Tasks
 oo create full pipeline
 * WS ++
 * JH ++

Reference Catalogs
 o validate synth.grizy
 * EAM ++

----

Summary:
EAM : 10 x ++, 3 x +
PAP :  6 x ++, 1 x +
JH  :  6 x ++, 1 x +
WS  :  6 x ++, 1 x +

----

Completed since 2008.04:

Nebulous
 o failover automation
 * JH ++

Build / Config / PSLib 
 o minor outstanding organizational improvements
 * JH ++

Single Science Image Analysis

 o move psastro to camera stage only
 * at large +

 @ ppStack optimization (sufficient for ORR)
 * PAP ++

 @ ppSub optimization (sufficient for ORR)
 * PAP ++

Output Tables
 o convert psphot output to MOPS input
 * WS +

 o set up summit copy server
 * JH +

Fake Source Pipeline
 o ippTools & integration work needed
 * PAP ++
 * JH ++

Regression Test Suite 
 o set up repository and scripts
 * JH ++

o(almost finished!)
Cleanup / Reprocess Tasks
 oo create full pipeline
 * WS ++
 * JH ++

----

Not needed for ORR 

Detrend Construction
 @ visualization
 * at large +
 
 @ color-correction grid in flat-correction
 * EAM ++

Single Science Image Analysis
 @ more output detrend application metadata needed
 * at large +

Image Combinations
 @ more visualization / output metadata
 * PAP +

Visualization
 @ more plots in ippMonitor
 * at large ++

OT Guiding Issues
 @ measure video astrometry / photometry
 * EAM ++

----

EAM Tasks:

 o finish psphot galaxy models
 o finish summit copy multi-DBs / test
 - test summit copy multi-DBs
 - Virgo PR pics
 - Stripe 82 CFHT / 2MASS comparisons

** psphot work
 - more robustness for psphot / psastro                     (1w)
 - determine photometry zero point in psastro		    (1d)
 - psphot optimization and threading			    (1w)
 - control psphot memory footprint			    (1w)

** DVO work
 - finish outlier flagging in relphot			    (1d)
 - DVO optimizations for Image / Object / Detection indexes (1w)
 - various minor DVO bugs				    (1w)
 - measure 2D color-correction model			    (1w)
 - color-correction grid in flat-correction		    (1w)
 - finish absphot                                           (1w)

** other tasks
 - PSPS output tables : extract calibration from DVO	    (1d)
 - measure video astrometry / photometry		    (1w)
 - validate synth.grizy					    (1w)

PAP Tasks:

 - finish ppStack / ppSub tweaking (A - B is still incomplete)
 - stack / diff more visualization / output metadata
 - fake source pipeline : (ppSub and ppStack versions)
 - test kernel generation / application
 o convert psphot output to MOPS input (to IPP DS)
 o minor ippconfig outstanding organizational improvements
   (early May)
 - stack / diff top-level automation and recipe tuning (extended sources ON)
 - threading for ppImage
 - ppStack optimization (some done, close to goal for now)
 - ppSub optimization (some done, close to goal for now)

JH Tasks:

 - set up OTIS DB copy server 
 - monitor summit copy [EAM : finish summit copy multi-DBs]
 - set up regression suite repository and scripts 
 - Nebulous failover automation (< Apr 21)
 - ippTools for stack / diff automation [needs input from PAP & EAM]
 - ippTools for fake source pipeline [needs pipeline layout]
 - cleanup / reprocess pipeline(s) [needs conceptual design]

WS Tasks:

 - test flat-field correction suite
 - detrend analysis tweak parameters (megacam -> gpc1)
 - Magic integration
 - postage stamp server : finish web pages / cleanups
 - postage stamp server : magic interface / release flags / re-processing
 - cleanup / reprocess pipeline 

----

IPP Status 2008.04.01

Since about mid-November, we have been putting an increasing amount of
our time into testing portions of the IPP on large collections of data
(GPC1, Megacam, Essence, SDSS). This has slowed progress on some areas
of development, but had the important benefit of uncovering a number
of issues which needed to be addressed.  Some of these were basic
coding bugs uncovered by real data.  

One important area of concern uncovered in the test processing is the
robustness of the psphot and psastro algorithms.  While we have
addressed some of these problems, more work is still needed here,
especially for cases where the input data is somewhat marginal.  One
of our recent conclusions is that we need to isolate the photometry
analysis (psphot), which can take a long time but more consisently
succeeds, from the astrometry analysis, which is still more
fragile. We have decided to remove the astrometry analysis from the
chip processing stage, and only perform this analysis at the camera
processing stage.  This will save a lot of time in error handling for
the science image analysis.

Another area which has caused on going error-handling effort is in the
parameter configuration system.  We have decided to clean up the
organization somewhat so that more of the parameter files can
be shared by all cameras, reducing the duplication of information and
making it easier to synchronize changes to the configurations.

Paul and I had a detailed discussion this morning about the current
IPP Status and what development work is still outstanding.  I have
listed our detailed notes below, grouped by the related IPP Subsystem.
There are three significant components that need substantial work:

* Magic integration

* Fake Source Pipeline

* Cleanup / Reprocess suite

These are each about 2 weeks of dedicated effort.  The elements of the
first two of these systems are in place, but we need to finish the
integration process into the full pipeline.  The Cleanup / Reprocess
suite is a subsystem which we have been deferring, but for which we
will soon need to begin work.

In addition, we have several areas where we need to work on
improvements to the code, or to finish minor additional features
needed by the pipeline.  Some of these are:

* improvements to the code robustness, particularly for psphot and
  psastro which are not deterministic.

* optimization work for psphot, ppStack, and ppSub, including
  multithreading.

* various improvements to the photometry and astrometry calibration
  analysis, from the measurement of the zero-points in real-time to
  the application of the calibrations to the output tables to be
  delivered to PSPS and MOPS.

----

