Index: /trunk/doc/plan/ipp.status.2008.04.txt
===================================================================
--- /trunk/doc/plan/ipp.status.2008.04.txt	(revision 17360)
+++ /trunk/doc/plan/ipp.status.2008.04.txt	(revision 17360)
@@ -0,0 +1,272 @@
+
+IPP Subsystems Outstanding Tasks
+ - work still to be done
+ * who / effort (* : day; ** : week)
+
+Build / Config / PSLib 
+ - minor outstanding organizational improvements
+   - site -> named-recipes -> camera -> named-recipes -> command-line 
+   - REDUCTION -> recipes/reductions.mdc
+   - FITS -> FITS_FORMATS -> recipes/fits_formats.mdc
+   - unify filerules tables
+ * JH ++
+
+Nebulous
+ - failover automation
+ * JH ++
+
+Detrend Construction
+ - visualization
+ * at large +
+ 
+ - tweak parameters
+ * WS ++ 
+
+ - color-correction grid in flat-correction
+ * EAM ++
+
+Single Science Image Analysis
+ - more output detrend application metadata needed
+ * at large +
+
+ - move psastro to camera stage only
+ * at large +
+
+ - determine photmetry zero point in psastro
+ * EAM +
+
+ - more robustness for psphot / psastro
+ * EAM ++
+
+ - psphot optimization and threading 
+ * EAM ++
+
+ - control psphot memory footprint
+ * EAM ++
+
+ - threading for ppImage
+ * PAP ++
+
+Image Combinations
+ - top-level automation and recipe tuning (extended sources ON)
+ * PAP ++
+ * JH ++
+
+ - more visualization / output metadata
+ * PAP +
+
+ - input source lists / forced photometry
+ * at large +
+
+ - ppStack optimization
+ * PAP ++
+
+ - ppSub optimization
+ * PAP ++
+
+Magic
+ - Integration
+ * WS ++ (2x)
+
+Calibration
+ - finish outlier flagging in relphot
+ * EAM +
+
+ - measure 2D color-correction model
+ * EAM ++
+
+ - finish absphot
+ * EAM ++
+
+Postage Stamp Server
+ - finish web pages / cleanups
+ * WS ++
+
+ - magic interface / release flags / re-processing
+ * WS ++
+
+DVO
+ - optimizations for Image / Object / Detection indexes
+ * EAM ++
+
+ - various minor bugs
+ * EAM ++
+
+Output Tables
+ - PSPS : extract calibration from DVO
+ * EAM +
+
+ - convert psphot output to MOPS input
+ * WS +
+
+ - set up summit copy server
+ * JH +
+
+Automation 
+ - high level automation needed
+ * at large ++
+
+Visualization
+ - more plots in ippMonitor
+ * at large ++
+
+Fake Source Pipeline
+ - ippTools & integration work needed
+ * PAP ++
+ * JH ++
+
+Regression Test Suite 
+ - set up repository and scripts
+ * JH ++
+
+OT Guiding Issues
+ - test kernel generation / application
+ * PAP ++
+
+ - measure video astrometry / photometry
+ * EAM ++
+
+Cleanup / Reprocess Tasks
+ - create full pipeline
+ * WS ++
+ * JH ++
+
+Reference Catalogs
+ - validate synth.grizy
+ * EAM ++
+
+----
+
+Summary:
+EAM : 10 x ++, 3 x +
+PAP :  6 x ++, 1 x +
+JH  :  6 x ++, 1 x +
+WS  :  6 x ++, 1 x +
+
+----
+
+EAM Tasks:
+
+ - finish psphot galaxy models
+ o finish summit copy multi-DBs
+ - test summit copy multi-DBs
+ - Virgo PR pics (** MHPCC cluster is down!)
+ - Stripe 82 CFHT / 2MASS comparisons
+ - more robustness for psphot / psastro
+ - finish outlier flagging in relphot
+ - determine photmetry zero point in psastro
+ - psphot optimization and threading 
+ - control psphot memory footprint
+ - finish absphot
+ - DVO optimizations for Image / Object / Detection indexes
+ - various minor DVO bugs
+ - PSPS output tables : extract calibration from DVO
+ - measure video astrometry / photometry
+ - validate synth.grizy
+ - measure 2D color-correction model
+ - color-correction grid in flat-correction
+
+PAP Tasks:
+
+ - finish ppStack / ppSub tweaking
+ - convert psphot output to MOPS input (to IPP DS)
+ - minor ippconfig outstanding organizational improvements
+   (early May)
+ - fake source pipeline : ippTools & integration work needed
+   (late May)
+ - ppStack optimization 
+ - ppSub optimization
+   (early June)
+ - threading for ppImage
+ - stack / diff top-level automation and recipe tuning (extended sources ON)
+ - stack / diff more visualization / output metadata
+ - test kernel generation / application
+
+JH Tasks:
+
+ - set up OTIS DB copy server 
+ - ippTools/faketool (based on chiptool)
+ - monitor summit copy [EAM : finish summit copy multi-DBs]
+ - set up regression suite repository and scripts 
+ - Nebulous failover automation (< Apr 21)
+ - ippTools for stack / diff automation [needs input from PAP & EAM]
+ - cleanup / reprocess pipeline(s) [needs conceptual design]
+
+WS Tasks:
+
+ - test flat-field correction suite
+ - detrend analysis tweak parameters (megacam -> gpc1)
+ - Magic integration
+ - postage stamp server : finish web pages / cleanups
+ - postage stamp server : magic interface / release flags / re-processing
+ - cleanup / reprocess pipeline 
+
+----
+
+IPP Schedule 2008.04.01 - 2008.07.01
+
+2008.04.01 - 2008.04.
+
+----
+
+IPP Status 2008.04.01
+
+Since about mid-November, we have been putting an increasing amount of
+our time into testing portions of the IPP on large collections of data
+(GPC1, Megacam, Essence, SDSS). This has slowed progress on some areas
+of development, but had the important benefit of uncovering a number
+of issues which needed to be addressed.  Some of these were basic
+coding bugs uncovered by real data.  
+
+One important area of concern uncovered in the test processing is the
+robustness of the psphot and psastro algorithms.  While we have
+addressed some of these problems, more work is still needed here,
+especially for cases where the input data is somewhat marginal.  One
+of our recent conclusions is that we need to isolate the photometry
+analysis (psphot), which can take a long time but more consisently
+succeeds, from the astrometry analysis, which is still more
+fragile. We have decided to remove the astrometry analysis from the
+chip processing stage, and only perform this analysis at the camera
+processing stage.  This will save a lot of time in error handling for
+the science image analysis.
+
+Another area which has caused on going error-handling effort is in the
+parameter configuration system.  We have decided to clean up the
+organization somewhat so that more of the parameter files can
+be shared by all cameras, reducing the duplication of information and
+making it easier to synchronize changes to the configurations.
+
+Paul and I had a detailed discussion this morning about the current
+IPP Status and what development work is still outstanding.  I have
+listed our detailed notes below, grouped by the related IPP Subsystem.
+There are three significant components that need substantial work:
+
+* Magic integration
+
+* Fake Source Pipeline
+
+* Cleanup / Reprocess suite
+
+These are each about 2 weeks of dedicated effort.  The elements of the
+first two of these systems are in place, but we need to finish the
+integration process into the full pipeline.  The Cleanup / Reprocess
+suite is a subsystem which we have been deferring, but for which we
+will soon need to begin work.
+
+In addition, we have several areas where we need to work on
+improvements to the code, or to finish minor additional features
+needed by the pipeline.  Some of these are:
+
+* improvements to the code robustness, particularly for psphot and
+  psastro which are not deterministic.
+
+* optimization work for psphot, ppStack, and ppSub, including
+  multithreading.
+
+* various improvements to the photometry and astrometry calibration
+  analysis, from the measurement of the zero-points in real-time to
+  the application of the calibrations to the output tables to be
+  delivered to PSPS and MOPS.
+
+----
+