IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changeset 39845 for trunk


Ignore:
Timestamp:
Dec 11, 2016, 11:56:48 AM (10 years ago)
Author:
eugene
Message:

updates to analysis and calibration

Location:
trunk/doc/release.2015
Files:
2 edited

Legend:

Unmodified
Added
Removed
  • trunk/doc/release.2015/ps1.analysis/analysis.tex

    r39839 r39845  
    410410The variance image, if not supplied is constructed by default from the
    411411flux image using the configuration supplied values of \code{GAIN} and
    412 \code{READ\_NOISE} to calculate the appropriate Poisson statistics for
     412\code{READ_NOISE} to calculate the appropriate Poisson statistics for
    413413each pixel.  In this case, the image is assumed to represent the
    414414readout from a single detector, with well-defined gain and read noise
     
    444444image.  The background image and the background standard deviation
    445445image are kept in memory from which the values of \code{SKY} and
    446 \code{SKY\_SIGMA} are calculated for each object in the output catalog.
     446\code{SKY_SIGMA} are calculated for each object in the output catalog.
    447447
    448448\subsection{Initial Object Detection}
     
    458458the covariance, if known. At this stage, the goal is only to detect
    459459the brighter sources, above a user defined S/N limit (configuration
    460 keyword: \code{PEAKS\_NSIGMA\_LIMIT}).  A maximum of
    461 \code{PEAKS\_NMAX} are found at this stage.  The detection efficiency
     460keyword: \code{PEAKS_NSIGMA_LIMIT}).  A maximum of
     461\code{PEAKS_NMAX} are found at this stage.  The detection efficiency
    462462for the brighter sources is not strongly dependent on the form of this
    463463smoothing function.
     
    546546{\em key col} for this peak (as used in topographic descriptions of a
    547547mountain).  If the key col for a given peak is less than
    548 \code{FOOTPRINT\_CULL\_NSIGMA\_DELTA} (4.0) sigmas below the peak of
     548\code{FOOTPRINT_CULL_NSIGMA_DELTA} (4.0) sigmas below the peak of
    549549interest, the peak is considered to be {\em locally insignificant} and
    550550removed from the list of possible detections.  In the vicinity of a
     
    581581to find a value of $\sigma_W$ for which $f$ is expected to be 0.65.
    582582\note{what is the expected ratio of $\sigma_x$ to the true value?}.
    583 We call this value the \code{MOMENTS\_GAUSS\_SIGMA}.  We use an
    584 aperture with a radius of \code{PSF\_MOMENTS\_RADIUS} = 4$\times$
    585 \code{MOMENTS\_GAUSS\_SIGMA} to select the pixels for the measurement.
    586 
    587 Once \code{PSF\_MOMENTS\_SIGMA} has been determined, moments are
     583We call this value the \code{MOMENTS_GAUSS_SIGMA}.  We use an
     584aperture with a radius of \code{PSF_MOMENTS_RADIUS} = 4$\times$
     585\code{MOMENTS_GAUSS_SIGMA} to select the pixels for the measurement.
     586
     587Once \code{PSF_MOMENTS_SIGMA} has been determined, moments are
    588588measured as defined below. 
    589589
     
    615615
    616616If the measured centroid coordinates ($x_0, y_0$) differs from the
    617 peak coordinates be a large amount (\code{MOMENT\_RADIUS}), then the
     617peak coordinates be a large amount (\code{MOMENT_RADIUS}), then the
    618618peak is identified as being of poor quality and is rejected.  In
    619619both of these cases, it is likely that the `peak' was identified in a
     
    638638limited at the low and high ends by $R_{\rm min} < M_r < R_{\rm max}$
    639639where $R_{\rm min}$ is the first radial moment of the PSF stars, or
    640 0.75$\times$ \code{MOMENTS\_GAUSS\_SIGMA} if that cannot be
    641 determined.  $R_{\rm max}$ is set to \code{PSF\_MOMENTS\_RADIUS}, the
     6400.75$\times$ \code{MOMENTS_GAUSS_SIGMA} if that cannot be
     641determined.  $R_{\rm max}$ is set to \code{PSF_MOMENTS_RADIUS}, the
    642642size of the moments aperture.
    643643
     
    731731registered as part of the model function code.  Another function is
    732732then used to return the appropriate function for a specific model
    733 type.  For example, the \code{psModelLookup\_GetFunction} will return
     733type.  For example, the \code{psModelLookup_GetFunction} will return
    734734the \code{psModelLookup} function for a given model type.  This
    735735mechanism makes it very easy to add new model functions into the
     
    756756their peaks, as well as an approximate signal-to-noise ratio.  All
    757757objects with a S/N ratio greater than a user-defined parameter
    758 (\code{PSF\_SHAPE\_NSIGMA} ???) are selected by PSPhot, though objects
     758(\code{PSF_SHAPE_NSIGMA} ???) are selected by PSPhot, though objects
    759759which have more than a certain number of saturated pixels are excluded
    760760at this stage.  PSPhot then examines the 2-D plane of $\sigma_x,
     
    10141014
    10151015PSPhot will use the user-selected galaxy model to attempt the galaxy
    1016 model fits.  In the configuration system, the keyword \code{GAL\_MODEL}
     1016model fits.  In the configuration system, the keyword \code{GAL_MODEL}
    10171017is set to the model of interest.  All suspected extended objects are
    10181018fitted with the model, allowing all of the parameters to float.  The
     
    11461146value for the ApResid scatter is then used by PSPhot as the best PSF
    11471147model for this image.  The number of models to be tested is specified
    1148 by the configuration keyword \code{PSF\_MODEL\_N}.  The configuration
    1149 variables \code{PSF\_MODEL\_0}, \code{PSF\_MODEL\_1}, through
    1150 \code{PSF\_MODEL\_N - 1} specify the names of the models which should be
     1148by the configuration keyword \code{PSF_MODEL_N}.  The configuration
     1149variables \code{PSF_MODEL_0}, \code{PSF_MODEL_1}, through
     1150\code{PSF_MODEL_N - 1} specify the names of the models which should be
    11511151tested.
    11521152
     
    11981198
    11991199The surface brightness values are sampled at a number of radial
    1200 annuli, with the radii defined in the configuration ({\tt
    1201   RADIAL.ANNULAR.BINS.LOWER \& RADIAL.ANNULAR.BINS.UPPER}).  For each
    1202 source, the resulting surface brightness profile is saved in the
    1203 output cmf-file as an N-element value in the FITS table ({\tt
    1204   PROF\_SB}).  The flux at each radial position and the fill-factor
    1205 (fraction of pixels used to the total possible) as also saved as
    1206 equal-length vectors in the FITS table ({\tt PROF\_FLUX and
    1207   PROF\_FILL}).  The values of the radial bins are saved in the cmf
    1208 header ({\tt RMIN\_NN, RMAX\_NN}).
     1200annuli, with the radii defined in the configuration
     1201(\code{RADIAL.ANNULAR.BINS.LOWER} \&
     1202\code{RADIAL.ANNULAR.BINS.UPPER}).  For each source, the resulting
     1203surface brightness profile is saved in the output cmf-file as an
     1204N-element value in the FITS table (\code{PROF_SB}).  The flux at each
     1205radial position and the fill-factor (fraction of pixels used to the
     1206total possible) as also saved as equal-length vectors in the FITS
     1207table (\code{PROF_FLUX} and \code{PROF_FILL}).  The values of the
     1208radial bins are saved in the cmf header (\code{RMIN_NN},
     1209\code{RMAX_NN}).
    12091210
    12101211\note{these profiles are not saved in PSPS}
  • trunk/doc/release.2015/ps1.calibration/calibration.tex

    r39840 r39845  
    2222
    2323% Pick a terse version of the title here;
    24 \shorttitle{Pixel Analysis in PS1}
     24\shorttitle{PS1 Calibration}
    2525\shortauthors{E.A. Magnier et al}
    2626\begin{document}
    27 \title{Pan-STARRS Pixel Analysis : Source Detection \& Characterization}
     27\title{Pan-STARRS Photometric and Astrometric Calibration}
    2828
    2929% this is a crude trick to get the order of affiliations right.  These
     
    194194images.
    195195
    196 \section{Astrometric Model in PSASTRO}
    197 
    198 \code{pasastro} loads the coordinates and calibrated magnitudes of
    199 stars from the reference database.  A model for the positions of the
    200 60 chips in the focal plane is used to determine the expected
    201 astrometry for each chip based on the boresite coordinates and
    202 position angle reported by the header.  Reference stars are selected
    203 from the full field of view of the GPC1 camera, padded by an
    204 additional \note{25\%} to ensure a match can be determined even in the
    205 presence of substantial errors in the boresite coordinates.  It is
    206 important to choose an appropriate set of reference stars: if too few
    207 are selected, the chance of finding a match between the reference and
    208 observed stars is diminished.  In addition, since stars are loaded in
    209 brightness order, a selection which is too small is likely to contain
    210 only stars which are saturated in the GPC1 images.  On the other hand,
    211 if too many reference stars are chosen, there is a higher chance of a
    212 false-positive match, especially as many of the reference stars may
    213 not be detected in the GPC1 image.  The seletion of the reference
    214 stars includes a limit on the brightest and fainted magnitude of the
    215 stars selected.
     196\section{Astrometric Models}
    216197
    217198Three somewhat distinct astrometric models are employed within the IPP
     
    278259\begin{eqnarray}
    279260  L & = & C^L_{0,0} + C^L_{1,0} X_{\rm chip} + C^L_{0,1} Y_{\rm chip} + \delta L(X_{\rm chip}, Y_{\rm chip}) \\
    280   M & = & C^M_{0,0} + C^M_{1,0} X_{\rm chip} + C^M_{0,1} Y_{\rm chip} + \delta M(X_{\rm chip}, Y_{\rm chip}) \\
     261  M & = & C^M_{0,0} + C^M_{1,0} X_{\rm chip} + C^M_{0,1} Y_{\rm chip} + \delta M(X_{\rm chip}, Y_{\rm chip})
    281262\end{eqnarray}
    282263
     
    289270  Q & = & \sum_{i,j} C^Q_{i,j} (X_{\rm chip} - X_0)^i (Y_{\rm chip} - Y_0)^j
    290271\end{eqnarray}
    291 
    292 \note{need to discuss the WCS keywords, both standard and
    293   non-standard, used to represent these polynomial transformations}
     272\note{need to complete this discussion of the WCS keywords, both
     273  standard and non-standard, used to represent these polynomial
     274  transformations}
    294275
    295276\begin{verbatim}
    296 CTYPE1,2 : RA---WRP, DEC--WRP & RA---DIS, DEC--DIS (ill-defined since the WRP entries do not generate RA,DEC)
     277Here is a table of the keywords and the related terms from Eqns above:
     278CTYPE1,2 : RA---WRP, DEC--WRP & RA---DIS, DEC--DIS
    297279CRVAL1,2 : C^{L,M}_{0,0}
    298280CRPIX1,2 : X_0, Y_0
     
    326308and photometric data from the reference database. 
    327309
     310\subsection{Reference Catalogs}
     311
    328312During the course of the PS1SC Survey, several reference databases
    329313have been used.  For the first 20 months of the survey, \code{psastro}
     
    336320catalog.  \note{discuss history of the different refcats?} 
    337321
     322Coordinates and calibrated magnitudes of stars from the reference
     323database are loaded by \code{pasastro}.  A model for the positions of
     324the 60 chips in the focal plane is used to determine the expected
     325astrometry for each chip based on the boresite coordinates and
     326position angle reported by the header.  Reference stars are selected
     327from the full field of view of the GPC1 camera, padded by an
     328additional \note{25\%} to ensure a match can be determined even in the
     329presence of substantial errors in the boresite coordinates.  It is
     330important to choose an appropriate set of reference stars: if too few
     331are selected, the chance of finding a match between the reference and
     332observed stars is diminished.  In addition, since stars are loaded in
     333brightness order, a selection which is too small is likely to contain
     334only stars which are saturated in the GPC1 images.  On the other hand,
     335if too many reference stars are chosen, there is a higher chance of a
     336false-positive match, especially as many of the reference stars may
     337not be detected in the GPC1 image.  The seletion of the reference
     338stars includes a limit on the brightest and fainted magnitude of the
     339stars selected.
     340
    338341The astrometric analysis is necessarily performed first; after the
    339342astrometry is determined, an automatic byproduct is a reliable match
     
    358361  chip}, Y^{\rm ref}_{\rm chip}$ values for the reference catalog
    359362stars.  For all possible pairs between the two lists, the values of
    360 \[
    361 \Delta X = X^{\rm ref}_{\rm chip} - X^{\rm obs}_{\rm chip}\\
    362 \Delta Y = Y^{\rm ref}_{\rm chip} - Y^{\rm obs}_{\rm chip}
    363 \]
     363\begin{eqnarray}
     364\Delta X & = & X^{\rm ref}_{\rm chip} - X^{\rm obs}_{\rm chip}\\
     365\Delta Y & = & Y^{\rm ref}_{\rm chip} - Y^{\rm obs}_{\rm chip}
     366\end{eqnarray}
    364367are generated.  The collection of $\Delta X, \Delta Y$ values are
    365368collected in a 2D histogram with sampling of \note{XXX} pixels and the
     
    388391astrometry guess for the chip.
    389392
     393\note{option to downweight based on photometric inconsistency : not
     394  used in PS1 analysis}
     395
    390396\subsection{Chip Polynomial Fits}
    391397
     
    410416($C^{L,M}_{0,0}$) and those which define the offset from focal plane
    411417to tangent plane ($C^{P,Q}_{0,0}$).  We limit ($C^{P,Q}_{0,0}$) to be
    412 0,0 to remove this degeneracy.  \note{disucss the measurement of the
    413   camera distortion via the gradient}
     4180,0 to remove this degeneracy. 
     419
     420The initial fit of the astrometry for each chip follows the distortion
     421introduced by the camera: the apparent plate scale for each chip is
     422the combination of the plate scale at the optical axis of the camera,
     423modified by the local average distortion.  To isolate the effect of
     424distortion, we choose a single common plate scale for the set of chips
     425and re-define the chip $\rightarrow$ sky calibrations as a set of chip
     426$\rightarrow$ focal plane transformation using that common pixel
     427scale.  We can now compare the observed focal plane coordinates,
     428derived from the chip coordinates, and the tangent plane coordiantes,
     429derived from the projection of the reference coordinates.  One caveat
     430is that the chip reference coordinates are also degenerate with the
     431fitted distortion.  In order to avoid being sensitive to the exact
     432positions of the chips at this stage, we measure the local gradient
     433between the focal plane and tangent plane coordinate systems.  We then
     434fit the gradient with a polynomial of order 1 less than the polynomial
     435desired for the distortion fit.  The coefficients of the gradient fit
     436are then used to determine the coefficients for the polynomials
     437representing the distortion.  \note{write out the math of the gradients}
    414438
    415439Once the common distortion coming from the optics and atmosphere have
     
    419443each iteration, the reference stars and detected objects are matched
    420444using the current best set of transformations.  These fits start with
    421 low order (1) and large matching radius (\note{XX}) and reduced the
    422 radius while allowing the order to increaes, up to 3rd order for the
    423 final iterations.  \note{quality of the fits as a result of this stage}.
    424 
    425 \note{describe the output smf file?}
    426 
    427 \note{discuss the real-time photometric calibration}
     445low order (1) and large matching radius (\note{XX}).  As the
     446iterations proceed, the radius is reduced and the order is allowed to
     447increaes, up to 3rd order for the final iterations.  \note{quality of
     448  the fits as a result of this stage}.
     449
     450\subsection{Real-time Photometric Calibration}
     451
     452After the astrometric calibration has finished, the photometric
     453calibration is performed by \code{psastro}.  When the reference stars
     454are loaded, the apparent magnitude in the filter of interest is also
     455loaded.   Stars for which the reference magnitude is brighter than
     456(\grizy) = (19, 19, 18.5, 18.5, 17.5) are used to determine the zero
     457points by comparison with the instrumental magnitudes.  For the PV3
     458analysis, the robust median \note{defined where?} is used to measure
     459the zero point. For early versions of the analysis, when the reference
     460catalog used synthetic magnitudes, it was necessary to search for the
     461blue edge of the distribution: the synthetic magnitude poorly
     462predicted the magnitudes of stars in the presence of significant
     463extinction or for the very red stars, making the blue edge somewhat
     464more reliable.  Note that we do not include an airmass correction in
     465this zero point analysis: the airmass correction is folded into the
     466observed zero point.  The zero point may be measured separately for
     467each chip or as a single value for the entire exposure; the latter
     468option was used for the PV3 analysis.
     469
     470\subsection{Real-time outputs}
     471
     472The calibrations determined by \code{psastro} as saved as part of the
     473header information in the output FITS tables.  A single
     474multi-extension FITS table is written using the \code{smf} format.  In
     475these files, the measurements from each chip are written as a separate
     476FITS table.  A second FITS extension for each chip is used to store
     477the header information from the original chip image.  The original
     478chip header is modified so that the extension corresponds to an image
     479with no pixels data: \code{NAXIS} is set to 0, even though
     480\code{NAXIS1} and \code{NAXIS2} are retained with the original
     481dimensions of the chip.  A pixel-less primary header unit (PHU) is
     482generated with a summary of some of the important and common
     483chip-level keywords (e.g., \code{DATE-OBS}).  The astrometric
     484transformation information for each chip is saved in the corresponding
     485header using standard (and some non-standard) WCS keywords.
     486\note{combine this discussion with the above?}.  For the two-level
     487astrometric model, the PHU header carries the astrometric
     488transformation related to the projection and the camera-wide
     489distortions.  Photometric calibrations are written as a set of
     490keywords to individual chip headers, and if the calibration is
     491performed at the exposure-level, to the PHU.  The photometry
     492calibration keywords are:
     493\begin{itemize}
     494\item \code{ZPT_REF} : the nominal zero point for this filter
     495\item \code{ZPT_OBS} : the measured zero point for this chip /
     496  exposure
     497\item \code{ZPT_ERR} : the measured error on \code{ZPT_OBS}
     498\item \code{ZPT_NREF} : the number of stars used to measure \code{ZPT_OBS}
     499\item \code{ZPT_MIN} : minimum reference magnitude included in analysis
     500\item \code{ZPT_MAX} : maximum reference magnitude included in analysis
     501\end{itemize}
     502The keyword \code{ZPT_OBS} is used to set the initial zero point when
     503the data from the exposure are loaded into the DVO database.
    428504
    429505\section{DVO Description}
    430506
    431507The Pan-STARRS IPP uses an internal database system, distinct from the
    432 publically visitble database system, to determine the association
     508publically visible database system, to determine the association
    433509between multiple detections of the same astronomical object and as
    434510part of the astrometric and photometric calibration process.  This
     
    438514this databasing system have been somewhat expanded for the Pan-STARRS
    439515context. 
    440 
    441 DVO includes two major classes of database tables: those containing
    442 information directly about astronomical objects in the sky and those
    443 containing other supporting information.  As discussed in detail
    444 below, the object-related tables are partitioned on the basis of
    445 position in the sky: objects within a region bounded by lines of
    446 constant RA,DEC are contained in a specific file.  The boundaries and
    447 the associated partition names are stored in one of the supporting
    448 tables.
    449516
    450517One of the main purposes of the DVO system is to define the
     
    460527detection is associated with the closest object. 
    461528
     529Detections in DVO have a special piece of metadata called the
     530\code{photcode} which identifies the source of the measurement.  A
     531\code{photcode} has a name which in general consists of the name of
     532the camera or telescope (e.g., GPC1 or 2MASS), the name (or short-hand
     533name) of the filter used for the measurement (e.g., $g$), and an
     534identifier for the detector, if not unique (e.g., XY01 for GPC1).
     535Along with each name, there is a numerical value for the photcode.  A
     536table within the DVO system, \code{Photcode}, lists the photcoes and
     537defines a number of additional pieces of information for each
     538photcode.  These include the nominal zero point and airmass slope, as
     539well as color trends to transform a measurement in the specific
     540photcode to a common system.  There are 3 classes of photcodes defined
     541within the DVO system.  Those photcodes associated with detections
     542from an image loaded into the database system are called \code{DEP}
     543photcodes.  There are also photcodes associated with the average
     544photometry values, called SEC photcodes.  There are also those
     545measurements which come from external data sources for which DVO does
     546not have any information to determine a calibration (e.g.,
     547instrumental magnitudes and detector coordinates).  These are
     548measurements are reference values and are assigned REF photcodes.
     549
    462550In the implementation of DVO used for the PV3 calibration analysis,
    463551the database tables are stored on disk using binary FITS tables.  Each
    464552type of database table is stored as a separate file, or a collection
    465 of files if the table is spatially partitioned.  The binary FITS
     553of files for table which are spatially partitioned.  The binary FITS
    466554tables may be optionally compressed using the (to date) experimental
    467555FITS binary table compression strategy outlined by REF.  In this
     
    495583\code{GZIP_1}, integers use \code{RICE}. 
    496584
     585\subsubsection{Sky Partition}
     586
     587DVO includes two major classes of database tables: those containing
     588information directly about astronomical objects in the sky and those
     589containing other supporting information.  The object-related tables
     590are partitioned on the basis of position in the sky: objects within a
     591region bounded by lines of constant RA,DEC are contained in a specific
     592file.  The boundaries and the associated partition names are stored in
     593one of the supporting tables, \code{SkyTable}.  This table contains
     594the definitions of the boundaries for each sky region (\code{R_MIN},
     595\code{R_MAX}, \code{D_MIN}, \code{D_MAX}), the name of the sky region,
     596an ID (\code{INDEX}, equal to the sequence number of the region in the
     597table), and index entries to enable navigation within the table.  The
     598regions are defined in a hierarchical sense, with a series of levels
     599each containing a finer mesh of regions covering the sky. 
     600
     601In the default used by the PV3 DVO, the partitioning scheme is based
     602on the one used by the Hubble Space Telescope Guide Star Catalog
     603files.  Level 0 is a single region covering the full sky.  Level 1
     604divides the sky in Declination into bands 7.5\degree\ high.  Level 2
     605subdivides these Declination bands in the RA direction, with spacing
     606related to the stellar density.  Level 3 divides these RA chunks into
     6074 - 8 smaller partitions.  This level exactly matches the HST GSC
     608layout, and uses the same naming convention to identify the
     609partitions: n0000/0000, etc. \note{more on the names?}.  Level 4
     610further divides these regions by a factor of 16.  In the
     611\code{SkyTable}, a region at one level has a pointer to its parent
     612region (the one which contains it) and a sequence pointing to its
     613children (regions it contains).  The \code{SkyTable} enables fast
     614lookups of the on-disk partitions which map to a specific coordinate
     615on the sky.  In general, a single DVO will have the full sky
     616represented with tables at a single level, though it is possible for
     617mixed levels to be used, this mode is not well tested.  For the PV3
     618master database, the partitioning at the 5th level results in \approx
     619150,000 regions to cover the full sky, of which \approx 110,000 are
     620used for the PV3 $3\pi$ data.  The densest portions of the bulge
     621contain at most \approx 300k astronomical objects in the database
     622files, with an associated maximum of 30M measurements in these files.
     623With the compression scheme described above, this makes the largest
     624database files \approx 3GB, which can be loaded into memory in 30
     625seconds on our partition machines.
     626
     627The DVO software system allows the tables which are partitioned across
     628the sky to also be distributed across multiple computers, which we
     629call partition hosts.  A single file defines the names of these
     630partition hosts and the location of the database partition on the
     631disks of that machine.  The \code{SkyTable} contains elements to
     632define by ID the parition host to which a partitioned set of tables
     633has been assigned.  Operations which query the database, or perform
     634other operations on the database, are aware of the partitioning scheme
     635and will launch their operations as remote processes on the machines
     636which contain the data they need.  For example, a query for data from
     637a small region will launch sub-query operations on the machines which
     638contain the data overlapping the region of interest.  These remote
     639query operations will select the database information which matches
     640the query request (i.e., applying restrictions as defined) and return
     641to the master process the results.  The results from the various
     642partition hosts are then merged into a single result by the master
     643process.  This parallelization is critical to querying and
     644manipulating the enormous database on a reasonable timescale.
     645
    497646\subsection{Tables which describe objects}
    498647
     
    607756in our analysis of the astrometry (see Section~\ref{sec:astrometry}).
    608757
    609 \subsubsection{Sky Partition}
    610 
    611 \note{SkyTable}
    612 
    613758\subsection{Other Tables}
    614759
    615 \note{Image Table}
    616 \note{Photcode Table}
    617 \note{FlatCorrection}
    618 \note{AstromOffsets}
     760Data from GPC1 (and other cameras processed by the IPP) are loaded
     761into DVO in units \code{smf} files generated by the Camera calibration
     762stage.  As described above, these files contain all measurements from
     763a complete exposure, with measurements from each chip grouped into
     764separate FITS tables.  When these measurements are loaded into the
     765\code{Measure} and similar tables, a subset of the information from
     766the chip header is used to populated a row in the DVO \code{Image}
     767table.  This table contains one row for each chip known to DVO, with
     768information such as the filter (\code{photcode}), the exposure time,
     769the airmass, the astrometric calibration terms, the photometric
     770zero point, etc.  For GPC1 and other mosaic cameras, an additional row
     771is defined to carry the projection and camera distortion elements of
     772the astrometry model.  As chips are loaded into this table, they are
     773assigned an internal ID (a running sequence in the table).  Images may
     774also be assigned an external ID: in the case of the GPC1 images, this
     775ID is defined by the processing mysql database and is guaranteed to be
     776unique within the processing system.
     777
     778Other tables are used to track information used by the calibration
     779system.  This includes the complete set of flat-field corrections
     780determined by the photometry calibration analysis (see
     781Section~\ref{sec:relphot}) and the astrometric flat-field corrections
     782determined by the astrometry calibration analysis (see Section~\ref{sec:relastro})
    619783
    620784\section{Photometry Calibration}
    621785
    622786\subsection{Ubercal Analysis}
    623 \begin{verbatim}
    624 * data loaded into LSD database (Juric REF) @ CFA (?). 
    625 * refer to Ubercal paper
    626 * modifications for PV3 : 2x2 grid, no new flats
    627 * result is a collection of zero points for photometric images
    628   * discuss stats on the zero points and the airmass terms
    629 * does eddie still use per exposure or per star airmass terms?
    630 \end{verbatim}
     787
     788\note{clean up and re-word the pieces below}
     789
     790The photometric calibration of the DVO database starts with the
     791``ubercal'' analysis technique as described by \cite{PS1.ubercal}.
     792This analysis is performed by the group at Harvard, loading data from
     793the \code{smf} files into their instance of the Large Scale Database
     794(LSD, Juric REF), a system similar to DVO used to manage the
     795detections and determine the calibrations.
     796
     797Photometric nights are selected and all other exposures are ignored.
     798Each night \note{shorter time?} is allowed to have a single fitted
     799zero point and a single fitted value for the airmass extinction
     800coefficient per filter.  The zero points and extinction terms are
     801determined as a least squares minimization process using the repeated
     802measurements of the same stars from different nights to tie nights
     803together.  Flat-field corrections are also determined as part of the
     804minimization process.  In the original (PV1) ubercal analysis,
     805\cite{PS1.ubercal} determined flat-field corrections for $2\times 2$
     806sub-regions of each chip in the camera and four distinct time periods
     807(``seasons'').  Later analysis (PV2) used an $8\times8$ grid of
     808flat-field corrections to good effect.
     809
     810The ubercal analysis was re-run for PV3 by the Harvard group.  For the
     811PV3 analysis, under the pressure of time to complete the analysis, we
     812chose to use only a $2\times 2$ grid per chip as part of the ubercal
     813fit and to leave higher frequency structures to the later analysis.  A
     8145th flat-field season consisting of nearly the last 2 years of data
     815was also included for PV3.  In retrospect, as we show below, the data
     816from the latter part of the survey would probably benefit from
     817additional flat-field seasons.  \note{something for PV4}.
     818
     819By excluding non-photometric data and only fitting 2 parameters for
     820each night, the Ubercal solution is robust and rigid.  It is not
     821subject to unexpected drift or sensitivity of the solution to the
     822vagaries of the data set.  The Ubercal analysis is also especially
     823aided by the inclusion of multiple Medium Deep field observations
     824every night, helping to tie down overall variations of the system
     825throughput and acting as internal standard star fields.  The resulting
     826photometric system is shown by \cite{PS1.ubercal} to have reliability
     827across the survey region at the level of (8.0, 7.0, 9.0, 10.7, 12.4)
     828millimags in (\grizy).  As we discuss below, this conclusion is
     829reinforced by our external comparison.  \note{do I have a measurement
     830  of the bright end stability in PV3?  basically, what is the scatter
     831  per star as a function of position in the camera and magnitude?}
     832
     833The overall zero point for each filter is not naturally determined by
     834the Ubercal analysis; an external constraint on the overall
     835photometric system is required for each filter.  \cite{PS1.ubercal}
     836used photometry of the MD09 Medium Deep field to match the photometry
     837measured by \cite{JTphoto} on the reference photometric night of MJD
     83855744 (UT 02 July 2011).  \note{Scolnic et al REF} have re-examined
     839the photometry of Calspec standards as observed by PS1.  They reject 2
     840of the \note{XX} stars used by \cite{JTphoto} and add photometry of
     841\note{XX} additional stars.  The calspec spectrophotometry values have
     842also been re-examined by XX; using these new measurements, Scolnic et
     843al determine new zero points for the PS1 system, which we have applied
     844(see below).
    631845
    632846\subsection{Applying the Ubercal Zero Points : Setphot}
     
    8981112the bright end.  \note{recommendation}
    8991113
     1114\subsection{Calculation of Object Photometry}
     1115
     1116\subsubsection{Iteratively Reweighted Least Squares Fitting (1D)}
     1117
     1118\subsubsection{Seletion of Measurements}
     1119
     1120\subsubsection{Stack Photometry}
     1121
     1122\subsubsection{Warp Photometry}
     1123
    9001124\section{PV3 DVO Master Database}
    9011125
     
    12111435\note{Figures showing the Gaia residuals}
    12121436
     1437\subsection{Calculation of Object Astrometry}
     1438
     1439\subsubsection{Iteratively Reweighted Least Squares Fitting}
     1440
     1441\subsubsection{Seletion of Measurements}
     1442
    12131443\section{Discussion}
    12141444
Note: See TracChangeset for help on using the changeset viewer.