Loading the 3PI.PV1 photometric calibration into the IPP database

The IPP now contains tables for tracking the data is contained in each "release" of IPP data. This process is described here

This system includes a place to record the results of the photometric calibration for individual exposures in the GPC1 database. This is used by the IPP postage stamp server to find these data for inclusion in the fits headers for single frame images.

The process for updating the database includes a few manual steps that are described in this note.

DVO calibration

The release is calibrated using the DVO programs setphot, relphot, and relastro.

• setphot takes the zero points and flat field corrections measured in the ubercal process and updates the DVO Images table.
• relphot does the photometric calibration
• relastro performs the astrometric calibration

Once this is is done all of the exposure level calibration is saved in the DVO fits table Images.dat. For single frame images there is one entry for each chip. Up to 60 per exposure. The exposure level zero points are saved in all of the chips for a given exposure.

For 3PI.PV1 the DVO used for calibration was LAP.ThreePi.20120706.v2. The data was extracted on 2013-07-31 using ftlist into the files in /data/ippc30.1/bills/3pi.pv1.calibration. The scripts used have been saved in the ipp trunk in the directory releasecalib/scripts.

ftlist columns=NAME,MCAL,DMCAL,SECZ,EXPTIME,TZERO,PHOTCO,FLAGS,UBERCAL_DIST /data/ipp060.0/gpc1/catdir/LAP.ThreePi.20120706.v2/Images.working.dat T > Images.working.txt

The resulting file has a row for each image. The extractinfo was used to skip stacks and select a single row for each exposure. The row used was the first one found with flags & 0x62 XXX list flags, if any. If no images had zero values for these flags the last image was used. (Subsequently it was verified that all rows have the same values for the paramters except for FLAGS).

perl extractinfo < Images.working.txt > 3pi.pv1.calibration.txt

The output file contained 1 row for each exposure with the follwoing columns

exp_name     exp_id  cam_id    zpcalib      zpcalerr        mcal     filter     flags   ubercal_dist

Finally these data were saved in the gpc1 database using

perl updatecalib 3pi.pv1.calibration.txt >& updatecalib.log

Exposure Counts for 3PI.PV1 (relExp.rel_id = 2)

Total Rows          224597
Calibrated          211793
---------------------------
Not Calibrated       12804

Galactic Center       8250  (270 <= RA <= 300) and DEC < 20
Towards Pole          3492  DEC >= 75
Poor quality          1039  camProcessedExp.quality > 0
Incorrect Boresight     21  camProcessedExp.fault = 42
Missing                  2  o5435g0469o o5891g0233o