Loading the 3PI.PV1 photometric calibration into the IPP database
The IPP now contains tables for tracking the data is contained in each "release" of IPP data. This process is described here
This system includes a place to record the results of the photometric calibration for individual exposures in the GPC1 database. This is used by the IPP postage stamp server to find these data for inclusion in the fits headers for single frame images.
The process for updating the database includes a few manual steps that are described in this note.
DVO calibration
The release is calibrated using the DVO programs setphot, relphot, and relastro.
- setphot takes the zero points and flat field corrections measured in the ubercal process and updates the DVO Images table.
- relphot does the photometric calibration
- relastro performs the astrometric calibration
Once this is is done all of the exposure level calibration is saved in the DVO fits table Images.dat. For single frame images there is one entry for each chip. Up to 60 per exposure. The exposure level zero points are saved in all of the chips for a given exposure.
For 3PI.PV1 the DVO used for calibration was LAP.ThreePi.20120706.v2. The data was extracted on 2013-07-31 using ftlist into the files in /data/ippc30.1/bills/3pi.pv1.calibration. The scripts used have been saved in the ipp trunk in the directory tools/releasecalib/scripts.
ftlist columns=NAME,MCAL,DMCAL,SECZ,EXPTIME,TZERO,PHOTCODE,FLAGS,UBERCAL_DIST /data/ipp060.0/gpc1/catdir/LAP.ThreePi.20120706.v2/Images.working.dat T > Images.working.txt
The resulting file has a row for each image. The script extractinfo was used to skip stacks and select a single row for each exposure. The row used was the first one found with
(FLAGS & (ID_IMAGE_PHOTOM_POOR | ID_IMAGE_ASTROM_POOR | ID_IMAGE_ASTROM_FAIL)) == 0.
If no images without these flags set are found for a given exposure, the last entry encountered was used. (Subsequently it was verified that all rows have the same values for the parameters except for FLAGS).
perl extractinfo < Images.working.txt > 3pi.pv1.calibration.txt
The output file contained 1 row for each exposure with the follwoing columns
exp_name exp_id cam_id zpcalib zpcalerr mcal filter flags ubercal_dist
Finally these data were saved in the gpc1 database using
perl updatecalib 3PI.PV1 3pi.pv1.calibration.txt >& updatecalib.log (note script updated to accept release_name as first argument)
Exposure Counts for 3PI.PV1 (relExp.rel_id = 2)
Total Rows 224597 Calibrated 211793 --------------------------- Not Calibrated 12804 Galactic Center 8250 (270 <= RA <= 300) and DEC < 20 Towards Pole 3492 DEC >= 75 Poor quality 1039 camProcessedExp.quality > 0 Incorrect Boresight 21 camProcessedExp.fault = 42 Missing 2 o5435g0469o o5891g0233o
Exposure Counts for 3PI.PV2 (relExp.rel_id = 37)
Total Rows 283188 Calibrated 282906 --------------------------- Not Calibrated 282 Poor Quality 241 Unknown 41
Exposure Counts for 3PI.PV3 (relExp.rel_id = 148). Not yet calibrated.
Total Rows 375573 Poor Quality 1052
