Changeset 37234
- Timestamp:
- Aug 12, 2014, 2:51:02 PM (12 years ago)
- Location:
- branches/eam_branches/ipp-20140717/ippToPsps/pspsschema/SchemaNew18.0/PSPS_TABLES/Fundamental_IPP_Data_Product_Tables
- Files:
-
- 3 edited
-
Detection.txt (modified) (1 diff)
-
MeanObject (modified) (1 diff)
-
schema18.notes.txt (modified) (1 diff)
Legend:
- Unmodified
- Added
- Removed
-
branches/eam_branches/ipp-20140717/ippToPsps/pspsschema/SchemaNew18.0/PSPS_TABLES/Fundamental_IPP_Data_Product_Tables/Detection.txt
r37218 r37234 46 46 apFlux + smf:AP_FLUX 47 47 apFluxErr + smf:AP_FLUX_SIG 48 apFillF -smf:AP_NPIX / (pi * (AP_MAG_RADIUS - 0.5)^2)48 apFillF + smf:AP_NPIX / (pi * (AP_MAG_RADIUS - 0.5)^2) 49 49 kronFlux + smf:KRON_FLUX 50 50 kronFluxErr + smf:KRON_FLUX_ERR -
branches/eam_branches/ipp-20140717/ippToPsps/pspsschema/SchemaNew18.0/PSPS_TABLES/Fundamental_IPP_Data_Product_Tables/MeanObject
r37215 r37234 7 7 gMeanPSFMag AB_magnitude REAL 4 -999 mean g psf AB magnitude from best available measurements (best available as current defined by ipp "waterfall logic" 8 8 gMeanPSFMagErr AB_magnitude REAL 4 -999 estimated error of best availalbe g-band psf AB magnitudes (individual errors added in quadrature) 9 gMeanPSFMagNct dimensionless SMALLINT 2 -999 number of best available detections included in mean psfMag10 9 gMeanPSFMagStd dimensioless REAL 4 -999 standard deviation of best available measurements - compared with MeanErr this is one measure of true variability 11 10 gMeanPSFMagMin AB_magnitude REAL 4 -999 minimum best available PSFMag - min and max are given for PSFMag as they may indicate variability. 12 11 gMeanPSFMagMax AB_magnitude REAL 4 -999 maximum best available PSFMag 12 gMeanPSFMagNpt dimensionless SMALLINT 2 -999 number of best available detections included in mean psfMag 13 13 14 14 gMeanKronMag AB_magnitude REAL 4 -999 mean g kron AB magnitude from best available measurements 15 15 gMeanKronMagErr AB_magnitude REAL 4 -999 estimated error of mean g kron AB magnitude 16 gMeanKronMag Nct dimensionless SMALLINT 2 -999 number of best available detections included mean Kron mag17 gMeanKronMag Std dimensioless REAL 4 -999 standard deviation of best available measurements16 gMeanKronMagStd dimensionless REAL 4 -999 standard deviation of best available measurements 17 gMeanKronMagNpt dimensionless SMALLINT 2 -999 number of best available detections included mean Kron mag 18 18 19 19 gMeanApMag AB_magnitude REAL 4 -999 mean g kron AB magnitude from best available measurements 20 20 gMeanApMagErr AB_magnitude REAL 4 -999 estimated error of g kron AB magnitude mean 21 gMeanApMagNct dimensionless SMALLINT 2 -999 number of detections included in best available mean of Kron mag in g filter22 21 gMeanApMagStd dimensioless REAL 4 -999 standard deviation of best available measurements 22 gMeanApMagNpt dimensionless SMALLINT 2 -999 number of detections included in best available mean of Kron mag in g filter 23 23 24 24 gFlags dimensionless INT 4 0 flags for g mean [XXX secfilt.flags is 4byte] -
branches/eam_branches/ipp-20140717/ippToPsps/pspsschema/SchemaNew18.0/PSPS_TABLES/Fundamental_IPP_Data_Product_Tables/schema18.notes.txt
r37209 r37234 2 2 This document describes the new PSPS schema (18.0) and identifies existing problems. 3 3 4 ObjectThin 5 6 Changes since Schema 16.0: 7 8 * DROPPED gcObjID (concept rejected by DRAVG) 9 * replaced skycellID (REAL) with combination of tessID, projectionID, skycellID (1,2,1 byte INTs) 10 * replaced raMeanStd, decMeanStd (not calculated) with posMeanChisq 11 12 Concerns: 13 14 * objName is generated by SQL in ippToPsps and is probably fragile: move to dvopsps? 15 * fields calculated by PSPS and not tested (htmID, zoneID, cx,cy,cz, lambda,beta, l,b) 16 * nStackObjectRows is not calculated 17 * should nStackDetections be split per filter? 18 * quality flag is currently the upper byte of dvo:average.flags, is this reasonable? 19 * consistency flag is hard-wired as 0 20 * raStack, etc are not yet calculated by relastro (set to match raMean, etc) 21 22 MeanObject 23 24 Changes since Schema 16.0: 25 26 * DROPPED gcObjID (concept rejected by DRAVG) 27 * CHANGED gFlags to be 4 byte not 8 byte (secfilt.flags is 4 byte) 28 * renamed fields to have consistent naming structure: 29 * gMeanTYPEMagVALUE, where TYPE = (PSF, Kron, Ap) and VALUE = (Err, Std, Min Max, Npt) 30 31 Concerns: 32 33 * NONE 34 35 Detections 36 37 Changes since Schema 16.0: 38 39 * ADDED apRadius 40 * DROPPED gcObjID (concept rejected by DRAVG) 41 * DROPPED kronRadErr (not measured by psphot, probably not needed?) 42 43 Concerns: 44 45 * imageID : this is currently generated from expID + ccd X,Y. 46 shouldn't we use gpc1.chipImfile.chip_imfile_id? (IMAGE_ID in 47 header) 48 * double-check reported value for zero point (needs to include airmass term, etc) 49 50 Implementation Changes: 51 52 * raErr,decErr are now taken from the SMF file not from dvo (x,y errors truncated in dvo) 53 * dvoRegion now uses CAT_ID from dvopsps 54 * psfMajor,MinorFWHM use PSF_FWHM_MJA,MIN 55 * added PSF_CORE to smf 56 * apFlux, kronFlux use FLUX values directly from smf 57 4 58 Stacks 5 59 6 Measurements related to the stacks are now split into 11 separate 7 tables depending on the measurements and, in some cases, the Galactic 8 latitude. The granularity of the split is partly mandated by the 9 inability of PSPS or its ingest system to handle excessively wide 10 tables. Note that in all of the tables below, a single row represents 11 the set of measurements from all 5 filters (grizy) for the aparition 12 of an astronomical object in a single skycell. The primaryDetection 13 flag is set to identify the row which comes from the primary skycell 14 for that location on the sky. 60 Measurements related to the stacks are now split into 11 separate 61 tables depending on the measurements and, in some cases, the Galactic 62 latitude. The granularity of the split is partly mandated by the 63 inability of PSPS or its ingest system to handle excessively wide 64 tables. Note that in all of the tables below, a single row represents 65 the set of measurements from all 5 filters (grizy) for the aparition 66 of an astronomical object in a single skycell. The primaryDetection 67 flag is set to identify the row which comes from the primary skycell 68 for that location on the sky. 69 70 Several of the tables are meant to be filled only for the Galactic cap 71 regions. As of 2014.08.09, ippToPsps is not setting this limit. 72 These tables are: 73 74 StackModelFitDeV 75 StackModelFitExp 76 StackModelFitSer 77 StackModelFitExtra 78 StackApFlxFull 79 StackApFlxFullC1 80 StackApFlxFullC2 81 StackPetrosian 15 82 16 Several of the tables are meant to be filled only for the Galactic cap 17 regions. As of 2014.08.09, ippToPsps is not setting this limit. 18 These tables are: 83 Other general concerns: 19 84 20 StackModelFitDeV 21 StackModelFitExp 22 StackModelFitSer 23 StackModelFitExtra 24 StackApFlxFull 25 StackApFlxFullC1 26 StackApFlxFullC2 27 StackPetrosian 85 * various size-related fields are reported in pixels not arcseconds. 86 87 * I need to double-check the reported zero point and telluric 88 extinction values. 89 90 * are we defining too many radial apertures? 28 91 29 Other general concerns: 92 The tables are divided as follows: 93 94 StackObjectThin : basic properties of the stack object detection. 95 * stackDetectRowID : this field will be set by PSPS and cannot be 96 tested in the ippToPsps code 30 97 31 * various size-related fields are reported in pixels not arcseconds. 98 * bestDetection : this field cannot be set until the entire PSPS is 99 populated. this will be deferred until the end of 100 the ingest. 32 101 33 * I need to double-check the reported zero point and telluric 34 extinction values. 35 36 * almost no 37 38 The tables are divided as follows: 39 40 StackObjectThin : basic properties of the stack object detection. 41 * stackDetectRowID : this field will be set by PSPS and cannot be 42 tested in the ippToPsps code 43 * bestDetection : this field cannot be set until the entire PSPS is 44 populated. this will be deferred until the end of 45 the ingest. 46 * primaryDetection : NOT YET TESTED 47 * xinfoFlag2 : currently only includes bits from 48 dvo:measure.dbflags but not dvo:secfilt.flags 49 50 * NOTE : stackDetectRowID, bestDetection, primaryDetection are 51 inherited by the following tables from StackObjectThin, so the issue 52 above are present in all Stack tables 53 54 StackObjectRaw : raw measurement values from the PSF fits 55 * xpsfLikelihood : some values seem to be negative, which should 56 not be allowed 57 58 StackModelFitExtra : extra properties derived from extended source 59 fits. NOTE: this table is not being generated 60 61 StackModelFitExp : Exponential model fit parameters 62 * xExpRadiusErr : EXT_WIDTH_MAJ_SIG is not being set in the CMF file 63 * xExpAbErr : EXT_WIDTH_MIN_SIG is not being set in the CMF file 64 * xExpPhiErr : not set in CMF 65 * xExpRa,Dec : this position is currently an approximate based on 66 X_EXT, X_PSF and the plate scale 67 * xExpRa,DecErr : circularly symmetric approximation based on S/N 68 * xExpCf : not calculated in psphot 69 * xExpChisq : the fit chisq is provided, not the likelihood 70 71 StackModelFitDeV : DeVaucouleur model fit parameters 72 * NOTE same issues as for Exp 73 74 StackModelFitSer : Sersic model fit parameters 75 * NOTE same issues as for Exp, also: 76 * xSerNuErr : value is hard-wired at 0.1, and not well-measured 77 in CMF 78 79 StackApFlx : flux measured in radial apertures (only 3 radii; raw and 80 both convolutions) 81 82 * standard deviation fields (eg, gflxR3Std) are measured in psphot as 83 the standard deviation across the full object. Should this perhaps 84 be a measurement of the standard deviation after the radial profile 85 is subtracted? 86 87 StackApFlxFull : flux measured in radial apertures (raw, all radii) 88 89 * see note above on Standard Deviation 90 * radius 10 is not measured or reported in the CMF 91 92 StackApFlxFullC1 : flux measured in radial apertures (first convolution, all radii) 93 94 * see note above on Standard Deviation 95 * radius 10 is not measured or reported in the CMF 96 97 StackApFlxFullC2 : flux measured in radial apertures (second convolution, all radii) 98 99 * see note above on Standard Deviation 100 * radius 10 is not measured or reported in the CMF 101 102 StackPetrosian : petrosian analysis data 103 * xpetCf : fill factor is mis-calculated in psphot (consistently > 1.0) 102 * primaryDetection : NOT YET TESTED 103 * xinfoFlag2 : currently only includes bits from 104 dvo:measure.dbflags but not dvo:secfilt.flags 105 106 * NOTE : stackDetectRowID, bestDetection, primaryDetection are 107 inherited by the following tables from StackObjectThin, so the issue 108 above are present in all Stack tables 109 110 StackObjectRaw : raw measurement values from the PSF fits 111 * xpsfLikelihood : some values seem to be negative, which should 112 not be allowed 113 114 StackModelFitExtra : extra properties derived from extended source 115 fits. NOTE: this table is not being generated 116 117 StackModelFitExp : Exponential model fit parameters 118 * xExpRadiusErr : EXT_WIDTH_MAJ_SIG is not being set in the CMF file 119 * xExpAbErr : EXT_WIDTH_MIN_SIG is not being set in the CMF file 120 * xExpPhiErr : not set in CMF 121 * xExpRa,Dec : this position is currently an approximation based on 122 X_EXT, X_PSF and the plate scale 123 * xExpRa,DecErr : circularly symmetric approximation based on S/N 124 * xExpCf : not calculated in psphot 125 * xExpChisq : the fit chisq is provided, not the likelihood 126 127 StackModelFitDeV : DeVaucouleur model fit parameters 128 * NOTE same issues as for Exp 129 130 StackModelFitSer : Sersic model fit parameters 131 * NOTE same issues as for Exp, also: 132 * xSerNuErr : value is hard-wired at 0.1, and not well-measured 133 in CMF 134 135 StackApFlx : flux measured in radial apertures (only 3 radii; raw and 136 both convolutions) 137 138 * standard deviation fields (eg, gflxR3Std) are measured in psphot as 139 the standard deviation across the full object. Should this perhaps 140 be a measurement of the standard deviation after the radial profile 141 is subtracted? 142 143 StackApFlxFull : flux measured in radial apertures (raw, all radii) 144 145 * see note above on Standard Deviation 146 * radius 10 is not measured or reported in the CMF 147 148 StackApFlxFullC1 : flux measured in radial apertures (first convolution, all radii) 149 150 * see note above on Standard Deviation 151 * radius 10 is not measured or reported in the CMF 152 153 StackApFlxFullC2 : flux measured in radial apertures (second convolution, all radii) 154 155 * see note above on Standard Deviation 156 * radius 10 is not measured or reported in the CMF 157 158 StackPetrosian : petrosian analysis data 159 * xpetCf : fill factor is mis-calculated in psphot (consistently > 1.0)
Note:
See TracChangeset
for help on using the changeset viewer.
