Changes between Initial Version and Version 1 of ippToPspsSAS37HeatherNotes

Timestamp:

Dec 19, 2014, 3:26:13 PM (12 years ago)

Author:

heather

Comment:

--

ippToPspsSAS37HeatherNotes

@@ +1 @@
+= These are Heather's notes (and status) for SAS37 / ipptopsps =
+
+== build of minis ==
+
+ This was done with minimal problems.  Addstar ff/ sky had problems initially, Gene put in fixes for that.  The faults that I have in the minis (only a handful of faults) are related to cluster / gpc1 problems. Rather than sort them out, I left those few exposures out. It's not complete (to ~10 exposures).
+
+The labels and associated minis:
+
+|| stage  || label || mini ||
+|| cam   || SAS.20141118 || SAS.20141118.cam ||
+||sky     || SAS.20141118.rerun || SAS.20141118.sky.rerun.V2 ||
+||fullforce || SAS.20141118.rerun || SAS.20141118.ff.rerun.V2 ||
+||diff ||SAS.20141118 || SAS.20141118.diff || 
+
+== merge of SAS ==
+
+This was done with no problems for diff, minimal problems for sky/cam/ff.  First, there was a faulted sky, which reported no errors and completed on retry. I don't know how that affects the mergedvodb.  Then, ff had problems to merge (related to the lensing stuff, Gene investigated and fixed).  I was then able to merge ff into the mergedvodb.  I redid the mergedvodb (to make absolutely certain that it's good)
+
+||Name  || minis  || order ||
+||SAS.20141118.diff||SAS.20141118.diff || 1||
+||SAS.20141118.V2 ||SAS.20141118.sky.rerun.V2 || 1 ||
+||SAS.20141118.V2 ||SAS.20141118.cam || 2 ||
+||SAS.20141118.V2 ||SAS.20141118.ff.rerun.V2 || 3||
+
+== calibration of SAS ==
+
+I intend to put a definitive set of rules/scripts for this.  So far, neither SAS has been calibrated.  The rules should be different for each
+
+=== SAS.20141118.diff ===
+
+ * addstar resort
+ * relphot -averages -update
+ * (gene ??  relastro? what params?)
+
+=== SAS.20141118.V2 ===
+
+ Previous SASes have been calibrated this way:
+
+ * in tools/dvodb_calib
+   * run.addstar.resort
+   * run.setphot
+   * gene.run.relastro.part1
+   * gene.run.relastro.part2
+   * gene.run.relphot.3pinew
+
+ SAS 36 was calibrated by Gene this way:
+
+{{{ for the sas calibration, see the file /data/ipp064.0/eugene/fforce.20140714/run.sascals and other files referenced in that script.
+
+there are a few points:
+
+* the sas images do not have ubercal zero points.  I have defined a group of ubercal-tied exposures (ucal.smfs) which need to be merged into the database before running 'setphot'.   I did this manually.  you probably should just make a reference mini from this set to be used for this purpose
+* sas does not need the koppenhoefer correction, so I have skipped that step.  ditto for galaxy motion / quasar tie
+* the current best boundary tree is /data/ipp064.0/eugene/relastro.20140923/tess.3pi.fits, but the version in the fforce.20140714 directory is OK for sas.
+* the current best ubercal table is ucalqy_bigflat.fits in fforce.20140714
+}}}
+ 
+Heather notes that I should do run.addstar.resort before doing gene's method
+
+
+== ipptopsps progress ==
+
+I am nearly done with FW/FO stuff, the other batches have been done and tested. 
+
+Example batches that I tested:
+
+ * 9196 --> DO Batch 
+ * 9200 --> DF Batch 
+ * 9065 --> ST Batch 
+ * 9067 --> P2 Batch 
+ * 9192 --> OB Batch 
+
+I opened each batch in topcat and checked that the columns were mostly sensible and investigated 0's or -999s as necessary
+
+=== DO Batch ===
+* DiffObject
+  * skycellID = -1 (not sure what it should be)
+  * ra/dec err = -999
+  * qfPerfect not by filter (H: need to fix)
+  * ng/nr/ni/nz/ny = 0 (H: need to investigate)
+
+=== DF Batch ===
+ * DiffMeta
+   * magSat = 0. (???)
+ * DiffToImage 
+   * has 60 chips... (H: needs to select only the chips , see how Stacks do this)
+ * DiffDetection
+   * telluricExt = 0 (this is in the dvo)
+   * momentM3*/M4* = -999 (not in cmf)
+   * appFillF = -999 (not in cmf)
+   
+=== P2 Batch ===
+ * FrameMeta (ok!)
+ * ImageMeta 
+    * magSat =0
+    * completMag =0
+    * psfModelID = -999
+ * Detection
+    * posAngle = -999
+    * extNSigma = -999 (H: I put this in here, but do we calculate it for camera?)
+    * zp changes in a funny pattern (it looks like each chip is cut into 4 quarters, each quarter a different zp)
+   * psfMajorFWHM = -999
+   * psfMinorFWHM = -999
+   * psfCore = -999
+   * apFlux/apFluxErr/appFillF = 0
+
+=== OB Batch ===
+ * ObjectThin
+  * nStackObjectRows = 0 (not sure if this is just for this batch or for all)
+ * MeanObject (ok!)
+
+=== ST Batch ===
+(this batch was a lucky batch that only had one filter (near the edge) - so I only checked z filter)
+ * StackMeta
+   * magSat, completMag, astroScat,photoScat, nAstro, nPhoRef, calibmodnum = -999
+ * StackObjectThin
+   * bestDetection = -999
+ * StackObjectAttributes
+   * bestDetection = -999
+   * zExtNSigma = -999 
+ * StackModelFitExp
+  * stackDetectRowID = -999
+  * bestDetection = -999
+  * zexpRadiusErr, zExpAbErr, zExpPhiErr, zExpCf = -999
+ * StackModelFitDev
+  * stackDetectRowID = -999
+  * bestDetection = -999
+  * zDevRadiusErr, zDevAbErr, zDevPhiErr, zDevCf = -999
+ * StackModelFitSer
+  * stackDetectRowID = -999
+  * bestDetection = -999
+  * zSerRadiusErr, zSerAbErr, zSerPhiErr, zSerCf = -999
+ * StackPetrosian 
+  * stackDetectRowID = -999
+  * bestDetection = -999
+ * StackApFlx
+  * stackDetectRowID = -999
+  * bestDetection = -999
+ * StackApFlxEGUnc
+  * stackDetectRowID = -999
+  * bestDetection = -999
+  * apertures 6-10 unfilled
+ * StackApFlxEGCon6
+  * stackDetectRowID = -999
+  * bestDetection = -999
+  * apertures 6-10 unfilled
+ * StackApFlxEGCon8
+  * stackDetectRowID = -999
+  * bestDetection = -999
+  * apertures 6-10 unfilled
+
+== Things I still need to fix ==
+
+ * number of apertures (from 10 to 9)
+ * aperture metadata