| Version 3 (modified by , 14 years ago) ( diff ) |
|---|
March 5, 2012
As discussed in the March 2 status, I've been looking into how the dark model may be introducing the gradients observed in the science data. To see what (if any) functional dependence these gradients had, I selected dark frames used in the construction of the current dark model, and calculated the detproc (overscan corrected, no dark applied) and detresid (overscan and current dark model applied) images. I used only XY67 in this study, as it has clear science image gradients, and was a useful test case. For each variable that could influence the dark, I selected two exposures that spanned the range, while attempting to keep the remaining variables constant. Here are the profile plots for these tests (profile the same as that used in the previous study of XY67: a large 300 pixel box covering the row of cells xy10-xy17):
dateobs
| exp_name | dateobs | exp_time | ccd_temp | detproc | detresid |
| o5605g0022d | 2011-02-13 | 10 | -78.455 | |
|
| o5743g0645d | 2011-07-01 | 10 | -79.6983 | |
|
exp_time
| exp_name | dateobs | exp_time | ccd_temp | detproc | detresid |
| o5641g0690d | 2011-03-21 | 0.001 | -87.2183 | |
|
| o5638g0035d | 2011-03-18 | 300 | -87.0017 | |
|
ccd_temp
| exp_name | dateobs | exp_time | ccd_temp | detproc | detresid |
| o5630g0494d | 2011-03-10 | 30 | -88.4883 | |
|
| o5736g0606d | 2011-06-24 | 30 | -77.745 | |
|
ccd_temp2
| exp_name | dateobs | exp_time | ccd_temp | detproc | detresid |
| o5654g0593d | 2011-04-03 | 10 | -86.765 | |
|
| o5612g0382d | 2011-02-20 | 10 | -72.1067 | |
|
30s test
| exp_name | dateobs | exp_time | ccd_temp | detproc | detresid |
| o5666g0013d | 2011-04-15 | 30 | -84.43 | |
|
| o5666g0645d | 2011-04-15 | 30 | -84.37 | |
|
Results
Looking at the residual plots for the dateobs and exp_time scans shows that there is some difference between the endpoints of these ranges, but that both have a strong gradient along the x pixel direction on each cell. Surprisingly, the direction of this gradient reverses in the ccd_temp scan, even though the temperatures studied in the previous scans are only a degree or two different. Repeating this study with a different exposure time shows that the 30s darks have a different gradient trend, a result confirmed by choosing two 30s darks from a single date with near identical ccd temperatures.
Given that the gradient remaining after the dark is applied slopes upward for the 0.001,10,and 300s darks, but downward in the 30s darks, it seems reasonable to assume that some aspect of the exposure time is not being fully modeled by the dark analysis. The current assumed functional form of the dark model is:
D = c_0 + (c_1 + c_2 ccd_temp + c_3 ccd_temp^2) * exp_time
Previous studies over the summer of 2011 suggested that c_3 is roughly equal to zero for the temperature range GPC1 currently operates at, and so this quadratic term in ccd_temp was dropped, leaving a model that is linear in exp_time and ccd_temp. If there is some non-linearity in the dark response as a function of exposure time, then it is easy to see how we could arrive at the observed residual structure by fitting a linear model to this response.
I've requested that a sequence of darks be taken to more finely cover the range of exposure times, and will use this data to develop a more complete dark model that will hopefully not introduce any residual gradients.
Attachments (113)
- o5666g0645d_detproc.png (8.8 KB ) - added by 14 years ago.
- o5666g0645d_detresid.png (8.2 KB ) - added by 14 years ago.
- o5666g0013d_detresid.png (8.2 KB ) - added by 14 years ago.
- o5666g0013d_detproc.png (8.9 KB ) - added by 14 years ago.
- o5612g0382d_detresid.png (8.1 KB ) - added by 14 years ago.
- o5612g0382d_detproc.png (8.2 KB ) - added by 14 years ago.
- o5654g0593d_detresid.png (8.0 KB ) - added by 14 years ago.
- o5654g0593d_detproc.png (8.2 KB ) - added by 14 years ago.
- o5638g0035d_detresid.png (8.0 KB ) - added by 14 years ago.
- o5641g0690d_detresid.png (8.5 KB ) - added by 14 years ago.
- o5743g0645d_detresid.png (8.0 KB ) - added by 14 years ago.
- o5605g0022d_detresid.png (8.5 KB ) - added by 14 years ago.
- o5736g0606d_detresid.png (7.7 KB ) - added by 14 years ago.
- o5630g0494d_detresid.png (8.2 KB ) - added by 14 years ago.
- o5638g0035d_detproc.png (8.4 KB ) - added by 14 years ago.
- o5641g0690d_detproc.png (8.2 KB ) - added by 14 years ago.
- o5641g0690d_detproc.2.png (8.2 KB ) - added by 14 years ago.
- o5743g0645d_detproc.png (8.3 KB ) - added by 14 years ago.
- o5605g0022d_detproc.png (8.3 KB ) - added by 14 years ago.
- o5736g0606d_detproc.png (8.0 KB ) - added by 14 years ago.
- o5630g0494d_detproc.png (8.3 KB ) - added by 14 years ago.
- dateobs.png (5.3 KB ) - added by 14 years ago.
- pontime.png (5.2 KB ) - added by 14 years ago.
- ccdtemp.png (5.2 KB ) - added by 14 years ago.
- dateobs4.png (9.6 KB ) - added by 14 years ago.
- pontime4.png (10.5 KB ) - added by 14 years ago.
- exptime4.png (6.5 KB ) - added by 14 years ago.
- ccdtemp4.png (10.0 KB ) - added by 14 years ago.
- profiles4.png (12.4 KB ) - added by 14 years ago.
- dateobs_new_dark.png (6.5 KB ) - added by 14 years ago.
- relative_detections.png (8.3 KB ) - added by 14 years ago.
- newdark_detections.png (6.8 KB ) - added by 14 years ago.
- skycell_comparison.png (1.1 MB ) - added by 14 years ago.
- false_detection_position.png (12.0 KB ) - added by 14 years ago.
- variance_ratio.png (12.9 KB ) - added by 14 years ago.
- variance_comparison.png (18.5 KB ) - added by 14 years ago.
- variance_ratio_CDF.png (13.7 KB ) - added by 14 years ago.
- OTA67xy71.png (119.7 KB ) - added by 14 years ago.
- o5722g0021d.detproc.png (1.5 MB ) - added by 14 years ago.
- col4.png (6.1 KB ) - added by 14 years ago.
- col6.png (6.2 KB ) - added by 14 years ago.
- col5.png (6.1 KB ) - added by 14 years ago.
- col1.png (6.1 KB ) - added by 14 years ago.
- col7.png (5.6 KB ) - added by 14 years ago.
- col2.png (6.3 KB ) - added by 14 years ago.
- col3.png (6.3 KB ) - added by 14 years ago.
- col0.png (5.6 KB ) - added by 14 years ago.
- col7_noisemap.png (5.5 KB ) - added by 14 years ago.
- col5_noisemap.png (6.2 KB ) - added by 14 years ago.
- col6_noisemap.png (6.3 KB ) - added by 14 years ago.
- col4_noisemap.png (6.1 KB ) - added by 14 years ago.
- col3_noisemap.png (6.3 KB ) - added by 14 years ago.
- col2_noisemap.png (6.3 KB ) - added by 14 years ago.
- col0_noisemap.png (5.6 KB ) - added by 14 years ago.
- col1_noisemap.png (6.2 KB ) - added by 14 years ago.
- 05_noisemap.png (6.2 KB ) - added by 14 years ago.
- 04_newdark.png (6.2 KB ) - added by 14 years ago.
- 02_czwreduct.png (6.4 KB ) - added by 14 years ago.
- 03_continuity.png (6.4 KB ) - added by 14 years ago.
- 06_noisemapSDSS.png (6.8 KB ) - added by 14 years ago.
- 06_noisemapSDSS.2.png (7.0 KB ) - added by 14 years ago.
- dark_viability.png (20.1 KB ) - added by 14 years ago.
- noisemap_viability.png (27.3 KB ) - added by 14 years ago.
- 07_fixedgain.png (6.2 KB ) - added by 14 years ago.
- fixedgain_improvement.png (6.6 KB ) - added by 14 years ago.
- b_dates.dat (18.5 KB ) - added by 14 years ago.
- glycol.png (6.2 KB ) - added by 14 years ago.
- 08_5sigma_cut.png (6.9 KB ) - added by 14 years ago.
- q4.png (24.1 KB ) - added by 14 years ago.
- q7.png (6.3 KB ) - added by 14 years ago.
- col2_gaintest.png (6.2 KB ) - added by 14 years ago.
- q5.png (38.9 KB ) - added by 14 years ago.
- q8.png (7.5 KB ) - added by 14 years ago.
- new_dark_slopes.png (11.4 KB ) - added by 14 years ago.
- proposed_boosts.png (9.0 KB ) - added by 14 years ago.
- XY67_boosttest.png (26.4 KB ) - added by 14 years ago.
- boosttest.png (5.6 KB ) - added by 14 years ago.
- boostmap_fov.png (21.1 KB ) - added by 14 years ago.
- noisemap_fov.png (22.2 KB ) - added by 14 years ago.
- full_fov_comparison.png (28.0 KB ) - added by 14 years ago.
- comparison_fov_5sig.png (17.5 KB ) - added by 14 years ago.
- boostmap_fov_5sig.png (46.7 KB ) - added by 14 years ago.
- noisemap_fov_5sig.2.png (50.6 KB ) - added by 14 years ago.
- noisemap_fov_5sig.png (50.6 KB ) - added by 14 years ago.
- boostmap_synthcat_fov_5sig.png (52.6 KB ) - added by 14 years ago.
- ghost_vectors.png (16.3 KB ) - added by 14 years ago.
- ghosts_rot_selected.png (19.3 KB ) - added by 14 years ago.
- ghosts_parity_corrected.png (20.4 KB ) - added by 14 years ago.
- ghost_comparison.png (53.2 KB ) - added by 14 years ago.
- finaltest_comparison.png (7.8 KB ) - added by 14 years ago.
- ghost_comparison_synth.png (54.4 KB ) - added by 14 years ago.
- finalsynthtest_comparison.png (7.9 KB ) - added by 14 years ago.
- false_positive_star_cor.png (23.3 KB ) - added by 14 years ago.
- fp_density_concentrations.png (24.0 KB ) - added by 14 years ago.
- ghost_comparison_photsynth.png (50.7 KB ) - added by 14 years ago.
- finalsynthphottest_comparison.png (8.3 KB ) - added by 14 years ago.
- ghost_comparison_photsynth_edit.png (40.2 KB ) - added by 14 years ago.
- ghost_comparison_test21_wSDSS.png (42.9 KB ) - added by 14 years ago.
- test21_wSDSS_comparison.png (8.6 KB ) - added by 14 years ago.
- ghost_comparison_test21.png (43.4 KB ) - added by 14 years ago.
- test21_comparison.png (7.7 KB ) - added by 14 years ago.
- test120525_comparison.png (8.0 KB ) - added by 14 years ago.
- ghost_comparison_test120525.png (49.7 KB ) - added by 14 years ago.
- ghost_comparison_test29.png (46.4 KB ) - added by 14 years ago.
- test29_comparison.png (7.7 KB ) - added by 14 years ago.
- test30_comparison.png (7.7 KB ) - added by 14 years ago.
- ghost_comparison_test30.png (46.2 KB ) - added by 14 years ago.
- ghost_comparison_test32.png (77.0 KB ) - added by 14 years ago.
- test32_comparison.png (7.5 KB ) - added by 14 years ago.
- ghost_comparison_test33.png (77.6 KB ) - added by 14 years ago.
- test33_comparison.png (7.5 KB ) - added by 14 years ago.
- ghost_comparison_test34.png (78.0 KB ) - added by 14 years ago.
- test34_comparison.png (7.5 KB ) - added by 14 years ago.




















