IPP for PS1

(Up to the Main Page)

This page lists information related to the IPP processing of the PS1 data.

Data Distribution

• GPC1_DataDistribution
• PS1 Data Distribution Requests & Processing Management
• Nightly stack processing information

Outstanding Issues

• Errors related to Nebulous (NFS? mysql? other issues?)

IPP Operations

• Processing Processing Czar information
• PS1 IPP Czar Logs
• PS1_Operations Tag creation
• NightlyScienceCode Nightly science automation code
• NightlyScienceV2 New nightly science code documentation
• Nebulous related notes
• ChipStage_Timing Statistics on the processing time required for chip stage
• PS1_IASC_Chips Creating a dataset for the IASC Outreach Program
• Large Area Processing organization

MHPCC Cluster

• 'Weekend Disk Changes' : information about contacting the MHPCC weekend support if we lose drives on the weekend
• Production Cluster
• Production Cluster Status
• PS1 Operations
• Cluster Storage Notes
• GPC Summit Copy : EAM notes for running the summit copy system (Feb 2008)
• ​Data Store
• Summit Copy Status
• IPP mysql database backups
• Throughput Demo 2009.11.04
• Nebulous related notes
• Nebulous Issues that need addressing in the future

Configuration Information

• PS1_DVO_Seed_Database : Creating the DVO Database used to seed the PS1 Science DVO Database
• PS1_Tessellations: Generation of the tessellations used for PS1 science

Science Image Analysis

• 3pi DVO Database 2012.06.06 Information about the 3pi DVO database snapshot 2012.06.06
• GPC1 Defects Examples of interesting GPC1 defects
• 3pi DVO Database 2011.04.21 Information about the 3pi DVO database snapshot 2011.04.21
• Background Model and Oversubtraction
• Background Model and Stacks
• ​Performance Tests by DRAVG (July 2010)
• ppSub Modifications September 2010 : Discussion of ppSub modifications
• MD04 Stack Photometry 2010.08.19 : Exploration of stack photometry issues seen in MD04
• PS1 MD04 RefStack : Creation of the MD04 reference stacks]
• Stackphot Initial Release
• SAS Astrometry & Photometry Test 2010.03.10
• Completeness / False Positive rates : Completeness and false positive rates for the MD09 reprocessing of 11/19
• PS1_depth : first-pass look as PS1 depth
• PS1_color_diagrams_July2009 : Color-color and color-magnitude diagrams from the July 2009 data release
• PS1_Science_Processing_Status_20090705 : Science Processing Status for April-June Medium Deep fields (MD06, MD07, MD08)
• PS1_GPC1_GlintMasks : Glint Masking examples 2009.07.03
• PS1_GPC1_Glints_20090629 : Glint Sources 2009.06.29
• PS1_GPC1_Magic_Status_20090628 : Status of Magic analysis issues 2009.06.28
• PS1_GPC1_Magic_And_Short_Exposures : Analysis of magic troubles for short exposures.
• PS1_GPC1_Rotator_Measurements : EAM Reports on analysis of PS1 rotation sequence images
• GPC Tests 2008.06 : EAM notes on running the science analysis on GPC1 images
• GPC PR Images : EAM notes on processing GPC1 PR images (Apr 2008)
• GPC Notes 2008.02 : J.Koppenhoefer notes on running IPP on GPC1 data (Feb 2008)
• GPC Notes : EAM notes on running IPP on GPC1 data (Aug 2007)
• GPC Notes 2007.12 : EAM notes on running IPP on GPC1 data (Dec 2007)
• PS1_GPC1_GhostModel_V0 : Ghost Model Analysis (Run 2 data)
• MaskFeatures.pattern.20090722 : Examples of features that trigger Magic
• Image_Artifacts Examples of known image artifacts
• MoonGlintTest Examples of moon glints.
• ppSub_Issues Concerns about image subtraction -- EAM 2010.01.04
• ppSub_vs_Hotpants Comparison between ppSub and hotpants PSF-matching image subtraction codes
• EdgeRolloff Check of the edge of cell rolloff issue
• Quality_Flags Counts and logfile examples of non-zero chip and warp quality flags.
• DetectorLinearity Detector linearity work.
• psphot_detection_comparison Comparison of detections with different signal-to-noise using psphot
• GPC_BrightStarAstrometry_Issue Analysis of astrometry offset first found in STS data.
• Background_Continuity Discussion of attempts to improve background smoothness by ensuring cell-to-cell continuity.
• Stack_Rejection_Discussion Discussion of stacking and input rejection.
• MOPS_diff_false_positives Discussion of MOPS false positives/difference images.

Detrend Creation Information

• GPC1_Detrend_Documentation : General documentation on GPC1 detrends/creation/detselect.
• GPC1_Camera_Artifacts_Bathtub_Rings : Bathtub Rings and Related Issues
• GPC1_detrend_extended_notes : information about the various detRuns, peculiarities, and manual changes
• GPC1 Flat-field correction 2009.10 : Description of the flat-field correction analysis process
• GPC1 Mask 20101215 : Manual updates to the GPC1 bad pixel mask (2010-12-15)
• GPC1 Mask 20100122 : Manual updates to the GPC1 bad pixel mask since the camera mods 2010.01.14
• GPC1 Mask 20090622 : Manual updates to the GPC1 bad pixel mask
• GPC1 Mask 2009.05 : Analysis of the GPC1 bad pixel mask -- Run 3 (reconfigured camera)
• GPC1 Dark Linefits : examination of the bias correction based on pre and post-scan fitting
• GPC1 Mask 2008.06 : Analysis of the GPC1 bad pixel mask
• GPC FlatField Correction 2008.11 : GPC1 flat-field correction analysis -- some success!
• GPC FlatField Correction 2008.10 pt2 : GPC1 flat-field correction analysis -- further notes
• GPC FlatField Correction 2008.10 : GPC1 flat-field correction analysis
• GPC Dark Trends : J.Koppenhoefer notes and figures on dark current as a function of temperature and exposure time (Feb/Mar 2008)
• GPC Mask Results : S.Rodney notes and figures showing GPC1 bad pixel mask results (Fall 2007)
• GPC DarkMask : S.Rodney notes on building/characterizing bad pixel masks from GPC1 darks (Fall 2007)
• GPC Detrend Registration : script for registering pre-made GPC1 detrends
• GPC1 Mask analysis 20100525 : Notes on the mask fraction for the full FPA.
• GPC1_Mask_Stats_Week_One : Check of the mask statistics from the first week of processing with maskstats enabled.
• Background_Dark_Model : Analysis of the dark model contribution to background signal, and results of making a new dark (2012-03-08).
• GPC1_Reference_Catalog_Stats : Analysis of the reliability of the reference catalog based on multiple SAS2 processings.
• GPC1_FFT_Bias_Study : Study of bias images with FFTs.
• GPC1_Bias_Pattern_Study : Study of common mode structure along bias cells
• GPC1_M31_OTA_Offset_Study : Examination of the offsets between OTAs visible in the M31 background preserved images.
• GPC1_Video_Dark_Models : Study of the influence of video cells on the dark current.

Interesting & Complex Bugs

• stack_background_example : Example of the stack background offset problem
• PS1_2MASS_astrometry : Problems with 2MASS astrometry and the synthetic catalog (July 2009)
• Update Processsing versus magic
• duplicate_addstars
• MOPS_trailed_psfs : Issues with trail fitting claiming point source objects are trailed.

Postage Stamp Server

• PostageStampServer

Photometric Calibration

• PS1 Photometric System : Detailed analysis and results for PS1 bandpasses and photometry by JT
• Calibration_Concept_Discussion : Summary of some of the photometric calibration issues for 3pi
• GPC Zero Points : EAM notes on using Stripe 82 chip output processed by Johannes to get zero points
• GPC_Zero_Points_July09 : Investigation of GPC1 zero points from the July 2009 data release
• synth_catalog_July09 : Color magnitude diagrams for the synthetic catalog as compared to SDSS
• zpt_variation_july09 : Variation in zero point relative to SDSS
• FaintBias : Attempt to empirically remove the faint-end bias

Astrometric Calibration

Collimation & Alignment

• GPC1 C&A Results 2008.07

Committees

• The Data Reduction, Analysis and Verification (DRAV) Group is the formal link between the PS1SC and the IPP team. DRAV coordinates IPP testing outside the IPP team at IfA and has ~monthly telecons bringing together everyone working on or with IPP. Email contact is dravg_at_ps1sc.org, group membership and telecon minutes are posted on the ​PS1 wiki's DRAVG page
• DRAVG_test_suite_images_photometry List of IPP test suite images candidates

Miscellaneous

• magic.20081221.example -- discussion of the impact of IPP and Magic on the GPC1 masking.
• magic.20081112.example -- discussion of the state of magic as of Nov 12, and example masks
• pordig.20081029.sample -- discussion of the single-image analysis and data examples.
• ipp.psps.ids -- discussion of how data is identified as it moves though IPP to PSPS
• PS1_Graveyard -- missing raw chips