| | 1 | Return to the [wiki:WikiStart Main Page] |
| | 2 | |
| | 3 | == Top-Level Overview == |
| | 4 | * [wiki:IPP_data_model IPP data model]: Information on structure and content of IPP outputs |
| | 5 | |
| | 6 | == IPP Pipeline Database == |
| | 7 | * [wiki:IppTools_FAQ ippTools FAQ] : how you tell pantasks what to do |
| | 8 | * [wiki:Ippdb_duplicate_data ippdb duplicate data] |
| | 9 | * [http://www.usm.lmu.de/people/arri/PS1/ippMonitor bash interface] to query the IPP mySQL database (A. Riffeser 2008/09/23) |
| | 10 | * [wiki:Ippdb_copy_database ippdb copy database] : copy the entire contents of a mySql database into a new database. |
| | 11 | |
| | 12 | == Pantasks & ippTasks == |
| | 13 | * [wiki:Pantasks_FAQ Pantasks FAQ] : common questions and problems with pantasks |
| | 14 | * [wiki:Pantasks_server_mode Pantasks server mode] : guide to running pantasks in the "server" mode. |
| | 15 | |
| | 16 | == Nebulous == |
| | 17 | * [wiki:Nebulous_FAQ Nebulous FAQ] |
| | 18 | * [wiki:Nebulous_Throughput_Issues Nebulous Throughput Issues] |
| | 19 | |
| | 20 | == Detrend Creation == |
| | 21 | * [wiki:Bad_Pixel_Masks Bad Pixel Masks] : General description of how bad pixel masks are constructed. S.Rodney |
| | 22 | * Biases |
| | 23 | * Darks |
| | 24 | * Flats |
| | 25 | * Fringes |
| | 26 | * Masks |
| | 27 | * Shutter Correction |
| | 28 | |
| | 29 | == Analysis Components == |
| | 30 | * Deep field photometry - [wiki:Durham_WHDF Durham_WHDF] |
| | 31 | * Extended source photometry - Sloan |
| | 32 | |
| | 33 | == Science Analysis Stages == |
| | 34 | * Chip |
| | 35 | * Camera |
| | 36 | * Fake |
| | 37 | * Warp |
| | 38 | * Stack |
| | 39 | * Diff |
| | 40 | * Magic |
| | 41 | |
| | 42 | == DVO == |
| | 43 | |
| | 44 | === Introduction === |
| | 45 | |
| | 46 | DVO (the Desktop Virtual Observatory) is a system for manipulating collections of images and measurements related to astronomical objects. The DVO system consists of several programs which insert data in the database system, extract data from the database, or manipulate data in the database. One of these is the DVO shell, which provides a command-line driven, programmable user interface to the astronomical objects and measurements in the database. The DVO shell is based on the [wiki:Opihi_Shell_Language Opihi shell language] which provides the tools to manipulate and display data in various representations. The DVO shell adds to this basic command set a collection of functions which provide direct access to the contents of the DVO database tables. |
| | 47 | |
| | 48 | === Schema === |
| | 49 | |
| | 50 | DVO uses the following database tables: |
| | 51 | |
| | 52 | * Sky Layout : defines the organization of the object / measurement tables on the sky |
| | 53 | * Photcodes : defines the photometric systems and transformations between them |
| | 54 | * Images : describes the images known the DVO; for a mosaic camera, one chip corresponds to a single image, and an additional meta-image is used to represent the full mosaic (note: these meta-images may soon be moved to a separate table; also note that the mosaic meta-image is only supplied for mosaic images with 'mosaic' astrometry solutions). |
| | 55 | * Average : average properties of the astronomical objects, excluding photometric average information (one row per object) |
| | 56 | * SecFilt : average photometric properties for astronomical objects (one row per 'average' filter per object). |
| | 57 | * Measure : all detections of the astronomical objects |
| | 58 | * Missing : non-detections of known astronomical objects nominally touched by an image (note : this table is not populated by default) |
| | 59 | |
| | 60 | The standard implementation of DVO uses a stores the database information as a collection FITS tables. For a subset of the tables (Average, SecFilt, Measure, Missing), the data is partitioned into multiple files representing different regions on the sky. The partitioning scheme allows for a wide range of scale on which the sky is divided. At one extreme, the entire sky is represented by a single file. At the next level, this is split into Declination bands of width 7.5 degrees. Next, these bands are split into RA ranges. The next levels subdivide the RA / DEC ranges into smaller and smaller patches. From the third level on down, the size of the sky regions varies with Galactic latitude to better sample regions of high and low stellar density. |
| | 61 | |
| | 62 | === DVO Shell === |
| | 63 | |
| | 64 | * [wiki:Opihi_Shell_Language Opihi Shell Language] |
| | 65 | * [wiki:DVO_Command_Help_Pages DVO Command Help Pages] |
| | 66 | |
| | 67 | === Working With DVO === |
| | 68 | |
| | 69 | * Inserting Data (addstar) |
| | 70 | |
| | 71 | === Other DVO Pages === |
| | 72 | |
| | 73 | * [wiki:DVO_FAQ DVO FAQ] -- look here for questions and solutions and add your own! |
| | 74 | * [http://kiawe.ifa.hawaii.edu/Elixir/Ohana/DVO/ DVO Intro] : introduction to the Desktop Virtual Observatory (on the CFHT elixir pages) |
| | 75 | * [http://pan-starrs.ifa.hawaii.edu/project/IPP/documentation/dvo.pdf dvo.pdf] manual from project documentation pages (needs updating, but describes concepts of dvo) |
| | 76 | * [wiki:DVODB.Synth.grizy.bright DVO DB Synth grizy bright] -- Bright-end subset DVO database with complete Ohana tarball |
| | 77 | * [wiki:DVO_Example DVO Example] -- a tarball and instructions on very basic DVO usage |
| | 78 | * [wiki:DVO_Challenge DVO Challenge] -- links to notes and Heidelberg slides created by Mike Liu |
| | 79 | * [wiki:DVO_Challenge#FAQ_/_Suggestions_for_Changes Includes FAQs and change suggestions] |
| | 80 | * [wiki:USNO-B_in_DVO USNO-B in DVO] : Building the USNO-B DVO catalog |
| | 81 | * [wiki:2MASS,_USNO-B,_SDSS_Merge 2MASS, USNO-B, SDSS Merge] : Notes on generating a merged DVO database |
| | 82 | * [wiki:2MASS_info_in_DVO 2MASS info in DVO] : A quick summary on what info from 2MASS has been imported into DVO |
| | 83 | * [wiki:DVO_GPC1_pt_2 DVO GPC1 pt 2] : MWV's test of DVO and addstar with GPC1 pt 2 release (see mail to ps-ipp-users from Gene Magnier on 2008/10/06) |
| | 84 | |
| | 85 | * '''SDSS stripe82 data set''' For the daring, here is a 202 MB tarfile expanding into a 588 MB directory with a very small subset of multi-epoch (but not [yet] coadded) SDSS stripe 82 data at [http://www.mpia.de/homes/jester/IPPstripe82_catdir_20080610.tgz http://www.mpia.de/homes/jester/IPPstripe82_catdir_20080610.tgz] The README describes what's there and how it was made. This is not (yet) useful for science! Email jester at mpia.de with questions regarding this dataset. |
| | 86 | |
| | 87 | == Simtest == |
| | 88 | * [wiki:SimtestNew New Simtest]: Running the revised Simtest (IPP 2.6 and later) |
| | 89 | * [http://www.usm.lmu.de/people/arri/PS1/IPP-2.6_simtest.pdf IPP-2.6 simtest tutorial (pdf)]: about simtest & ippMonitor by A. Riffeser |
| | 90 | * [wiki:Simtest Simtest]: Annotated walk-through. S.Rodney, modified for IPP 2.2 by M. Wood-Vasey |
| | 91 | * [wiki:SimtestEAM SimtestEAM] : EAM notes |
| | 92 | * [wiki:SimtestVerification Simtest Verification]: verification of SIMTEST input/output data products |
| | 93 | * [wiki:Simtest2.1Notes Simtest2.1Notes] : Some notes I took while running simtest on IPP 2.1. By Julia Fang |
| | 94 | * [wiki:Simtest_IPP_2.1 Simtest_IPP_2.1]: Annotated walk-through. S.Rodney |
