Changeset 882
- Timestamp:
- Jun 4, 2004, 2:49:48 PM (22 years ago)
- File:
-
- 1 edited
-
trunk/doc/design/ippSRS.tex (modified) (22 diffs)
Legend:
- Unmodified
- Added
- Removed
-
trunk/doc/design/ippSRS.tex
r837 r882 1 %%% $Id: ippSRS.tex,v 1. 3 2004-06-03 02:56:58 eugene Exp $1 %%% $Id: ippSRS.tex,v 1.4 2004-06-05 00:49:48 eugene Exp $ 2 2 \documentclass[panstarrs]{panstarrs} 3 3 … … 84 84 \DocumentsInternalSection 85 85 PSDC-130-001 & PS-1 Design Reference Mission \\ \hline 86 PSDC-130-xxx & PS-1 SCD \\ \hline 86 87 PSDC-430-004 & Pan-STARRS IPP C Code Conventions \\ \hline 87 88 PSDC-430-006 & Pan-STARRS IPP ADD \\ \hline 89 PSDC-430-006 & Pan-STARRS IPP SDRS \\ \hline 88 90 PSDC-430-007 & Pan-STARRS IPP PSLib SDRS \\ \hline 89 91 \DocumentsExternalSection … … 101 103 after AP survey} 102 104 105 \tbd{define astronomy concepts: cleaned, pre-processed, significant, 106 outlier} 107 103 108 The IPP must perform the following tasks: 104 109 105 110 \begin{enumerate} 106 111 107 \item Accept raw images from OATS at a sustained rate of 1 exposure 108 per 30 seconds. 109 110 \item Accept metadata from OATS at a sustained rate of \tbd{XXX MB / sec}. 111 112 \item Produce high-quality calibration images from the raw calibration 113 images. The calibration images must not introduce systematic 114 uncertainties greater than \tbd{0.2\%}. \tbd{Requirements on the 115 speed of processing the calibration images.} 116 117 \item Pre-process the science images with the high-quality calibration 118 images. 112 \item Accept raw images from the summit at a sustained rate of 1 113 exposure per 30 seconds. 114 115 \item Accept metadata from the summit at a sustained rate of \tbd{XXX 116 MB / sec}. 117 118 \item Produce high-quality master calibration images from the raw 119 calibration images. The master calibration images must not 120 introduce systematic uncertainties greater than \tbd{0.2\%}. 121 \tbd{Requirements on the speed of processing the calibration 122 images.} 123 124 \item Pre-process the science images with the high-quality master 125 calibration images. 119 126 120 127 \item Merge multiple pre-processed science images -- from multiple 121 128 telescopes or from sequential, dithered exposures -- into single, 122 cleaned, stacked images .129 cleaned, stacked images with corresponding signal-to-noise maps. 123 130 124 131 \item Subtract a static sky image from the cleaned, stacked images to 125 produce an image of only the transient events.132 produce an image of only the transient objects. 126 133 127 134 \item Excise the significant transients and outliers from the 128 pre-processed science images and merge the cleaned images into the 129 static sky image. 130 131 \item Detect objects on the four types of images: pre-processed 132 images, the stacked image, the difference image, and the static sky 133 image. 135 pre-processed science images. \tbd{how to handle variable stars?} 136 137 \item merge the cleaned images into the static sky image, and 138 update the corresponding exposure (S/N) maps. 139 140 \item Detect and measure parameters of objects on the four types of 141 images: pre-processed images, the stacked image, the difference 142 image, and the static sky image. 134 143 135 144 \item Determine astrometry of the detected objects relative to an 136 astrometric reference to an accuracy of \tbd{30 mas}. 145 astrometric reference to an accuracy of \tbd{30 mas}, with a limit of 146 \tbd{xxx} on the outliers. 137 147 138 148 \item Determine photometry of the detected objects relative to a 139 149 photometric reference to an accuracy of \tbd{5 millimag} relative 140 150 photometry and \tbd{10 millimag} absolute photometry in photometric 141 weather. 151 weather. \tbd{before vs after PS-1 AP Surver} \tbd{bright vs faint 152 errors} with a limit of \tbd{xxx} on the outliers. \tbd{limit 153 depends on filter} 142 154 143 155 \item Produce a high-quality astrometric reference catalog from the 144 156 extracted objects on a time-scale of 6 months. The astrometric 145 157 reference must have an absolute accuracy of \tbd{30 mas} and a local 146 relative accuracy of \tbd{10 mas}. Proper motions of all nearly147 stationary objects must be determined with an accuracy of \tbd{XXX148 mas / year}.158 relative accuracy of \tbd{10 mas}. Proper motions of detected 159 objects with distances greater than 1000 AU must be determined with 160 an accuracy of \tbd{XXX mas / year}. 149 161 150 162 \item Produce a high-quality photometric reference catalog from the 151 extracted objects on a time-scale of 6 months. The photometric152 reference must have an consistency across the sky of \tbd{5153 millimag} and an absolute calibration to the external system defined154 by \tbd{SDSS} of \tbd{10 millimag}.163 extracted point-source objects on a time-scale of 6 months. The 164 photometric reference must have an consistency across the sky of 165 \tbd{5 millimag} and an absolute calibration to the external system 166 defined by \tbd{SDSS} of \tbd{10 millimag}. 155 167 156 168 \item Publish the static sky images to the Pan-STARRS published static 157 sky server on a time-scale of \tb d{1 month}.169 sky server on a time-scale of \tbr{1 month}. 158 170 159 171 \item Publish the detected objects to the Pan-STARRS published object 160 database on a time-scale of \tb d{1 week}.172 database on a time-scale of \tbr{1 week}. 161 173 162 174 \item Provide access to external Pan-STARRS clients to the detected 163 objects on time-scales of \tbd{1 minute} after the image is 164 processed. 175 objects on time-scales of \tbr{10 minute} after the image is 176 obtained.\comment{this is a top-level science requirement.} 177 178 \item Store the raw images for a particular period of, depending on 179 the survey source of the data. In PS-1, the AP and IVP Survey data 180 must be stored for the lifetime of the project. Other raw data must 181 be store for \tbr{1 month}. 182 183 \item Store the detected objects for a period of time, depending on 184 the type of detection. Transients from the P4$\Delta$ images may be 185 excised after \tbr{6 monts}. 165 186 166 187 \end{enumerate} … … 198 219 199 220 Source code must be in C. All source code must be compiled with `gcc' 200 version v2.95 or higher. 221 version v2.95 or higher, and the tested compiler version must be 222 defined for the delivered software product. 201 223 202 224 Scripting language must be \tbd{Python, version TBD}. … … 355 377 \subsection{Architectural Components} 356 378 357 As discussed in the Pan-STARRS System Concept Definition, the IPP is 358 organized into a number of clearly-defined software elements. The SCD 359 provides a detailed description of the roles and responsibilities of 360 these subsystems. In brief, the IPP consists of a collection of 361 science analysis stages, a set of architectural components which 362 provide the infrastructure needed to run the analysis programs, and a 363 collection of hardware on which all of the software elements exist. 379 As discussed in the Pan-STARRS System Concept Definition 380 (PSDC-xxx-xxx), the IPP is organized into a number of clearly-defined 381 software elements. The SCD provides a detailed description of the 382 roles and responsibilities of these subsystems. In brief, the IPP 383 consists of a collection of science analysis stages, a set of 384 architectural components which provide the infrastructure needed to 385 run the analysis programs, and a collection of hardware on which all 386 of the software elements exist. 364 387 365 388 The architectural components consist of: … … 383 406 384 407 \item {\bf Metadata Database:} This component is required to store the 385 data which is not directly related to images or astronomical objects 386 as needed to perform the analysis specified above. 408 all other data which are neither image files nor astronomical object 409 data. The Metadata Database is the authoratative source for all 410 metadata data, including metadata which may be duplicated elsewhere, 411 such as in the headers of images in the image database. 387 412 388 413 \item {\bf Controller:} In order to perform the analysis stages … … 424 449 machine and notify the requesting agent of the new locations. 425 450 426 The IPP Image Server be able to maintain multiple copies of each427 image, as specifiedby the user.451 The IPP Image Server store multiple copies of each image, the number 452 of copies specified independently for each by the user. 428 453 429 454 The IPP Image Server must maintain a record of all image copies … … 551 576 \begin{table} 552 577 \begin{center} 553 \caption{AP D etection Classes \& Object Parameters\label{APdetections}}578 \caption{AP Data Volume Requirements\label{APrates}} 554 579 \begin{tabular}{lrrrr} 555 580 \hline … … 557 582 Quantity & P2 & P4$\Sigma$ & P4$\Delta$ & SS \\ 558 583 \hline 559 detection limit & $20 \sigma$ & $5 \sigma$ & $3 \sigma$& \\560 depth (r') & 20.8 & 23.0 && \\561 stars deg$^{-2}$ ($|b|>10$) & $1 \times 10^5$ & $ 1 \times 10^5$ & $1 \times 10^5$ & $1 \times 10^5$\\562 stars FPA$^{-1}$ ($|b|>10$) & $7 \times 10^5$ & $ 1 \times 10^5$ & $1 \times 10^5$ & $1 \times 10^5$\\563 stars sec$^{-1}$ ($|b|>10$) & $2.3 \times 10^4$ & $ 1 \times 10^5$ & $1 \times 10^5$ & $1 \times 10^5$\\564 bytes star$^{-1}$ & 64 & 100 & 64 &\\565 MB sec$^{-1}$ & 1.4 & 2.2 & 0.7 &\\566 PS-1 total TB & 8 & 12 & 4 &\\584 detection limit & $20 \sigma$ & $5 \sigma$ & $3 \sigma$ & \\ 585 depth (r') & 20.8 & 23.0 & ? & \\ 586 stars deg$^{-2}$ ($|b|>10$) & $1 \times 10^5$ & $4 \times 10^5$ & $2 \times 10^5$ & \\ 587 stars FPA$^{-1}$ ($|b|>10$) & $7 \times 10^5$ & $2.8 \times 10^6$ & $1.4 \times 10^6$ & \\ 588 stars sec$^{-1}$ ($|b|>10$) & $2.3 \times 10^4$ & $2.3 \times 10^4$ & $1.2 \times 10^4$ & \\ 589 bytes star$^{-1}$ & 64 & 100 & 64 & \\ 590 MB sec$^{-1}$ & 1.4 & 2.2 & 0.7 & \\ 591 PS-1 total TB & 8 & 12 & 4 & \\ 567 592 \hline 568 593 \end{tabular} … … 578 603 rates. 579 604 580 \subsubsection{Metadata Database -- FIX ME} 605 \tbd{archive lifetime} 606 607 \tbd{reliability} 608 609 \tbd{backups} 610 611 \subsubsection{Metadata Database} 581 612 582 613 \tbd{this section needs to be reviewed and revised} … … 605 636 \tbd{queries} 606 637 607 {\bf note: description of images belong in the Metadata database, 608 locationof images is in the Image server}609 610 \paragraph{Configuration Database -- FIX ME}611 612 The IPP requires a Configuration Database to store and provide access to613 information about the IPP itself. Examples of data in the638 \tbd{description of images belong in the Metadata database, location 639 of images is in the Image server} 640 641 \paragraph{Configuration Database} 642 643 The IPP requires a Configuration Database to store and provide access 644 to information about the IPP itself. Examples of data in the 614 645 configuration database include the default parameters for the various 615 646 analysis programs, the description of the computing environment, the 616 647 process status information, etc. \tbd{part of metadata database?}. 648 649 \tbd{some information must have access limited to specific responsible 650 people. ie, software / hardware configuration $\rightarrow$ sysadmin; 651 science parameters $\rightarrow$ science team.} 617 652 618 653 \subsubsection{Controller} … … 880 915 peak-to-peak deviations of \tbr{0.5\%}. 881 916 917 \tbd{color of stars in flat-field correction?} 918 882 919 \paragraph{Sky \& Fringe subtraction} 883 920 … … 1029 1066 1030 1067 The output image must maintain photometric consistency with the input 1031 image to within 0.2\%. \tbd{interpolation method?} 1068 image to within 0.2\%. \tbd{does interpolation method choice risk 1069 losing flux?} 1032 1070 1033 1071 \paragraph{Flux matching} … … 1036 1074 factors needed to combine the images photometrically. 1037 1075 1076 \tbd{is flux matched automatically by calibration?} 1077 1038 1078 \paragraph{Image outlier pixel rejection} 1039 1079 1040 Pixels from the group of images which are inconsistent \tbd{how much?} 1041 with the ensemble of pixel values must be identified and flagged. 1080 When multiple images are combined, the group of input pixels which 1081 contribute to an output pixel must be examined and pixels from the 1082 group of images which are inconsistent with the ensemble \tbd{how 1083 much?} must be identified and flagged. 1042 1084 1043 1085 This outlier rejection must be performed optionally. 1086 1087 \tbd{for moving objects and images which are not simultaneous, do we 1088 identify the moving objects?} 1089 1090 \tbd{use the spatial information? fit a 2-D Nth order polynomial to 1091 the collection of pixels and then look for outliers} 1044 1092 1045 1093 \paragraph{Initial cleaned image} … … 1056 1104 The static sky image must be subtracted from the stacked, cleaned 1057 1105 image. 1106 1107 \tbd{what about different stellar colors?} 1058 1108 1059 1109 \paragraph{Find objects in the image} … … 1122 1172 the relevant image metadata (\ie filter, exposure time, etc). 1123 1173 1174 \paragraph{Image Processing Q/A} 1175 1176 Before the image is added to the static sky, it must pass Q/A tests. 1177 1124 1178 \paragraph{Update static sky} 1125 1179 … … 1372 1426 \item Catalog to mean positions 1373 1427 \item Mean to apparent positions 1428 \item Apparent positions + pointing to tangent plane coordinates 1374 1429 \item Apparent positions + pointing to focal plane coordinates 1375 1430 \item focal plane to specific detector (OTA) … … 1552 1607 \subsection{External Interfaces} 1553 1608 1609 Images from OATS / Camera data store. 1610 1611 Summit Metadata from OATS. 1612 1613 Image Q/A assessment to OATS 1614 1615 3$\sigma$ transient non-orphaned detections to MOPS 1616 1617 3$\sigma$ transient detections to Transient Science Client 1618 1619 Published static sky images to Science Database 1620 1621 Published objects (P2, P4S, P4D, SS) to Science Database 1622 1554 1623 \subsection{Internal Interfaces} 1555 1624 … … 1562 1631 \tbd{this section should be parred down a bit by referring more to the 1563 1632 hardware report}. 1633 1634 \tbd{switch to passive voice (we will address foo $\rightarrow$ foo is 1635 addressed)} 1564 1636 1565 1637 This section discusses the Pan-STARRS Image Processing Pipeline (IPP) … … 1597 1669 object db & 4 TB \\ 1598 1670 \hline 1599 total & 116 TB \\1671 total & 466 TB \\ 1600 1672 \hline 1601 1673 \end{tabular} … … 1778 1850 input images & $1.5 \times 4 \times 32$ MB \\ 1779 1851 input masks & $1.5 \times 4 \times 8$ MB \\ 1780 static sky & 32 MB \\1781 static weight & 32 MB \\1852 static sky & 32x9/4 MB \\ 1853 static weight & 32x9/4 MB \\ 1782 1854 \hline 1783 1855 input: & 304 MB \\ … … 1913 1985 \subsection{Software Integrity Tests} 1914 1986 1915 MHPCC must test the integrity of the software, specifically to check 1916 that the code does not produce memory leaks, segmentation faults. 1987 MHPCC must test that the code does not produce memory leaks. 1988 1989 MHPCC must test that the code does not produce segmentation faults. 1917 1990 1918 1991 \subsection{Basic Unit Tests}
Note:
See TracChangeset
for help on using the changeset viewer.
