IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changeset 2225


Ignore:
Timestamp:
Oct 27, 2004, 2:33:56 PM (22 years ago)
Author:
jhoblitt
Message:

update heat dissipation numbers
formatting

File:
1 edited

Legend:

Unmodified
Added
Removed

  • trunk/doc/design/datasys_cost.tex

    r194 r2225  
    11% Copyright (C) 2004  Joshua Hoblitt
    22%
    3 % $Id: datasys_cost.tex,v 1.10 2004-03-10 02:50:05 jhoblitt Exp $
     3% $Id: datasys_cost.tex,v 1.11 2004-10-28 00:33:56 jhoblitt Exp $
    44
    55\documentclass[panstarrs,psreport]{panstarrs}
    … …  
    4949\subsection{Identification}
    5050
    51 This document establishes the estimated cost of the network and computing hardware necessary to support PS1.  Due to the rapid rate of change in the IT industry the part numbers specified in this document may change prior to the actual purchase of equipment but the cost structure is expected to remain stable.
     51This document establishes the estimated cost of the network and computing
     52hardware necessary to support PS1.  Due to the rapid rate of change in the IT
     53industry the part numbers specified in this document may change prior to the
     54actual purchase of equipment but the cost structure is expected to remain
     55stable.
    5256
    5357\section{Image Processing Pipeline and Data Storage Equipment}
    … …  
    5761\subsubsection{CPU}
    5862
    59 Phase 2 and phase 4 dominate the IPP computational processing needs.  Assuming 3.0GHz CPUs we need 40 CPUs for phase 2 and 30 CPUs for phase 4.
     63Phase 2 and phase 4 dominate the IPP computational processing needs.  Assuming
     643.0GHz CPUs we need 40 CPUs for phase 2 and 30 CPUs for phase 4.
    6065
    6166\subsubsection{Storage}
    6267
    63 The storage needs for the first year of PS1's operation have been estimated to be between 700-1100TB.  Assuming that 0.5TB SATA disks become available in the next year we will require between 2000-3000 units.
    64 
    65 \subsection{Hardware}
    66 
    67 A 5u rackmount case has been identified that can support 24 hot-swappable SATA disks, 1 internal disk, and a dual CPU motherboard.  The large data storage capacity requirement is the driver for the number of complete systems we will have to acquire.
     68The storage needs for the first year of PS1's operation have been estimated to
     69be between 700-1100TB.  Assuming that 0.5TB SATA disks become available in the
     70next year we will require between 2000-3000 units.
     71
     72\subsection{Hardware}
     73
     74A 5u rackmount case has been identified that can support 24 hot-swappable SATA
     75disks, 1 internal disk, and a dual CPU motherboard.  The large data storage
     76capacity requirement is the driver for the number of complete systems we will
     77have to acquire.
    6878
    6979We will need between 85 and 132 nodes to support our data requirements.
    … …  
    7282\begin{tabular}{lrrr}
    7383% \begin{tabular}{>{$}l<{$}>{$}r>{$}r>{$}r}
    74 Item                                    &Estimated Price&85 nodes&132 nodes\\
    75 \cline{1-4}
    76 24 x 0.5TB SATA disks (bulk storage)    &\$7,200 &\$61,200  &\$950,400\\
    77 1 x 0.5TB SATA disk (OS + software)     &\$300   &\$25,500  &\$39,600\\
    78 2 x 3.0GHz CPUs                         &\$2,000 &\$170,000 &\$264,000\\
    79 2 x 12-port SATA raid controller        &\$1,500 &\$127,500 &\$198,000\\
    80 1 x Motherboard                         &\$500   &\$42,500  &\$66,000\\
    81 4 x 1GB RAM DIMM                        &\$1,400 &\$119,000 &\$184,800\\
    82 1 x 5u Rackmount Chassis                &\$2,800 &\$238,000 &\$369,600\\
    83 \cline{1-4}
    84 Total                                   &$\sim$\$16,000&$\sim$\$1,360,000&$\sim$\$2,112,000\\
     84Item                                    &Estimated Price&85 nodes&132 nodes\\
     85\cline{1-4}
     8624 x 0.5TB SATA disks (bulk storage)    &\$7,200 &\$61,200  &\$950,400\\
     871 x 0.5TB SATA disk (OS + software)     &\$300   &\$25,500  &\$39,600\\
     882 x 3.0GHz CPUs                         &\$2,000 &\$170,000 &\$264,000\\
     892 x 12-port SATA raid controller        &\$1,500 &\$127,500 &\$198,000\\
     901 x Motherboard                         &\$500   &\$42,500  &\$66,000\\
     914 x 1GB RAM DIMM                        &\$1,400 &\$119,000 &\$184,800\\
     921 x 5u Rackmount Chassis                &\$2,800 &\$238,000 &\$369,600\\
     93\cline{1-4}
     94Total                    &$\sim$\$16,000&$\sim$\$1,360,000&$\sim$\$2,112,000\\
    8595\end{tabular}
    8696\end{center}
    … …  
    100110\subsubsection{Bandwidth}
    101111
    102 It has been estimated that we need a throughput of $\sim604Mb/s$ to support PS1 at a 30s cadence.  A OC-12c Packet over SONET connection can provide enough bandwidth.
     112It has been estimated that we need a throughput of $\sim604Mb/s$ to support PS1
     113at a 30s cadence.  A OC-12c Packet over SONET connection can provide enough
     114bandwidth.
    103115
    104116\subsubsection{Switch ports}
    105117
    106 We will needs to support 32 x Summit Pixel Servers and up to 16 x Servers/Workstations at the summit.  The data center switch should be able to support up to 192 computation nodes and control computers.
     118We will needs to support 32 x Summit Pixel Servers and up to 16 x
     119Servers/Workstations at the summit.  The data center switch should be able to
     120support up to 192 computation nodes and control computers.
    107121
    108122\subsection{Network Link}
    109123
    110 An OC-12c PoS link from the summit of Haleakala to Kihei on Maui will cost \$16,970 per month with a 3-year contract or \$16,460 per month with a 5-year contract.  Setup fees will vary by location and are estimated to be in the range of \$10,000 - \$100,000 per end point (\$20K - \$200K total). 
    111 
    112 \subsection{Hardware}
    113 
    114 \subsubsection{Summit Core Switch}
     124An OC-12c PoS link from the summit of Haleakala to Kihei on Maui will cost
     125\$16,970 per month with a 3-year contract or \$16,460 per month with a 5-year
     126contract.  Setup fees will vary by location and are estimated to be in the
     127range of \$10,000 - \$100,000 per end point (\$20K - \$200K total). 
     128
     129\subsection{Hardware}
     130
     131\subsubsection{Summit Core Switch/Router}
    115132
    116133\begin{center}
    117134Cisco 6513
    118135\begin{tabular}{lr}
    119 Item                    &Estimated Price\\
    120 \cline{1-2}
    121 1 x WS-C6513 Cat 6513   &\$15,250\\
    122 1 x WS-X6K-S720-6408A   &\$33,000\\
    123 1 x WS-X6548-RJ-45      &\$17,995\\
    124 1 x WS-C6K-13SLT-FAN2   &\$745\\
    125 2 x WS-CAC-4000W-US     &\$10,000\\
    126 \cline{1-2}
    127 Total                   &$\sim$\$76,990\\
    128 \end{tabular}
    129 \end{center}
    130 
    131 \subsubsection{Data Center Core Switch}
     136Item            &Estimated Price\\
     137\cline{1-2}
     1381 x WS-C6513 Cat 6513   &\$15,250\\
     1391 x WS-X6K-S720-6408A   &\$33,000\\
     1401 x WS-X6548-RJ-45      &\$17,995\\
     1411 x WS-C6K-13SLT-FAN2   &\$745\\
     1422 x WS-CAC-4000W-US     &\$10,000\\
     143\cline{1-2}
     144Total                   &$\sim$\$76,990\\
     145\end{tabular}
     146\end{center}
     147
     148\subsubsection{IPP Core Switch/Router}
    132149
    133150\begin{center}
    134151Cisco 6513
    135152\begin{tabular}{lr}
    136 Item                    &Estimated Price\\
    137 \cline{1-2}
    138 1 x WS-C6513 Cat 6513   &\$15,250\\
    139 1 x WS-X6K-S720-6408A   &\$33,000\\
    140 4 x WS-X6548-RJ-45      &\$71,980\\
    141 1 x WS-C6K-13SLT-FAN2   &\$745\\
    142 2 x WS-CAC-4000W-US     &\$10,000\\
    143 \cline{1-2}
    144 Total                   &$\sim$\$130,975\\
    145 \end{tabular}
    146 \end{center}
    147 
    148 \subsubsection{Summit Border Router}
    149 
    150 \begin{center}
    151 Cisco 7606
    152 \begin{tabular}{lr}
    153 Item                    &Estimated Price\\
    154 \cline{1-2}
    155 1 x 7606-SUP720XL-PS    &\$49,500\\
    156 1 x OSM-2OC12-POS-SI+   &\$60,000\\
    157 1 x WS-X6548-RJ-45              &\$17,995\\
    158 \cline{1-2}
    159 Total                   &$\sim$\$127,495\\
    160 \end{tabular}
    161 \end{center}
    162 
    163 \subsubsection{Date Center Border Router}
    164 
    165 \begin{center}
    166 Cisco 7606
    167 \begin{tabular}{lr}
    168 Item                    &Estimated Price\\
    169 \cline{1-2}
    170 1 x 7606-SUP720XL-PS    &\$49,500\\
    171 1 x OSM-2OC12-POS-SI+   &\$60,000\\
    172 1 x WS-X6548-RJ-45              &\$17,995\\
    173 \cline{1-2}
    174 Total                   &$\sim$\$127,495\\
     153Item            &Estimated Price\\
     154\cline{1-2}
     1551 x WS-C6513 Cat 6513   &\$15,250\\
     1561 x WS-X6K-S720-6408A   &\$33,000\\
     1574 x WS-X6548-RJ-45      &\$71,980\\
     1581 x WS-C6K-13SLT-FAN2   &\$745\\
     1592 x WS-CAC-4000W-US     &\$10,000\\
     160\cline{1-2}
     161Total                   &$\sim$\$130,975\\
    175162\end{tabular}
    176163\end{center}
    … …  
    226213\subsubsection{Maintenance}
    227214
    228 \tbd{TBD}
     215ClusterFS, Inc. has given an estimate of \$64,000 per year for a 128 node
     216cluster.
     217
    229218
    230219\section{Power Consumption}
    231220
    232 \subsection{Nodes}
    233 
    234 The Pan-STARRS Prototype IPP Computational/Storage Node draws $\sim600w$ when idle.  As this is the idle load and the power consumption of computer components is rapidly increasing we should budget for $\sim750w$ per node.
     221\subsection{Summit Data Systems}
     222
     223\begin{center}
     224\begin{tabular}{lrrr}
     225Item                        &Count      &Per Unit   &Power Consumption\\
     226\cline{1-4}
     227Pixel Server Node           &16         &600w       &9,600w\\
     228Ethernet Switches           &4          &540w(high) &2,160w\\
     229Core Switch/Router          &1          &2,000w     &2,000w\\
     230OATS Database Server        &2          &600w       &1,200w\\
     231Desktop Computers           &3          &230w       &690w\\
     232OATS Server                 &1          &600w       &600w\\
     233PTS Server                  &1          &600w       &600w\\
     23420.1" LCD monitors          &6          &65w        &390w\\
     235Managed Power Strips        &15         &10         &150w\\
     23616-port KVM                 &1          &50w        &50w\\
     23732-port Console Server      &1          &17w        &17w\\
     238\cline{1-4}
     239SubTotal                                            &&&17,457w\\
     240UPS                         &6% loss                &&1,047w\\
     241\cline{1-4}
     242Total                                                &&&18,504\\
     243\end{tabular}
     244\end{center}
     245
     246\subsection{IPP Data Systems}
     247
     248The Pan-STARRS Prototype IPP Computational/Storage Node draws $\sim600w$ when
     249idle.  As this is the idle load and the power consumption of computer
     250components is rapidly increasing we should budget for $\sim750w$ per node.
    235251
    236252\begin{center}
    23725385 nodes
    238254\begin{tabular}{lr}
    239 Item            &Estimated Power Consumption\\
    240 \cline{1-2}
    241 Nodes           &63,750w\\
    242 Network + Misc. &25,000w\\
    243 \cline{1-2}
    244 Total           &88,750w\\
     255Item            &Estimated Power Consumption\\
     256\cline{1-2}
     257Nodes           &63,750w\\
     258Network + Misc. &25,000w\\
     259\cline{1-2}
     260Total           &88,750w\\
    245261\end{tabular}
    246262\end{center}
    … …  
    249265132 nodes
    250266\begin{tabular}{lr}
    251 Item            &Estimated Power Consumption\\
    252 \cline{1-2}
    253 Nodes           &99,000w\\
    254 Network + Misc. &25,000w\\
    255 \cline{1-2}
    256 Total           &124,000w\\
     267Item            &Estimated Power Consumption\\
     268\cline{1-2}
     269Nodes           &99,000w\\
     270Network + Misc. &25,000w\\
     271\cline{1-2}
     272Total           &124,000w\\
    257273\end{tabular}
    258274\end{center}
    … …  
    264280\begin{center}
    265281\begin{tabular}{lr}
    266 Heat Generated  &A/C Load\\
    267 \cline{1-2}
    268 88,750w         &25.242tons\\
    269 124,000w        &35.268tons\\
     282Heat Generated  &A/C Load\\
     283\cline{1-2}
     28488,750w         &25.242tons\\
     285124,000w        &35.268tons\\
    270286\end{tabular}
    271287\end{center}
    … …  
    277293\begin{center}
    278294\begin{tabular}{lrr}
    279 Item            &85 nodes       &132 nodes\\
     295Item                &85 nodes   &132 nodes\\
    280296\cline{1-3}
    281 Nodes + Net + Misc.     &88,750w        &124,000w\\
    282 A/C             &25,242w        &35,268w\\
     297Nodes + Net + Misc. &88,750w    &124,000w\\
     298A/C                 &25,242w    &35,268w\\
    283299\cline{1-3}
    284 Total           &113,992w       &159,268w\\
     300Total               &113,992w   &159,268w\\
    285301\end{tabular}
    286302\end{center}
    … …  
    288304\subsection{Cost Estimate}
    289305
    290 This Billing estimate is from Maui Electric Company, Ltd. (MECO) for schedule "J" service with a power factor of 0.9 (MECO refers to this as a power factor of 90\%) based on Feburary, 2004 rates.
    291 
    292 \begin{center}
    293 \begin{tabular}{lr}
    294 Peak Demand     &Estimated Price\\
    295 \cline{1-2}
    296 115kw           &\$13,000 per month\\
    297 160kw           &\$18,100 per month\\
    298 \end{tabular}
    299 \end{center}
     306This Billing estimate is from Maui Electric Company, Ltd. (MECO) for schedule
     307"J" service with a power factor of 0.9 (MECO refers to this as a power factor
     308of 90\%) based on Feburary, 2004 rates.
     309
     310\begin{center}
     311\begin{tabular}{lr}
     312Peak Demand     &Estimated Price\\
     313\cline{1-2}
     314115kw           &\$13,000 per month\\
     315160kw           &\$18,100 per month\\
     316\end{tabular}
     317\end{center}
     318
    300319
    301320\section{Misc}
    … …  
    305324\begin{center}
    306325\begin{tabular}{lr}
    307 Item            &Estimated Price\\
    308 \cline{1-2}
    309 Racks/cabinets  &\$50,000\\
    310 Cabling         &\$25,000\\
    311 Tools           &\$10,000\\
    312 \cline{1-2}
    313 Total           &$\sim$\$85,000\\
     326Item            &Estimated Price\\
     327\cline{1-2}
     328Racks/cabinets  &\$50,000\\
     329Cabling         &\$25,000\\
     330Tools           &\$10,000\\
     331\cline{1-2}
     332Total           &$\sim$\$85,000\\
    314333\end{tabular}
    315334\end{center}
    … …  
    317336\subsection{Electrical Wiring}
    318337
    319 Each cabinet will require 4 x 220v/15amp circuits.  \tbd{Material/labor costs are TBD}.
     338Each cabinet will require 4 x 220v/15amp single phase circuits.
     339\tbd{Material/labor costs are TBD}.
    320340
    321341\bibliographystyle{plain}
Note: See TracChangeset for help on using the changeset viewer.