Index: /trunk/doc/design/datasys_cost.tex =================================================================== --- /trunk/doc/design/datasys_cost.tex (revision 2224) +++ /trunk/doc/design/datasys_cost.tex (revision 2225) @@ -1,5 +1,5 @@ % Copyright (C) 2004 Joshua Hoblitt % -% $Id: datasys_cost.tex,v 1.10 2004-03-10 02:50:05 jhoblitt Exp $ +% $Id: datasys_cost.tex,v 1.11 2004-10-28 00:33:56 jhoblitt Exp $ \documentclass[panstarrs,psreport]{panstarrs} @@ -49,5 +49,9 @@ \subsection{Identification} -This document establishes the estimated cost of the network and computing hardware necessary to support PS1. Due to the rapid rate of change in the IT industry the part numbers specified in this document may change prior to the actual purchase of equipment but the cost structure is expected to remain stable. +This document establishes the estimated cost of the network and computing +hardware necessary to support PS1. Due to the rapid rate of change in the IT +industry the part numbers specified in this document may change prior to the +actual purchase of equipment but the cost structure is expected to remain +stable. \section{Image Processing Pipeline and Data Storage Equipment} @@ -57,13 +61,19 @@ \subsubsection{CPU} -Phase 2 and phase 4 dominate the IPP computational processing needs. Assuming 3.0GHz CPUs we need 40 CPUs for phase 2 and 30 CPUs for phase 4. +Phase 2 and phase 4 dominate the IPP computational processing needs. Assuming +3.0GHz CPUs we need 40 CPUs for phase 2 and 30 CPUs for phase 4. \subsubsection{Storage} -The storage needs for the first year of PS1's operation have been estimated to be between 700-1100TB. Assuming that 0.5TB SATA disks become available in the next year we will require between 2000-3000 units. - -\subsection{Hardware} - -A 5u rackmount case has been identified that can support 24 hot-swappable SATA disks, 1 internal disk, and a dual CPU motherboard. The large data storage capacity requirement is the driver for the number of complete systems we will have to acquire. +The storage needs for the first year of PS1's operation have been estimated to +be between 700-1100TB. Assuming that 0.5TB SATA disks become available in the +next year we will require between 2000-3000 units. + +\subsection{Hardware} + +A 5u rackmount case has been identified that can support 24 hot-swappable SATA +disks, 1 internal disk, and a dual CPU motherboard. The large data storage +capacity requirement is the driver for the number of complete systems we will +have to acquire. We will need between 85 and 132 nodes to support our data requirements. @@ -72,15 +82,15 @@ \begin{tabular}{lrrr} % \begin{tabular}{>{$}l<{$}>{$}r>{$}r>{$}r} -Item &Estimated Price&85 nodes&132 nodes\\ -\cline{1-4} -24 x 0.5TB SATA disks (bulk storage) &\$7,200 &\$61,200 &\$950,400\\ -1 x 0.5TB SATA disk (OS + software) &\$300 &\$25,500 &\$39,600\\ -2 x 3.0GHz CPUs &\$2,000 &\$170,000 &\$264,000\\ -2 x 12-port SATA raid controller &\$1,500 &\$127,500 &\$198,000\\ -1 x Motherboard &\$500 &\$42,500 &\$66,000\\ -4 x 1GB RAM DIMM &\$1,400 &\$119,000 &\$184,800\\ -1 x 5u Rackmount Chassis &\$2,800 &\$238,000 &\$369,600\\ -\cline{1-4} -Total &$\sim$\$16,000&$\sim$\$1,360,000&$\sim$\$2,112,000\\ +Item &Estimated Price&85 nodes&132 nodes\\ +\cline{1-4} +24 x 0.5TB SATA disks (bulk storage) &\$7,200 &\$61,200 &\$950,400\\ +1 x 0.5TB SATA disk (OS + software) &\$300 &\$25,500 &\$39,600\\ +2 x 3.0GHz CPUs &\$2,000 &\$170,000 &\$264,000\\ +2 x 12-port SATA raid controller &\$1,500 &\$127,500 &\$198,000\\ +1 x Motherboard &\$500 &\$42,500 &\$66,000\\ +4 x 1GB RAM DIMM &\$1,400 &\$119,000 &\$184,800\\ +1 x 5u Rackmount Chassis &\$2,800 &\$238,000 &\$369,600\\ +\cline{1-4} +Total &$\sim$\$16,000&$\sim$\$1,360,000&$\sim$\$2,112,000\\ \end{tabular} \end{center} @@ -100,77 +110,54 @@ \subsubsection{Bandwidth} -It has been estimated that we need a throughput of $\sim604Mb/s$ to support PS1 at a 30s cadence. A OC-12c Packet over SONET connection can provide enough bandwidth. +It has been estimated that we need a throughput of $\sim604Mb/s$ to support PS1 +at a 30s cadence. A OC-12c Packet over SONET connection can provide enough +bandwidth. \subsubsection{Switch ports} -We will needs to support 32 x Summit Pixel Servers and up to 16 x Servers/Workstations at the summit. The data center switch should be able to support up to 192 computation nodes and control computers. +We will needs to support 32 x Summit Pixel Servers and up to 16 x +Servers/Workstations at the summit. The data center switch should be able to +support up to 192 computation nodes and control computers. \subsection{Network Link} -An OC-12c PoS link from the summit of Haleakala to Kihei on Maui will cost \$16,970 per month with a 3-year contract or \$16,460 per month with a 5-year contract. Setup fees will vary by location and are estimated to be in the range of \$10,000 - \$100,000 per end point (\$20K - \$200K total). - -\subsection{Hardware} - -\subsubsection{Summit Core Switch} +An OC-12c PoS link from the summit of Haleakala to Kihei on Maui will cost +\$16,970 per month with a 3-year contract or \$16,460 per month with a 5-year +contract. Setup fees will vary by location and are estimated to be in the +range of \$10,000 - \$100,000 per end point (\$20K - \$200K total). + +\subsection{Hardware} + +\subsubsection{Summit Core Switch/Router} \begin{center} Cisco 6513 \begin{tabular}{lr} -Item &Estimated Price\\ -\cline{1-2} -1 x WS-C6513 Cat 6513 &\$15,250\\ -1 x WS-X6K-S720-6408A &\$33,000\\ -1 x WS-X6548-RJ-45 &\$17,995\\ -1 x WS-C6K-13SLT-FAN2 &\$745\\ -2 x WS-CAC-4000W-US &\$10,000\\ -\cline{1-2} -Total &$\sim$\$76,990\\ -\end{tabular} -\end{center} - -\subsubsection{Data Center Core Switch} +Item &Estimated Price\\ +\cline{1-2} +1 x WS-C6513 Cat 6513 &\$15,250\\ +1 x WS-X6K-S720-6408A &\$33,000\\ +1 x WS-X6548-RJ-45 &\$17,995\\ +1 x WS-C6K-13SLT-FAN2 &\$745\\ +2 x WS-CAC-4000W-US &\$10,000\\ +\cline{1-2} +Total &$\sim$\$76,990\\ +\end{tabular} +\end{center} + +\subsubsection{IPP Core Switch/Router} \begin{center} Cisco 6513 \begin{tabular}{lr} -Item &Estimated Price\\ -\cline{1-2} -1 x WS-C6513 Cat 6513 &\$15,250\\ -1 x WS-X6K-S720-6408A &\$33,000\\ -4 x WS-X6548-RJ-45 &\$71,980\\ -1 x WS-C6K-13SLT-FAN2 &\$745\\ -2 x WS-CAC-4000W-US &\$10,000\\ -\cline{1-2} -Total &$\sim$\$130,975\\ -\end{tabular} -\end{center} - -\subsubsection{Summit Border Router} - -\begin{center} -Cisco 7606 -\begin{tabular}{lr} -Item &Estimated Price\\ -\cline{1-2} -1 x 7606-SUP720XL-PS &\$49,500\\ -1 x OSM-2OC12-POS-SI+ &\$60,000\\ -1 x WS-X6548-RJ-45 &\$17,995\\ -\cline{1-2} -Total &$\sim$\$127,495\\ -\end{tabular} -\end{center} - -\subsubsection{Date Center Border Router} - -\begin{center} -Cisco 7606 -\begin{tabular}{lr} -Item &Estimated Price\\ -\cline{1-2} -1 x 7606-SUP720XL-PS &\$49,500\\ -1 x OSM-2OC12-POS-SI+ &\$60,000\\ -1 x WS-X6548-RJ-45 &\$17,995\\ -\cline{1-2} -Total &$\sim$\$127,495\\ +Item &Estimated Price\\ +\cline{1-2} +1 x WS-C6513 Cat 6513 &\$15,250\\ +1 x WS-X6K-S720-6408A &\$33,000\\ +4 x WS-X6548-RJ-45 &\$71,980\\ +1 x WS-C6K-13SLT-FAN2 &\$745\\ +2 x WS-CAC-4000W-US &\$10,000\\ +\cline{1-2} +Total &$\sim$\$130,975\\ \end{tabular} \end{center} @@ -226,21 +213,50 @@ \subsubsection{Maintenance} -\tbd{TBD} +ClusterFS, Inc. has given an estimate of \$64,000 per year for a 128 node +cluster. + \section{Power Consumption} -\subsection{Nodes} - -The Pan-STARRS Prototype IPP Computational/Storage Node draws $\sim600w$ when idle. As this is the idle load and the power consumption of computer components is rapidly increasing we should budget for $\sim750w$ per node. +\subsection{Summit Data Systems} + +\begin{center} +\begin{tabular}{lrrr} +Item &Count &Per Unit &Power Consumption\\ +\cline{1-4} +Pixel Server Node &16 &600w &9,600w\\ +Ethernet Switches &4 &540w(high) &2,160w\\ +Core Switch/Router &1 &2,000w &2,000w\\ +OATS Database Server &2 &600w &1,200w\\ +Desktop Computers &3 &230w &690w\\ +OATS Server &1 &600w &600w\\ +PTS Server &1 &600w &600w\\ +20.1" LCD monitors &6 &65w &390w\\ +Managed Power Strips &15 &10 &150w\\ +16-port KVM &1 &50w &50w\\ +32-port Console Server &1 &17w &17w\\ +\cline{1-4} +SubTotal &&&17,457w\\ +UPS &6% loss &&1,047w\\ +\cline{1-4} +Total &&&18,504\\ +\end{tabular} +\end{center} + +\subsection{IPP Data Systems} + +The Pan-STARRS Prototype IPP Computational/Storage Node draws $\sim600w$ when +idle. As this is the idle load and the power consumption of computer +components is rapidly increasing we should budget for $\sim750w$ per node. \begin{center} 85 nodes \begin{tabular}{lr} -Item &Estimated Power Consumption\\ -\cline{1-2} -Nodes &63,750w\\ -Network + Misc. &25,000w\\ -\cline{1-2} -Total &88,750w\\ +Item &Estimated Power Consumption\\ +\cline{1-2} +Nodes &63,750w\\ +Network + Misc. &25,000w\\ +\cline{1-2} +Total &88,750w\\ \end{tabular} \end{center} @@ -249,10 +265,10 @@ 132 nodes \begin{tabular}{lr} -Item &Estimated Power Consumption\\ -\cline{1-2} -Nodes &99,000w\\ -Network + Misc. &25,000w\\ -\cline{1-2} -Total &124,000w\\ +Item &Estimated Power Consumption\\ +\cline{1-2} +Nodes &99,000w\\ +Network + Misc. &25,000w\\ +\cline{1-2} +Total &124,000w\\ \end{tabular} \end{center} @@ -264,8 +280,8 @@ \begin{center} \begin{tabular}{lr} -Heat Generated &A/C Load\\ -\cline{1-2} -88,750w &25.242tons\\ -124,000w &35.268tons\\ +Heat Generated &A/C Load\\ +\cline{1-2} +88,750w &25.242tons\\ +124,000w &35.268tons\\ \end{tabular} \end{center} @@ -277,10 +293,10 @@ \begin{center} \begin{tabular}{lrr} -Item &85 nodes &132 nodes\\ +Item &85 nodes &132 nodes\\ \cline{1-3} -Nodes + Net + Misc. &88,750w &124,000w\\ -A/C &25,242w &35,268w\\ +Nodes + Net + Misc. &88,750w &124,000w\\ +A/C &25,242w &35,268w\\ \cline{1-3} -Total &113,992w &159,268w\\ +Total &113,992w &159,268w\\ \end{tabular} \end{center} @@ -288,14 +304,17 @@ \subsection{Cost Estimate} -This Billing estimate is from Maui Electric Company, Ltd. (MECO) for schedule "J" service with a power factor of 0.9 (MECO refers to this as a power factor of 90\%) based on Feburary, 2004 rates. - -\begin{center} -\begin{tabular}{lr} -Peak Demand &Estimated Price\\ -\cline{1-2} -115kw &\$13,000 per month\\ -160kw &\$18,100 per month\\ -\end{tabular} -\end{center} +This Billing estimate is from Maui Electric Company, Ltd. (MECO) for schedule +"J" service with a power factor of 0.9 (MECO refers to this as a power factor +of 90\%) based on Feburary, 2004 rates. + +\begin{center} +\begin{tabular}{lr} +Peak Demand &Estimated Price\\ +\cline{1-2} +115kw &\$13,000 per month\\ +160kw &\$18,100 per month\\ +\end{tabular} +\end{center} + \section{Misc} @@ -305,11 +324,11 @@ \begin{center} \begin{tabular}{lr} -Item &Estimated Price\\ -\cline{1-2} -Racks/cabinets &\$50,000\\ -Cabling &\$25,000\\ -Tools &\$10,000\\ -\cline{1-2} -Total &$\sim$\$85,000\\ +Item &Estimated Price\\ +\cline{1-2} +Racks/cabinets &\$50,000\\ +Cabling &\$25,000\\ +Tools &\$10,000\\ +\cline{1-2} +Total &$\sim$\$85,000\\ \end{tabular} \end{center} @@ -317,5 +336,6 @@ \subsection{Electrical Wiring} -Each cabinet will require 4 x 220v/15amp circuits. \tbd{Material/labor costs are TBD}. +Each cabinet will require 4 x 220v/15amp single phase circuits. +\tbd{Material/labor costs are TBD}. \bibliographystyle{plain}