Concurrency and exchanging design knowledge among thermal and IT management are required to achieve an energy efficient operational data center. In this paper, a design approach is presented to bring adaptability and concurrency for coordinated minimization of cooling and IT power consumption in data centers. The presented approach is centered on a proper orthogonal decomposition based reduced order thermal modeling approach, and power profiling of the IT equipment to identify the optimal parameters of the air cooling systems along with optimal dynamic workload distribution among the servers. The method is applied to a data center cell with different rack and server architectures. The results show that the design approach results in 12–70% saving in the total energy consumption of the data center cell for various scenarios, compared with a baseline design.
1.
2007, “
Report to Congress on Server and Data Center Energy Efficiency Public Law 109-431
,” U.S. Environmental Protection Agency ENERGY STARProgram.2.
Greenberg
, S.
, Mills
, E.
, Tschudi
, W.
, Rumsey
, P.
, and Myatt
, B.
, 2006, “Best Practices for Data Centers: Lessons Learned from Benchmarking 22 Data Centers
,” Proceedings of the ACEEE Summer Study on Energy Efficiency in Buildings in Asilomar, CA
, pp. 76
–87
.3.
Rolander
, N.
, Rambo
, J.
, Joshi
, Y.
, Mistree
, F.
, and Allen
, J. K.
, 2006, “Robust Design of Turbulent Convective Systems Using the Proper Orthogonal Decomposition
,” ASME J. Mech. Des.
0161-8458, 128
, pp. 844
–855
.4.
Samadiani
, E.
, Joshi
, Y.
, and Mistree
, F.
, 2008, “The Thermal Design of A Next Generation Data Center: A Conceptual Exposition
,” ASME J. Electron. Packag.
1043-7398, 130
(4
), p. 041104
.5.
Isci
, C.
, Contreras
, G.
, and Martonosi
, M.
, 2006, “Live, Runtime Phase Monitoring and Prediction on Real Systems With Application to Dynamic Power Management
,” Proceedings of the 39th International Symposium on Microarchitecture (MICRO-39)
, pp. 359
–370
.6.
Zhu
, Q.
, Chen
, Z.
, Tan
, L.
, Zhou
, Y.
, Keeton
, K.
, and Wilkes
, J.
, 2005, “Hibernator: Helping Disk Arrays Sleep Through the Winter
,” ACM SIGOPS Operating Systems Review
0163-5980, 39
(5
), pp. 177
–190
.7.
Balkan
, D.
, Sharkey
, J.
, Ponomarev
, D.
, and Ghose
, K.
, 2006, “SPARTAN: Speculative Avoidance of Register Allocations to Transient Values for Performance and Energy-Efficiency
,” Proceedings of the 15th IEEE/ACM International Conference on Parallel Architectures and Compilation Techniques (PACT’06)
, Seattle, WA.8.
Sharkey
, J.
, Ponomarev
, D.
, Ghose
, K.
, and Ergin
, O.
, 2006, “Instruction Packing: Toward Fast and Energy-Efficient Instruction Scheduling
,” ACM Transactions on Architecture and Code Optimization
1544-3566, 3
(2
), pp. 156
–181
.9.
Kumar
, R.
, Tullsen
, D.
, Ranganathan
, P.
, Jouppi
, N.
, and Farkas
, K.
, 2004, “Single-ISA Heterogeneous Multi-Core Architectures for Multithreaded Workload Performance
,” ACM SIGARCH Computer Architecture News
0163-5964, 32
(2
), p. 64
.10.
Nathuji
, R.
, Isci
, C.
, and Gorbatov
, E.
, 2007, “Exploiting Platform Heterogeneity for Power Efficient Data Centers
,” Proceedings of the IEEE International Conference on Autonomic Computing (ICAC)
, p. 5
.11.
Chase
, J.
, Anderson
, D.
, Thakar
, P.
, Vahdat
, A.
, and Doyle
, R.
, 2001, “Managing Energy and Server Resources in Hosting Centers
,” ACM SIGOPS Operating Systems Review
0163-5980, 35
(5
), pp. 103
–116
.12.
Patel
, C. D.
, Sharma
, R.
, Bash
, C.
, and Beitelmal
, M.
, 2002, “Thermal Considerations in Cooling of Large Scale High Compute Density Data Centers
,” Proceedings of the ITHERM 2002-Eight Intersociety Conference on Thermal and Thermomechanical Phenomena in Electronic Systems
, San Diego, CA, pp. 767
–776
.13.
Rambo
, J.
, and Joshi
, Y.
, 2003, “Multi-Scale Modeling of High Power Density Data Centers
,” Proceedings of the ASME InterPACK03
, Kauai, HI.14.
Rambo
, J.
, and Joshi
, Y.
, 2003, “Physical Models in Data Center Airflow Simulations
,” Proceedings of the IMECE-03-ASME International Mechanical Engineering Congress and R&D Exposition
, Washington, DC.15.
Shrivastava
, S.
, Sammakia
, B.
, Schmidt
, R.
, and Iyengar
, M.
, 2005, “Comparative Analysis of Different Data Center Airflow Management Configurations
,” Proceedings of the ASME InterPACK05
, San Francisco, CA.16.
Iyengar
, M.
, Schmidt
, R.
, Sharma
, A.
, McVicker
, G.
, Shrivastava
, S.
, Sri-Jayantha
, S.
, Amemiya
, Y.
, Dang
, H.
, Chainer
, T.
, and Sammakia
, B.
, 2005, “Thermal Characterization of Non-Raised Floor Air Cooled Data Centers Using Numerical Modeling
,” Proceedings of the ASME InterPACK05
, San Francisco, CA.17.
Schmidt
, R.
, Karki
, K. C.
, and Patankar
, S. V.
, 2004, “Raised-Floor Data Center: Perforated Tile Flow Rates for Various Tile Layouts
,” Proceedings of the ITHERM 2004-Ninth Intersociety Conference on Thermal and Thermomechanical Phenomena in Electronic Systems
, Las Vegas, NV.18.
VanGilder
, J. W.
, and Schmidt
, R.
, 2005, “Airflow Uniformity Through Perforated Tiles in a Raised-Floor Data Center
,” Proceedings of the ASME InterPACK
, San Francisco, CA.19.
Chen
, W.
, Allen
, J. K.
, Tsui
, K.
, and Mistree
, F.
, 1996, “A Procedure for Robust Design: Minimizing Variations Caused by Noise Factors and Control Factors
,” ASME J. Mech. Des.
0161-8458, 118
, pp. 478
–485
.20.
Lawrence Berkeley National Laboratory and Rumsey Engineers
, “Data Center Energy Benchmarking Case Study
,” http://datacenters.lbl.gov/http://datacenters.lbl.gov/21.
Mistree
, F.
, Hughes
, O. F.
, and Bras
, B.
, 1993, “The Compromise Decision Support Problem and the Adaptive Linear Programming Algorithm
,” Structural Optimization: Status and Promise
, M. P.
Kamat
, ed., AIAA
, Washington, D.C.
, pp. 247
–286
.22.
Samadiani
, E.
, Joshi
, Y.
, and Mistree
, F.
, 2007, “The Thermal Design of A Next Generation Data Center: A Conceptual Exposition
,” Proceedings of the Thermal Issues in Emerging Technologies, ThETA 1
, Cairo, Egypt.23.
Schmit
, R.
, and Iyengar
, M.
, 2005, “Effect of Data Center Layout on Rack Inlet Air Temperatures
,” Proceedings of the ASME InterPACK 05
, San Francisco, CA.24.
Patel
, C.
, Bash
, C.
, Belady
, C.
, Stahl
, L.
, and Sullivan
, D.
, 2001, “Computational Fluid Dynamics Modeling of High Compute Density Data Centers to Assure System Inlet Air Specifications
,” Proceedings of the ASME IPACK’01
, Kauai, HI.25.
Rambo
, J.
, and Joshi
, Y.
, 2006, “Thermal Modeling of Technology Infrastructure Facilities: A Case Study of Data Centers
,” The Handbook of Numerical Heat Transfer’
, W. J.
Minkowycz
, E. M.
Sparrow
, and J. Y.
Murthy
, eds., Taylor & Francis
, London
, pp. 821
–850
.26.
Schmidt
, R.
, Karki
, K. C.
, Kelkar
, K. M.
, Radmehr
, A.
, and Patankar
, S. V.
, 2001, “Measurements and Predictions of the Flow Distribution Through Perforated Tiles in Raised Floor Data Centers
,” Proceedings of the ASME InterPACK01
, Kauai, HI.27.
Shah
, A.
, Carey
, V.
, Bash
, C.
, and Patel
, C.
, 2005, “Exergy-Based Optimization Strategies for Multi-Component Data Center Thermal Management: Part I, Analysis
,” Proceedings of the ASME InterPACK05
, San Francisco, CA.28.
Shah
, A.
, Carey
, V.
, Bash
, C.
, and Patel
, C.
, 2005, “Exergy-Based Optimization Strategies for Multi-Component Data Center Thermal Management: Part II, Application and Validation
,” Proceedings of the ASME InterPACK05
, San Francisco, CA.29.
Bhopte
, S.
, Agonafer
, D.
, Schmidt
, R.
, and Sammakia
, B.
, 2005, “Optimization of Data Center Room Layout to Minimize Rack Inlet Air Temperature
,” Proceedings of the ASME InterPACK
, San Francisco, CA.30.
Moore
, J.
, Chase
, J.
, Farkas
, K.
, and Ranganathan
, P.
, 2005, “Data Center Workload Monitoring, Analysis, and Emulation
,” Proceedings of the Eighth Workshop on Computer Architecture Evaluation Using Commercial Workloads
.31.
Sharma
, R. K.
, Bash
, C.
, Patel
, C. D.
, Friedrich
, R. J.
, and Chase
, J. S.
, 2003, “Balance of Power: Dynamic Thermal Management for Internet Data Centers
,” Whitepaper issued by Hewlett Packard Laboratories.32.
Boucher
, T. D.
, Auslander
, D. M.
, Bash
, C. E.
, Federspiel
, C. C.
, and Patel
, C. D.
, 2004, “Viability of Dynamic Cooling Control in a Data Center Environment
,” Proceedings of the International Society Conference on Thermal Phenomena
, pp. 593
–600
.33.
Moore
, J.
, Chase
, J.
, Ranganathan
, P.
, and Sharma
, R.
, 2005, “Making Scheduling Cool: Temperature-Aware Workload Placement in Data Centers
,” Proceedings of the USENIX Annual Technical Conference
, pp. 61
–75
.34.
Moore
, J.
, Chase
, J.
, and Ranganathan
, P.
, 2006, “Weatherman: Automated, Online, and Predictive Thermal Mapping and Management for Data Centers
,” Proceedings of the IEEE International Conference on Autonomic Computing (ICAC)
, pp. 155
–164
.35.
Tang
, Q.
, Gupta
, S.
, and Varsamopoulos
, G.
, 2008, “Energy-Efficient Thermal-Aware Task Scheduling for Homogeneous High-Performance Computing Data Centers: A Cyber-Physical Approach
,” IEEE Trans. Parallel Distrib. Syst.
1045-9219, 19
(11
), pp. 1458
–1472
.36.
Heath
, T.
, Centeno
, A. P.
, George
, P.
, Ramos
, L.
, Jaluria
, Y.
, and Bianchini
, R.
, 2006, “Mercury and Freon: Temperature Emulation and Management in Server Systems
,” Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS)
, pp. 106
–116
.37.
Raghavendra
, R.
, Ranganathan
, P.
, Talwar
, V.
, Wang
, Z.
, and Zhu
, X.
, 2008, “No “Power” Struggles: Coordinated Multi-Level Power Management for the Data Center
,” ACM SIGARCH Computer Architecture News
0163-5964, 36
(1
), pp. 48
–59
.38.
Nathuji
, R.
, Somani
, A.
, Schwan
, K.
, and Joshi
, Y.
, 2008, “CoolIT: Coordinating Facility and IT Management for Efficient Datacenters
,” Proceedings of the Hot Power ‘08; Workshop on Power Aware Computing and Systems
, San Diego, CA.39.
Somani
, A.
, and Joshi
, Y.
, 2008, “Ambient Intelligence Based Load Management
,” USPTO Provisional Patent GTRC ID No. 4524.40.
Kumar
, S.
, Talwar
, V.
, Ranganathan
, P.
, Nathuji
, R.
, and Schwan
, K.
, 2008, “M Channels and m-Brokers: Coordinated Management in Virtualized Systems
,” Proceedings of the Workshop on Managed Many-Core Systems, MMCS
.41.
Nathuji
, R.
, and Schwan
, K.
, 2007, “Virtual Power: Coordinated Power Management in Virtualized Enterprise Systems
,” Proceedings of the 21st ACM Symposium on Operating Systems Principles (SOSP)
, pp. 265
–278
.42.
Nathuji
, R.
, and Schwan
, K.
, 2008, “VPM Tokens: Virtual Machine-Aware Power Budgeting in Datacenters
,” Proceedings of the ACM/IEEE International Symposium on High Performance Distributed Computing (HPDC)
, pp. 119
–128
.43.
Samadiani
, E.
, and Joshi
, Y.
, 2010, “Multi-Parameter Model Reduction in Multi-Scale Convective Systems
,” Int. J. Heat Mass Transfer
0017-9310, 53
, pp. 2193
–2205
.44.
Samadiani
, E.
, Joshi
, Y.
, Allen
, J. K.
, and Mistree
, F.
, 2010, “Adaptable Robust Design of Multi-scale Convective Systems Applied to Energy Efficient Data Centers
,” Numer. Heat Transfer, Part A
1040-7782, 57
(2
), pp. 69
–100
.45.
ASHRAE
, 2004, Thermal Guidelines for Data Processing Environments
, American Society of Heating, Refrigeration, and Air-Conditioning Engineers
, Atlanta, GA
.46.
Samadiani
, E.
, 2009, “Energy Efficient Thermal Management of Data Centers via Open Multi-Scale Design
,” Ph.D. thesis, Georgia Institute of Technology, Atlanta, GA.47.
Crippen
, M. J.
, Alo
, R. K.
, Champion
, D.
, Clemo
, R. M.
, Grosser
, C. M.
, Gruendler
, N. J.
, Mansuria
, M. S.
, Matteson
, J. A.
, Miller
, M. S.
, and Trumbo
, B. A.
, 2005, “BladeCenter Packaging, Power, and Cooling
,” IBM J. Res. Dev.
0018-8646, 49
(6
), pp. 887
–904
.48.
Lewis
, R. M.
, and Torczon
, V.
, 2000, “Pattern Search Methods for Linearly Constrained Minimization
,” SIAM J. Optim.
1052-6234, 10
(3
), pp. 917
–941
.49.
Kumar
, S.
, Talwar
, V.
, Kumar
, V.
, Ranganathan
, P.
, and Schwan
, K.
, 2009, “vManage: Loosely Coupled Platform and Virtualization Management in Data Centers
,” Proceedings of the International Conference on Autonomic Computing (ICAC)
, pp. 127
–136
.Copyright © 2010
by American Society of Mechanical Engineers
You do not currently have access to this content.
