Data center design: Electrical and power systems

In the information age, data centers are one of the most critical components of a facility. If the data center isn’t reliable, business can’t be done. This is a review of the key electrical and power issues in data centers.


Kevin V. Dickens, PE, LEED BD+C, Mission critical design principal, Jacobs Engineering, St. Louis. Courtesy: Jacobs Engineering Terrence J. Gillick, President, Primary Integration Solutions Inc., Charlotte, N.C. Courtesy: Primary Integration SolutionsBill Kosik, PE, CEM, BEMP, LEED AP BD+C , Principal data center energy technologist, HP Technology Services, Chicago. Courtesy: HP Technology ServicesKeith Lane, PE, RCDD, NTS, RTPM, LC, LEED AP BD+C, President/CEO, Lane Coburn & Associates LLC, Bothell, Wash. Courtesy: Lane Coburn & AssociatesDavid E. Wesemann, PE, LEED AP, ATD, President, Spectrum Engineers Inc., Salt Lake City. Courtesy: Spectrum Engineers Inc.


CSE: What standby or backup power solutions have you specified recently in a data center or mission critical facility? Why was it successful?

Lane: The standard backup solutions include standby generators and UPS systems. IT is critical to ensure that the standby generators are not overloaded under all failure conditions. Additionally, the generator must perform properly under all failure modes harmonic distortions. The engineer must specify a generator with the appropriate level of subtransient reactance. Also, it is a good idea to specify a generator that is “mission critical” rated for a load factor of 85%.

Wesemann: Time-tested, tried, and proven systems: standby diesel generators with closed-transition bypass isolation switches and static double-conversion on-line UPS with batteries. Paralleling gear is necessary when capacity or redundancy requires it, but I avoid generator paralleling gear unless necessary for capacity. It has become a single point of failure on some projects.

Gillick: In large mission critical facilities, a current trend among engineers is to specify medium-voltage generators because it is possible to obtain utility service at 15,000 V or higher—a significant benefit over the conventional 480- or 600-V systems. This has required larger but fewer feeders—therefore, less copper—with an associated cost savings. This is a successful, robust power strategy, but we have had to manage the increased risk of arc flash events and other medium-voltage safety practices and equipment to satisfy medium-voltage electrical commissioning and testing—often at full load.

CSE: What types of electrical/power flexibility are current data center clients requesting?

Gillick: We are seeing many different electrical/power flexibility requirements depending on the type of data center. In a typical Tier III or Tier IV data center, we are being asked to commission typical load densities between 75 and 250 W/sq ft. However, owners are being asked to provide power at an even higher density for some equipment rack installations, and these can range from a density of 6 kW per rack to as high as 35 kW per rack. Anticipating electrical and mechanical distribution requirements, owners are requesting design of electrical distribution systems with enough flexibility to deliver various load densities out to the raised floor.

Lane: Flexibility and modularity are the key features clients require: Flexibility to modify the design for future phases and to ensure the infrastructure is in place to provide for changes. Modularity to ensure incremental components can be added as density and/or redundancy increases are required.

Wesemann: They are requesting the ability to make changes and additions quickly and easily, some of which can be avoided by standardizing on a typical size/capacity of rack circuits and power distribution plug strips; the ability to start with minimal capacity requirement then grow modularly and easily without taking the system down, and an A and B bus system feeding dual power cord loads is very common today.

CSE: What experience have you had with The Green Grid report “Recommendations for Measuring and Reporting Overall Data Center Efficiency: Version 2 – Measuring Power Usage Effectiveness (PUE) at Data Centers”?

Kosik: I use this quite often when modeling energy use. Even though it was written around measuring power/energy in existing facilities, it can be used as guidance in the development of energy use and PUE of a not-yet-constructed data center.

Gillick: We have commissioned a 100,000-sq-ft data center design based on The Green Grid guidelines, and we have used these for measuring and reporting data center efficiency. One of the challenges this industry faces today is agreeing on the elements that constitute PUE—not all owners “do the math” in the same way—so we welcome these recommendations if they move the industry toward greater consensus and standardization.

Wesemann: It is the most common unit of measuring data centers in design discussions today. Most engineers and data center owners/users are familiar with the term, and PUE is one of the criteria that is targeted in the initial planning and design of a data center. It seems as though there is an unofficial competition out there to achieve the lowest PUE.

CSE: How have sustainability and PUE requirements affected how you approach electrical/power systems in data centers?

Gillick: As owners seek greater energy efficiency and lower PUE in their data centers and the new systems become increasingly efficient, we have observed that they are beginning to review and, in some cases, shorten their end-of-life projections for their existing electrical power and UPS systems We have also noted increasing deployment of air- and water-side economizers on mechanical systems, which has increased efficiency and lowered PUE. From a design review perspective, we try to ensure that the owner is weighing both the benefits and costs associated with trying to achieve greater energy efficiency and lower operating costs.

Lane: The use of more efficient UPS systems, modular implementation, transformerless UPS systems, more efficient transformers, more efficient lighting and lighting controls, warmer cold isle temperature, and hot isle containment. Building with modular components also ensures that electrical components are loaded at levels that run more efficiently. For example, some 2N data centers that are lightly loaded could have loading percentages during normal operation that are less than 20%. UPS systems and transformers can run far less efficiently when loaded to 20% or less.

Kosik: There is a much stronger focus on leveraging reliability through the use of modular electrical system design to make systems much more efficient, especially at low loads. 

Wesemann: This has become a major consideration that enters into the selection of most equipment, in particular the UPS systems and transformers. We are also seeing more metering being requested to track the actual energy usage to verify that it meets design expectations, and also tout the sustainability of a data center as it has become a marketing point for many data centers. Some clients are careful not to let energy efficiency override reliability. For example, the “offline” UPS systems that are offered to save energy are rarely implemented because data center operators don’t want the risk of the transfer to the inverter/rectifier when power fails. However, owners who have accepted this risk reap significant cost savings in reduced energy bills.

No comments
The Top Plant program honors outstanding manufacturing facilities in North America. View the 2013 Top Plant.
The Product of the Year program recognizes products newly released in the manufacturing industries.
The Engineering Leaders Under 40 program identifies and gives recognition to young engineers who...
The true cost of lubrication: Three keys to consider when evaluating oils; Plant Engineering Lubrication Guide; 11 ways to protect bearing assets; Is lubrication part of your KPIs?
Contract maintenance: 5 ways to keep things humming while keeping an eye on costs; Pneumatic systems; Energy monitoring; The sixth 'S' is safety
Transport your data: Supply chain information critical to operational excellence; High-voltage faults; Portable cooling; Safety automation isn't automatic
Case Study Database

Case Study Database

Get more exposure for your case study by uploading it to the Plant Engineering case study database, where end-users can identify relevant solutions and explore what the experts are doing to effectively implement a variety of technology and productivity related projects.

These case studies provide examples of how knowledgeable solution providers have used technology, processes and people to create effective and successful implementations in real-world situations. Case studies can be completed by filling out a simple online form where you can outline the project title, abstract, and full story in 1500 words or less; upload photos, videos and a logo.

Click here to visit the Case Study Database and upload your case study.

Maintaining low data center PUE; Using eco mode in UPS systems; Commissioning electrical and power systems; Exploring dc power distribution alternatives
Synchronizing industrial Ethernet networks; Selecting protocol conversion gateways; Integrating HMIs with PLCs and PACs
Why manufacturers need to see energy in a different light: Current approaches to energy management yield quick savings, but leave plant managers searching for ways of improving on those early gains.

Annual Salary Survey

Participate in the 2013 Salary Survey

In a year when manufacturing continued to lead the economic rebound, it makes sense that plant manager bonuses rebounded. Plant Engineering’s annual Salary Survey shows both wages and bonuses rose in 2012 after a retreat the year before.

Average salary across all job titles for plant floor management rose 3.5% to $95,446, and bonus compensation jumped to $15,162, a 4.2% increase from the 2010 level and double the 2011 total, which showed a sharp drop in bonus.

2012 Salary Survey Analysis

2012 Salary Survey Results

Maintenance and reliability tips and best practices from the maintenance and reliability coaches at Allied Reliability Group.
The One Voice for Manufacturing blog reports on federal public policy issues impacting the manufacturing sector. One Voice is a joint effort by the National Tooling and Machining...
The Society for Maintenance and Reliability Professionals an organization devoted...
Join this ongoing discussion of machine guarding topics, including solutions assessments, regulatory compliance, gap analysis...
IMS Research, recently acquired by IHS Inc., is a leading independent supplier of market research and consultancy to the global electronics industry.
Maintenance is not optional in manufacturing. It’s a profit center, driving productivity and uptime while reducing overall repair costs.
The Lachance on CMMS blog is about current maintenance topics. Blogger Paul Lachance is president and chief technology officer for Smartware Group.