A 40 MW data center needs a power infrastructure capable of delivering 40 megawatts of IT load, which translates to roughly 42-48 MW of total facility power after accounting for losses and cooling, and a cooling system designed to remove the equivalent heat—typically 40 MW of heat—using either air or liquid-based methods. This article explains the electrical and cooling components required, how they scale, and the key decisions involved in building such a facility.
Understanding the 40 MW Scale
A 40 MW data center is a large, hyperscale-class facility. To put it in perspective, a typical large enterprise data center might be 1-5 MW, while a hyperscale campus can be 100 MW or more. 40 MW can support roughly 400,000 to 800,000 servers, depending on the server density and power draw per rack (typically 5-20 kW per rack, with high-density racks reaching 50-100 kW). The total building area might be 400,000 to 600,000 square feet (37,000-56,000 m²), including office and support spaces.
The power and cooling infrastructure must be designed for high availability (Tier III or Tier IV), meaning redundant components and multiple independent distribution paths. This redundancy significantly increases the physical footprint and cost.
Power Infrastructure: From Grid to Server
The electrical path begins with the utility substation. A 40 MW IT load typically requires a high-voltage feed at 33 kV, 66 kV, or 110 kV, depending on local grid capacity. The substation transforms this to medium voltage (11-22 kV) for distribution inside the campus. From there, the power flows through:
- Medium-voltage switchgear that routes power to different buildings or pods.
- Transformers that step down to low voltage (400V-480V) for the IT equipment.
- Uninterruptible Power Supplies (UPS) that provide battery backup for the few seconds until generators start.
- Power Distribution Units (PDUs) that distribute power to server racks.
- Rack PDUs that provide the final connection to servers.
The total facility power draw is higher than 40 MW because of losses in the UPS, transformers, and cooling systems. At a typical power usage effectiveness (PUE) of 1.2-1.4, the total power from the grid would be 48-56 MW. PUE is the ratio of total facility energy to IT equipment energy. A well-designed modern facility can achieve PUE around 1.1-1.2 with efficient cooling and power distribution.
Cooling Infrastructure: Removing 40 MW of Heat
Almost all the electrical power consumed by IT equipment becomes heat. Therefore, the cooling system must remove approximately 40 MW of heat. The cooling approach depends on the climate, water availability, and server density. The main options are:
- Air cooling: Traditional computer room air conditioning (CRAC) or air handling units (AHU) push cold air through raised floors or hot/cold aisles. This is effective up to about 15-20 kW per rack.
- Liquid cooling: For higher densities (above 20-30 kW per rack), liquid cooling (direct-to-chip or immersion) is more efficient. It uses water or dielectric fluid to capture heat directly from the processors.
- Free cooling: In cool climates, outside air can be used directly (air-side economizer) or through a heat exchanger (water-side economizer) to reduce chiller energy.
A typical air-cooled system for 40 MW includes:
- Chillers (water-cooled or air-cooled) that produce chilled water at 7-12°C (45-55°F).
- Cooling towers or dry coolers to reject heat to the atmosphere.
- Pumps and piping to circulate chilled water.
- Air handling units with fans that blow air across coils.
- Humidification and dehumidification systems to maintain proper humidity levels.
For liquid cooling, you would add a coolant distribution unit (CDU) that connects the facility water loop to the server loop, and possibly a heat rejection loop to the outside.
Redundancy and Reliability
To achieve high availability, the infrastructure must be duplicated. Common configurations:
- N+1 redundancy: One extra unit beyond what is needed. For example, if you need 5 chillers to handle the load, you install 6.
- 2N redundancy: Two independent systems, each capable of handling the full load. If one fails, the other takes over.
- Distributed redundant: Multiple paths with no single point of failure.
For a 40 MW facility, this means having at least two utility feeds, multiple backup generators (diesel or natural gas) sized to run the entire facility, and battery UPS systems that can bridge the gap until generators are online (typically 10-30 seconds). Generators are often N+1 or 2N, meaning you might have 6-8 generators at 2.5 MW each.
Costs and Budget Considerations
The capital cost of building a 40 MW data center varies widely by location, but a rough estimate is $8-12 million per MW of IT load. So the total capital cost could be $320-480 million. This includes land, building, power and cooling equipment, and installation. Operating costs are dominated by electricity; at $0.10 per kWh, the annual electricity cost for 40 MW at PUE 1.3 would be about $45 million. Cooling can account for 30-40% of the facility’s electricity use, so efficient cooling is critical.
Common Problems and Misconceptions
One common misconception is that a 40 MW data center consumes 40 MW of power. In reality, the IT load is 40 MW, but the total facility draw is higher. Another issue is underestimating cooling needs for high-density racks. A rack with 50 kW of IT load requires about 170,000 BTU/hr of cooling, which is beyond the capability of standard air cooling. Liquid cooling is necessary for such densities.
Another problem is the assumption that free cooling works everywhere. In hot, humid climates, chillers must run most of the year, increasing PUE. Also, water availability is a major constraint for evaporative cooling towers; some regions have water restrictions.
How to Choose the Right Infrastructure
When planning a 40 MW data center, consider these factors:
- IT density: If you plan to use high-density racks (above 20 kW), plan for liquid cooling from the start.
- Climate: Cooler climates allow more free cooling, reducing energy costs.
- Water availability: If water is scarce, use air-cooled chillers or dry coolers instead of cooling towers.
- Redundancy level: Determine the required uptime (Tier III vs. Tier IV) and design accordingly.
- Future expansion: Design for modularity so you can add capacity without disrupting operations.
Frequently Asked Questions
What is the difference between IT load and total facility power?
IT load is the power consumed by servers, storage, and networking equipment. Total facility power includes that plus cooling, power distribution losses, and lighting. The ratio is PUE; a PUE of 1.2 means for every 1 MW of IT load, the facility draws 1.2 MW from the grid.
Can a 40 MW data center be air-cooled?
Yes, but only if the average rack density is low (below 15-20 kW). For higher densities, air cooling becomes inefficient and impractical. Many modern hyperscale data centers use a combination of air and liquid cooling to handle hotspots.
How many backup generators are needed for a 40 MW facility?
It depends on the generator size and redundancy level. For N+1 redundancy with 2.5 MW generators, you would need 17 generators (16 to supply 40 MW, plus 1 spare). For 2N, you would need 32 generators. However, generators are often sized larger to handle the entire facility load, including cooling, so the number may vary.
How much water does a 40 MW data center use?
A water-cooled facility with cooling towers can use 1-2 million gallons of water per day (3,800-7,600 m³/day) for evaporation and blowdown. This varies with climate and cooling efficiency. Some facilities use air-cooled systems to eliminate water consumption, but they consume more electricity.
What is the typical PUE for a modern 40 MW data center?
Modern hyperscale data centers achieve PUE between 1.1 and 1.3, depending on climate and cooling technology. The industry average is around 1.5, but best-in-class facilities are lower. A PUE of 1.1 means the cooling and power losses are only 10% of the IT load.
Related
Method: the standard formula for this calculation, rounded as each result states. See how the calculators work or report an error.
More cards in this drawer
- Philips DST7060/20 7000 Series Iron: Specs & Fit
- Coal Fueled Jet Aircraft: Could It Work?675 L
- Remote Desktop on Raspberry Pi: How to Enable It
- Word Select Last Line in Paragraph?
- Google Assistant IFTTT Recipes: 7 Useful Automations
- OLED TVs in Dark Rooms: Why They Look Better and When They Don’t