Data Centre Cooling: Air vs Water vs Immersion

Data centre cooling falls into three main categories: air cooling, water (liquid) cooling, and immersion cooling. Air cooling uses fans and computer room air conditioners (CRACs) to move chilled air through the facility; water cooling uses chilled water loops that absorb heat via cooling coils or direct-to-chip cold plates; immersion cooling submerges servers in a dielectric fluid that absorbs heat directly. This article compares the three approaches on efficiency, cost, density, and practical deployment to help you understand which suits different workloads and facilities.

Background: Why Data Centre Cooling Matters

Modern server racks can draw 10–50 kW or more, and nearly all of that electrical energy converts to heat. Without effective cooling, component temperatures quickly exceed safe operating limits, causing throttling, crashes, and permanent hardware damage. Cooling accounts for roughly 20–40% of a data centre’s total energy use in traditional air-cooled facilities, so improving cooling efficiency directly reduces operating costs and carbon footprint.

How Air Cooling Works

Air cooling is the traditional approach. It uses one of two main configurations:

• Room-based cooling: CRAC or CRAH (computer room air handler) units blow cold air through a raised floor or overhead ducts. The air enters the front of racks, passes through servers, and exits hot at the rear.
• Row/rack-based cooling: Units are placed between or on top of racks, capturing hot exhaust air directly and returning it cooled. This is more efficient because air travels shorter distances.

Air cooling is simple, well understood, and works for most legacy and low-density deployments. However, air has low heat capacity (about 1 kJ/kg·K) and requires significant airflow for high heat loads. As rack densities exceed 15–20 kW, air cooling becomes impractical because the sheer volume of air needed creates turbulence, hot spots, and high fan energy.

How Water (Liquid) Cooling Works

Water cooling uses water’s high heat capacity (about 4.18 kJ/kg·K) to move heat far more efficiently than air. There are two common forms:

• Chilled water systems: A central chiller produces cold water (typically 7–15°C) that circulates to cooling coils in air handlers. The coils cool the air that then cools the servers. This is essentially an air-cooling system with a water-based heat rejection loop.
• Direct-to-chip (DTC) cooling: Coolant flows through cold plates mounted directly on CPUs, GPUs, or memory. A facility loop carries the heated coolant to a dry cooler or heat exchanger. This removes 60–80% of server heat without needing to cool the entire room.

Direct-to-chip cooling is increasingly popular for high-performance computing (HPC) and AI clusters because it can handle 30–100+ kW per rack. It requires retrofitting servers with cold plates and plumbing, and it still relies on air cooling for the remaining components (power supplies, drives, networking).

How Immersion Cooling Works

Immersion cooling submerges entire servers (or just their motherboards) in a bath of dielectric fluid—a non-conductive liquid such as mineral oil or a synthetic fluorocarbon. The fluid boils or flows over the components, absorbing heat directly. There are two main types:

• Single-phase: The fluid remains liquid; it is pumped through the tank, heated by the servers, then cooled in a heat exchanger and recirculated.
• Two-phase: The fluid boils at a low temperature (e.g., 50°C), and the vapour rises to a condenser coil at the top of the tank, where it condenses back to liquid and drips down. This phase change transfers heat very efficiently.

Immersion cooling eliminates the need for air movers (fans) inside servers and can handle 100+ kW per rack with ease. It also enables extremely dense configurations—up to 2–3 times the compute per square metre compared to air. However, the fluid is expensive, the tanks are heavy, and service/maintenance requires lifting servers out of the liquid, which can be messy and time-consuming.

Comparing Efficiency, Cost, and Density

The table below summarises key differences for typical deployments (values are approximate and vary with hardware and climate):

• Power Usage Effectiveness (PUE): Air: 1.3–1.6; Water (DTC): 1.1–1.2; Immersion: 1.02–1.1. Lower is better.
• Rack density supported: Air: up to ~20 kW; Water (DTC): 30–100 kW; Immersion: 100+ kW.
• Capital cost (per rack): Air: lowest; Water: moderate (plumbing, cold plates); Immersion: highest (tanks, fluid, pumps).
• Operating cost: Air: highest due to fans and chillers; Water: lower; Immersion: lowest energy use, but fluid replacement/maintenance adds cost.
• Space efficiency: Air: poor (requires aisles and airflow); Water: good; Immersion: excellent (servers can be packed tightly).
• Retrofit difficulty: Air: none (existing); Water: requires server modification; Immersion: requires new tanks and server enclosures.

How to Choose Between Air, Water, and Immersion

The right choice depends on your specific situation. Consider these factors:

1. Rack density: If you plan to exceed 20 kW per rack, air cooling is not viable—look at water or immersion.
2. Existing facility: Retrofitting water or immersion into an existing air-cooled data centre is costly. New builds can more easily adopt liquid cooling.
3. Workload type: High-performance computing, AI training, and dense virtualisation benefit most from liquid cooling. Low-density web hosting may not justify the extra cost.
4. Climate: In cool climates, air-side economisers (using outside air) can make air cooling very efficient. In hot climates, water or immersion reduces chiller load.
5. Maintenance capability: Immersion cooling requires specialised skills for server handling and fluid management. If your team lacks this, water cooling may be a simpler step.
6. Total cost of ownership: Calculate not just the cooling system cost, but also the energy savings, space savings, and potential for higher compute density over the facility’s lifetime.

Common Problems and Misconceptions

One common misconception is that water cooling is risky because water and electronics don’t mix. In practice, direct-to-chip systems use sealed loops and conductive coolants (or deionised water) that are safe when properly maintained. Immersion cooling uses dielectric fluids that are non-conductive, so the risk of short circuits is minimal.

Another issue is that immersion cooling makes hardware maintenance harder. You cannot simply open a server and swap a component—you must drain the fluid, remove the server, dry it, and then work on it. This increases service time and requires careful planning for hot-swap operations.

Also, not all servers are rated for immersion. Hard drives and power supplies may not be designed to operate submerged, so you may need to use specialised immersion-ready hardware, which can be more expensive and less available.

Safety and Environmental Considerations

All three cooling methods have safety and environmental aspects:

• Air: No special hazards beyond standard electrical safety. Refrigerants in CRAC units can have high global warming potential (GWP) if leaked.
• Water: Risk of leaks damaging equipment. Use leak detection, proper sealing, and corrosion inhibitors. Water is non-toxic and environmentally benign.
• Immersion: Dielectric fluids can be expensive, and some have high GWP if they are fluorinated compounds. Mineral oil is biodegradable but has a high flash point; it must be handled to avoid spills. Two-phase fluids may evaporate and need containment.

Always follow manufacturer guidelines for fluid compatibility, fire suppression, and worker safety. Immersion tanks should be placed on reinforced floors due to the weight of the fluid.

Frequently Asked Questions

Is immersion cooling always better than air cooling?

Not always. Immersion cooling offers the best efficiency and density, but it has higher upfront costs and operational complexity. For small or low-density facilities, air cooling is simpler and cheaper. Immersion is justified when you need extreme compute density or want to minimise energy use in a large-scale deployment.

Can I retrofit my existing data centre for water or immersion cooling?

Yes, but it’s challenging. Direct-to-chip water cooling can be retrofitted to existing servers if they have compatible cold plates, but you’ll need to install plumbing and possibly upgrade power distribution. Immersion cooling requires replacing standard racks with tanks, which may be impractical in an existing raised-floor environment. A phased approach is common, starting with a few high-density racks.

What is the typical PUE for each cooling method?

Air-cooled data centres typically achieve PUE of 1.3–1.6, depending on climate and design. Direct-to-chip water cooling can reach 1.1–1.2. Immersion cooling can achieve PUE as low as 1.02–1.1, especially with two-phase systems and free cooling. Remember that PUE also depends on other factors like UPS efficiency and lighting.

Does immersion cooling void server warranties?

It can. Most server manufacturers only warrant hardware for use in air-cooled environments unless they specifically offer immersion-ready models. Check with your vendor before submerging equipment. Some manufacturers now sell servers designed for immersion with proper sealing and fluid-compatible components.

How much water does a water-cooled data centre use?

Water consumption depends on the cooling tower or evaporative system. A typical water-cooled data centre can use millions of litres per year for evaporation. Direct-to-chip systems that use a closed loop with a dry cooler consume very little water—only for occasional makeup. Immersion cooling uses no water for heat transfer, but may use water in the facility’s heat rejection loop.

Is liquid cooling safe for electronics?

Yes, when done correctly. Direct-to-chip systems use sealed cold plates that never contact the electronics directly. Immersion systems use dielectric fluids that do not conduct electricity. The main risks are leaks (for water) and fluid contamination (for immersion), both of which can be managed with proper design and maintenance.

Related

• Microsoft Copilot Agents: What They Actually Do
• Convert Live Photo Popular Formats Explained
• Steal an Egg Eternal Oni Tiger Bloom Mutation?