Best Data Center Power Architecture for AI Racks

The best data center power distribution architecture for high-density AI racks is a 415V/480V AC distribution with a per-rack busway feeding an in-rack 48V DC bus, typically using an AC-to-DC conversion at the rack level. This approach minimizes distribution losses, supports 100kW+ per rack, and aligns with the power delivery needs of modern GPU servers. Below, we break down why this architecture wins, how it works, and what to consider when designing or retrofitting a data center for AI workloads.

Background: Why AI Racks Break Traditional Power Design

AI training and inference servers—especially those using high-end GPUs—consume far more power than standard compute racks. A typical 1U server might draw 1–2kW, but a single AI rack with 8 GPUs can easily pull 30–50kW, and next-generation systems are pushing toward 100kW or more per rack. This density changes everything about power distribution:

• Voltage drop: At lower voltages (208V), high current causes significant losses in cables and busways.
• Physical space: Thicker copper conductors and larger breakers consume valuable floor and overhead space.
• Cooling interaction: High power density generates heat that must be removed, often requiring liquid cooling, which adds its own infrastructure.

Traditional data centers designed for 5–10kW per rack simply cannot support AI workloads without major upgrades. The architecture must evolve to deliver more power efficiently and reliably.

How the Winning Architecture Works

The recommended architecture has three key stages:

1. Medium voltage (MV) to low voltage (LV) transformation: Utility power (typically 12.5kV or 13.8kV) is stepped down to 480V (or 415V in some regions) via large transformers. This is standard practice.
2. Busway distribution: Instead of traditional cable trays with individual branch circuits, a high-ampacity busway (e.g., 400A, 600A, or 800A) runs above the row of racks. Each rack taps into the busway via a plug-in unit with a breaker. This allows flexible power allocation and easy reconfiguration.
3. In-rack AC-to-DC conversion (48V DC bus): At the rack level, a high-efficiency rectifier converts 480V AC to 48V DC. This DC bus feeds the GPU servers directly, eliminating multiple conversion steps that waste energy. Many AI server vendors now offer 48V DC input options, and the Open Compute Project (OCP) has championed this approach.

Why 48V DC? It is high enough to reduce current (and thus copper losses) compared to 12V DC, but low enough to be safe and compatible with existing server components. The conversion from 480V AC to 48V DC happens once, at high efficiency (typically 97–98%), rather than multiple times (e.g., 480V AC to 208V AC to 12V DC to 1V core voltage).

Comparing Architectures: 208V vs. 480V vs. 48V DC

Let’s compare the main options:

• Traditional 208V AC (single-phase or three-phase): This is common in older data centers. For a 50kW rack, 208V three-phase would require about 139A per phase (assuming 0.9 power factor). That means heavy cables, large breakers, and significant voltage drop over even short distances. Not practical for high density.
• 480V AC three-phase: This is the standard for modern data centers. For the same 50kW, current drops to about 60A per phase. This allows smaller conductors and lower losses. Distribution losses are roughly 4x lower than 208V for the same power.
• In-rack 48V DC: This is not a distribution architecture per se, but a server input standard. By moving AC-DC conversion into the rack, you avoid multiple conversions and can use high-efficiency rectifiers. Combined with 480V AC busway, it is the best of both worlds.

Some hyperscalers are experimenting with 400V DC distribution (directly powering servers with DC), but this is not yet mainstream due to safety and equipment availability. For most operators, 480V AC busway + 48V DC rack bus is the sweet spot.

How to Choose the Right Architecture for Your Facility

When deciding, consider these factors:

• Rack power target: If you plan to support 50kW+ per rack, 480V AC is essentially mandatory. Below 20kW, 208V may suffice, but you should still plan for future upgrades.
• Existing infrastructure: Retrofitting an existing data center is more complex than building new. You may be limited by transformer capacity, busway ampacity, and floor space.
• Server input voltage: Check what your AI servers accept. Many high-end GPUs now support 48V DC input, but some still require 208V AC. If your servers are AC-only, you may need a rack-level transformer (480V to 208V) instead of a rectifier.
• Cooling strategy: High-density racks often require liquid cooling. This affects power distribution because cooling pumps and controls need power, and the heat load must be managed. Ensure your power architecture can support both the IT load and cooling infrastructure.
• Redundancy requirements: For AI training, downtime is costly. Consider dual busway feeds (A and B) to each rack, with automatic transfer switches. This adds cost but improves availability.

Common Problems and Misconceptions

Several issues trip up engineers new to high-density AI power:

• Misconception: “480V is dangerous.â€� It is true that 480V requires more careful handling than 208V, but it is standard in industrial settings. Proper training, clear labeling, and arc-flash mitigation make it safe.
• Problem: Voltage drop in busway. Even with 480V, long busway runs can cause voltage drop. Keep busway runs short and size them appropriately. Use copper busway for high ampacity.
• Problem: Harmonic distortion. High-density switch-mode power supplies can inject harmonics into the power system. Use active harmonic filters or specify servers with high power factor correction (PFC).
• Misconception: “Just add more power to the rack.â€� The rack itself has physical limits—power connectors, busbars, and cooling. You cannot simply increase power without upgrading the rack’s power distribution unit (PDU) and cooling.
• Problem: Inrush current. When a rack of GPUs powers on, it can draw a large inrush current. Size breakers and busway to handle this, and consider staggered power-on sequences.

Cost and Efficiency Considerations

Upgrading to 480V AC distribution has upfront costs: new busway, transformers, and possibly new PDUs. However, the efficiency gains can be significant. Distribution losses at 480V are roughly one-fourth of those at 208V for the same power. Over a 10-year lifespan, these savings can offset the capital cost. Additionally, in-rack 48V DC conversion reduces losses further by eliminating multiple conversion stages. A typical 208V AC system might have 85–90% end-to-end efficiency, while a 480V AC + 48V DC system can achieve 95–97%. For a 1MW data center, that difference translates to 50–100kW of saved energy, which also reduces cooling load.

Safety and Standards

Working with 480V AC and 48V DC requires adherence to electrical safety standards. Key points:

• Follow local electrical codes (e.g., NEC in the US) for clearance, grounding, and overcurrent protection.
• Use arc-flash hazard analysis and appropriate personal protective equipment (PPE) when working on live equipment.
• 48V DC is considered “extra-low voltageâ€� in many jurisdictions, but it can still cause arcing and burns. Treat it with respect.
• Ensure proper grounding and bonding of all metallic components to prevent shock and fire.

Alternatives and Future Trends

While 480V AC + 48V DC is the current best practice, other approaches are emerging:

• 400V DC distribution: Some operators are testing direct DC distribution to racks, eliminating the AC-to-DC conversion at the rack. This can be more efficient, but equipment availability and safety standards are still evolving.
• High-voltage DC (HVDC) at the facility level: Using 380V DC or higher to distribute power throughout the data center, with conversion only at the server level. This is promising but not yet mainstream.
• On-site generation: Some facilities are adding solar, fuel cells, or battery storage to supplement grid power. This does not change the distribution architecture but can reduce costs and improve resilience.

Frequently Asked Questions

What is the maximum power per rack supported by 480V AC busway?

A single 480V three-phase busway can support up to 100kW or more per rack, depending on the ampacity of the busway (e.g., 800A at 480V three-phase is about 665kW total, but per-rack plug-in units are typically rated 60–100kW). For higher densities, you can use multiple busways or higher voltages.

Can I retrofit an existing 208V data center for AI racks?

Yes, but it is costly. You would need to add 480V transformers and busway, or use step-up transformers at the rack level (which adds losses). In many cases, it is more economical to build a new high-density zone or facility.

What is the difference between a PDU and a busway?

A PDU (Power Distribution Unit) is a cabinet that takes power from a busway or cable and distributes it to multiple outlets. A busway is a overhead or underfloor system of busbars that provides a high-ampacity feed. In high-density designs, you often use busway to bring power to the row, then a rack PDU (or in-rack rectifier) to distribute to individual servers.

Why is 48V DC preferred over 12V DC for AI servers?

48V DC reduces current by a factor of four compared to 12V DC for the same power, which means lower I²R losses in the server power distribution and thinner cables. It also allows more efficient power conversion in the server’s voltage regulators.

How does liquid cooling affect power distribution?

Liquid cooling removes heat more efficiently than air, allowing higher power densities. However, the cooling system itself requires power for pumps and controls, and the power distribution must also support these loads. Additionally, liquid cooling may allow you to pack more GPUs per rack, increasing the power demand per rack, which your electrical system must handle.

Is it better to use AC or DC distribution for AI data centers?

For most facilities, AC distribution (480V) with in-rack DC conversion is the best balance of cost, safety, and efficiency. Pure DC distribution is more efficient but has higher upfront costs and limited equipment availability. As DC equipment matures, it may become more common, but for now, AC is the practical choice.

Related

• Dual Input Adapter: Definition and How It Works
• Convert Images to Cartoon: How It Works
• Enshrouded: Upgrade Storage Chests in Place