keepcalculator

06 Numbers and Powers

How Data Centers Use Electricity and Why AI Needs More

Card No. 06·24801 · Updated · Standard formula, shown below

Data centers turn electricity into computing, storage, and network services, while also using power to keep equipment cool and reliable. This guide explains where the electricity goes, why AI workloads can raise demand, and how to assess claims about a facility’s power use. You need no special tools; a basic understanding of kilowatts and kilowatt-hours is helpful.

What You’ll Need

  • A calculator, if you want to check simple energy examples.
  • For a specific facility estimate: its IT load, total facility power or power-usage-effectiveness (PUE), operating hours, and the period being measured.
  • For comparisons: matching units and a clear boundary, such as the servers alone or the whole facility.

Step-by-Step

  1. Separate power from energy. Power is the rate of electricity use, measured in watts or kilowatts (kW). Energy is power accumulated over time, measured in kilowatt-hours (kWh) or megawatt-hours (MWh). A 1 MW load running steadily for one hour consumes 1 MWh. A facility’s stated capacity is not necessarily its actual continuous consumption.
  2. Start with the IT equipment. Servers, accelerators such as GPUs, storage drives, and network switches perform the computing and communication. Their electricity becomes heat as they operate. Workload, hardware, utilization, and power settings all affect the IT load; the equipment does not necessarily draw its maximum rated power at all times.
  3. Add cooling and other supporting systems. Cooling removes heat using equipment such as fans, pumps, chillers, or cooling towers; the mix depends on climate and facility design. Electrical losses in power conversion and distribution, lighting, controls, and other building services also contribute. Thus, the whole data center generally draws more electricity than the IT equipment alone.
  4. Use PUE carefully to estimate total facility power. PUE means total facility energy divided by IT equipment energy over the same period. If IT equipment uses 10 MWh and PUE is 1.4, the facility uses 14 MWh in total for that period. The remaining 4 MWh is overhead under that accounting boundary. PUE is a ratio, not a percentage or a direct measure of computing efficiency.
  5. Check what a power figure describes. A number may refer to an individual server, a data hall, the IT load, a whole facility, a grid connection, or a planned campus. These are not interchangeable. A grid connection or announced capacity indicates how much power could be supplied, not necessarily how much is being consumed now.
  6. Identify the AI workload. AI training repeatedly processes large datasets to adjust a model’s parameters; this can keep many accelerators busy for long periods. Inference—the serving of a trained model in response to requests—can be continuous and grows with demand, but its energy per request varies. Model size, request volume, response length, hardware, and software all matter.
  7. Account for high-density computing. AI accelerators can draw substantial power, and servers may pack many of them into a rack. High rack power concentrates heat, so it can require more capable cooling and power delivery. The extra demand is not simply “the GPU’s wattage”: count the full system and facility overhead, using measurements or documented assumptions.
  8. Calculate energy for a stated period. If average total power is known, multiply it by operating time: energy (kWh) = average power (kW) × hours. For example, a steady 2 MW facility load over 24 hours is 2,000 kW × 24 = 48,000 kWh, or 48 MWh. If only IT power is known, apply a representative PUE for the same period to estimate total facility energy.
  9. Consider the electricity supply and timing. A facility’s annual energy use does not show when it draws power. Its hourly demand, location, grid connection, and supply mix matter for understanding grid effects and emissions. Renewable-energy contracts or certificates are not the same as proof that every hour’s electricity came from a renewable source at the facility’s location.
  10. Compare like with like. When judging whether AI uses “more,” compare the same service, time period, and system boundary. A training run, a single AI query, a whole AI data center, and all data centers worldwide are different comparisons. Ask whether figures are measured or modeled, and whether they include cooling and other facility loads.

Common Mistakes

  • Mixing kW and kWh: kW is a rate; kWh is energy over time. A 1 MW capacity figure alone cannot establish annual consumption.
  • Applying PUE twice: If a published figure already describes total facility power, do not multiply it by PUE again. Apply PUE only to an IT-only figure.
  • Treating peak capacity as typical use: A facility may have a large connection or maximum rating but operate below it. Use measured average load when available.
  • Assuming all AI workloads use the same amount: Training and inference differ, and workloads vary in model, utilization, hardware, and duration.
  • Comparing incompatible boundaries: Server-only energy should not be compared directly with another site’s total-facility energy.
  • Using a single PUE as a universal constant: PUE varies by facility design, weather, workload, and measurement period.

Tips

  • Write down the unit, time period, and boundary beside every number you use.
  • Prefer measured energy over nameplate ratings or announcements when estimating actual consumption.
  • For an annual estimate, use average power across the year and 8,760 hours, or use actual monthly or hourly energy data. Do not assume full rated load all year without evidence.
  • Report a range when utilization or PUE is uncertain, and label the assumptions rather than presenting an estimate as a measured fact.
  • For environmental comparisons, distinguish electricity consumption from emissions; emissions depend on the electricity supply and when and where it is generated.

Troubleshooting

Your estimate seems too high or too low: Check whether the input is in watts or kilowatts and whether the time is hours or days. Convert MW to kW by multiplying by 1,000, and multiply by the matching number of hours.

The total does not match a published figure: Look for differences in scope, date, and measurement method. One figure may cover IT equipment while another includes cooling and building systems; one may be peak capacity while another is average consumption.

You cannot find PUE: Do not invent one. Search for facility-level energy and IT energy for the same period, or present an IT-only estimate and state that overhead is not included. If a rough total is necessary, use a clearly labeled, justified range rather than a single unsupported value.

AI demand is hard to isolate: A shared data center may serve AI and non-AI workloads on the same equipment and cooling systems. Unless the operator publishes a separate measurement or a transparent allocation method, treat an AI-only figure as an estimate.

Frequently Asked Questions

Why do data centers use so much electricity?
They operate computing, storage, and networking equipment continuously, then use additional power to cool it and run supporting infrastructure. Large facilities contain many machines.

Why do AI data centers need more power?
AI often uses power-dense accelerators in large numbers. Training can keep them busy for extended periods, while popular inference services can create sustained demand. Cooling and power delivery add overhead.

Does one AI prompt use a fixed amount of electricity?
No. Energy varies with the model, hardware, prompt and response, batching, utilization, and how the service is measured. A single universal figure can be misleading.

Is PUE the same as efficiency?
It measures facility overhead relative to IT energy, not the useful computing achieved per unit of electricity. A low PUE does not by itself show that a model or service is energy-efficient.

Does a data center’s capacity show its actual electricity use?
No. Capacity describes a limit or supply provision. Actual use depends on operating load and time; energy data is needed to calculate consumption.

Can renewable power mean a facility has no emissions?
Not necessarily. Emissions depend on the electricity supply over time and on how renewable claims are accounted for. Annual matching does not automatically mean every hour is powered by local renewable generation.

Related

Method: the standard formula for this calculation, rounded as each result states. See how the calculators work or report an error.

More cards in this drawer

The whole Numbers and Powers drawer →