Azure infrastructure

Inside a Microsoft hyperscale datacenter

One building runs one job. Here is what changes when a datacenter is built to behave like a single computer, and what gets thrown out.

A two-storey hall of GPU racks. The town power line feeds its left wall. Coolant pipes run along the ceiling of each floor and out through the wall to a cooling plant, whose fans send the heat up. POWER GPU RACKS COOLANT COOLING HEAT OUT
Stacked top to bottom: the grid feed, the hall of GPU racks, and the cooling plant, joined by the coolant loop. POWER FROM THE GRID GPU RACKS COOLANT COOLING PLANT
140 kWdrawn by one rack
72Blackwell GPUs inside it
20 homesworth of water, filled once
0diesel generators on site

The shift

One job, not a million apps

A traditional cloud datacenter runs millions of separate applications for many customers. A Fairwater hall runs one complex job across every chip inside it.

The limit

Heat, not floor space, sets the size

Packing chips tightly is the point, and every watt leaves as heat. Air stopped being enough, so coolant now runs across the chips themselves.

Rack powerabout 140 kW
Row powerabout 1,360 kW
First fill of coolantwhat 20 homes use in a year
Coolant replacedonly if the chemistry says so, built for six-plus years

It is a closed loop, so nothing evaporates. The water bill is a one-time cost, not a monthly one.

Geometry

Two floors to shorten the cables

Light itself is now the bottleneck. Every GPU connects to every other GPU, so a longer cable means a slower cluster.

Power

It trusts the grid and skips the diesels

Atlanta was chosen for a resilient utility grid, and that choice removed equipment other halls cannot do without.

Network

One flat network across the hall

Each rack holds up to 72 Blackwell GPUs on NVLink: 1.8 TB a second between them, and 14 TB of pooled memory for each.

Scale

Several sites behaving as one machine

One site runs out of power and space before a frontier model runs out of parameters, so the network keeps reaching outward.

Wisconsinhall one
→
AI WANprivate optical fibre
→
Atlantahall two