Thermal Autonomy

heat rejection · liquid cooling · buffering · water

AI racks went from about 10 kW to 130 kW in five years, and the next generation targets 600 kW. Energy makes power available; thermal decides whether it can be used.

Bar chart of power per rack: a typical enterprise rack draws about 5 to 10 kW; air cooling reaches its practical limit around 30 to 40 kW; Nvidia GB200 NVL72 draws about 120 to 132 kW; GB300 NVL72 about 140 kW; and Nvidia's Kyber rack for Rubin Ultra targets about 600 kW. A dashed line at 40 kW marks where liquid cooling becomes mandatory. POWER PER RACK, AND WHERE AIR COOLING STOPS Typical enterprise rack ~5-10 kW Air cooling practical limit ~30-40 kW Nvidia GB200 NVL72 ~120-132 kW Nvidia GB300 NVL72 ~140 kW Nvidia Kyber (Rubin Ultra) ~600 kW liquid cooling required to the right
GB200 NVL72
~132 kW/rack
Air limit
~30-40 kW/rack
Framework layer
Fourth
Hub
Autonomy

Finding

Heat removal, not power, is now the first limit on density in AI clusters, megawatt chargers and BESS, and it shows up as throttling instead of outages

A GB200 NVL72 rack draws about 132 kW, more than three times what air can remove, so every current AI cluster is liquid-cooled to the chip. The same wall appears in charging: Tesla V4 cabinets, the 3.75 MW Megawatt Charging System and BYD's 1,000 kW flash chargers all need liquid-cooled cables and power stages.

When thermal autonomy is weak, nothing trips. GPUs downclock, chargers roll back current, BESS containers cap charge and discharge rate, and fab tools drift out of spec. Installed power stays on the books but stops producing work, which is why ElectronsX treats thermal as the density gate that sits beside energy in the Six Foundation Domains. China's answer to the density limit is the opposite trade: Huawei's CloudMatrix 384 spreads 384 Ascend 910C chips across 16 racks, using more floor space and power to avoid extreme per-rack density.

Water is the second limit. Evaporative cooling towers consume millions of gallons a day at large campuses, so new builds such as Stargate Abilene in dry West Texas use closed-loop liquid cooling that is filled once and recirculated. Heat reuse is the upside: Nordic data centers already export waste heat to district heating networks.

Cooling layers

What thermal autonomy covers

Thermal autonomy domains
DomainWhat it includesNamed suppliers
Heat rejectionChillers, cooling towers, dry coolers, heat exchangers, ambient design marginVertiv, Trane, Johnson Controls, Daikin, Envicool
Coolant loopsDirect-to-chip cold plates, CDUs, immersion, pumps, leak detectionVertiv, Schneider (Motivair), CoolIT, Boyd, Envicool, Inspur
Thermal bufferingChilled-water storage, thermal mass, staged dispatchSite-engineered; thermal batteries for process heat
Water and consumablesWater intensity, treatment, reclaimed water, refrigerantsClosed-loop and dry cooling designs
Heat reuseHeat pumps, district heat, process heat recoveryStockholm Data Parks; industrial heat pump makers
ControlsSensors, telemetry, model predictive control, fallback modesBuilding and SCADA platforms; rack-level sensors

Where it binds

Where thermal limits bite

Thermal limits by system
SystemThermal limitNamed example
AI data centersFast, dense transients at 100+ kW per rackNvidia GB200 and GB300 NVL72, liquid-cooled to the chip
Fast charging and MCSSustained heat in cables, connectors and power stagesTesla V4 Supercharger, MCS up to 3.75 MW, BYD 1,000 kW flash charging
BESSCells held within a narrow temperature bandLiquid-cooled containers: Tesla Megapack, CATL TENER, Sungrow PowerTitan
EV packs and drivesCell, inverter and motor temperature during fast charge and towingHeat-pump thermal systems, octovalve-style integrated loops
Semiconductor fabsTight temperature control for yieldUltrapure water and process cooling at TSMC, Samsung, Intel fabs
GigafactoriesDry rooms, formation, coupled process and HVAC heatCATL, LGES, Tesla and Panasonic cell plants

Readiness

Thermal readiness bands

ElectronsX rating scale.

Thermal autonomy readiness bands
BandCharacteristicsSymptoms
TA-0 FragileCooling an afterthought; little redundancy or monitoringFrequent throttling and alarms
TA-1 AdequateMeets typical loads; little headroomSeasonal derating; hot-weather caps
TA-2 ScalableRedundancy, buffering, telemetry, predictable performanceRare throttling; clear expansion headroom
TA-3 AutonomousPredictive control, graceful degradation, heat reuse, expansion-readySelf-stabilizing; minimal manual intervention

Sources

Sources and scope

Scope
Thermal Autonomy
Sources
Nvidia; Uptime Institute; Huawei; Tesla; BYD; CharIN MCS; company disclosures; AustinIO
Updated
October 2026