Quick answer: AI workloads pack 40–130 kW into a single rack — many times what traditional servers drew — and air simply can’t carry that much heat away. Liquid cooling moves heat far more efficiently, so it has shifted from a niche option to a baseline requirement for any data center running AI.
For most of the data center era, air did the job. Fans, raised floors, and carefully managed hot and cold aisles kept servers within safe operating temperatures, and for decades that was enough. Artificial intelligence has changed the math. The GPU clusters that train and serve modern AI models pack far more power — and therefore far more heat — into a single rack than anything air cooling was ever designed to handle. The result is a quiet but decisive shift across the industry: the liquid cooling data center is moving from an exotic, niche option to a baseline requirement for any facility serious about AI.
This article explains why that shift is happening, what is driving it, and what it means for anyone planning data center capacity today.
The rack density problem
Heat in a data center scales directly with power. A traditional enterprise rack drew somewhere between 5 and 15 kilowatts (kW) — a load that conventional air handling could manage comfortably. AI has rewritten those numbers. A single rack of modern AI accelerators commonly draws 40 to 100 kW, and the densest next-generation GPU configurations now push past 120–130 kW.
That is not an incremental change. It is close to an order-of-magnitude jump in the amount of heat that must be removed from the same physical footprint. The servers haven’t grown; the power flowing through them has. And every watt that goes in as electricity comes back out as heat that has to go somewhere. Once a rack crosses roughly 50 kW, air cooling stops being merely inefficient and starts being impractical. This is the single biggest reason high density rack cooling has become one of the defining engineering challenges of the AI era.
Why air cooling hits a wall
The honest answer is physics. Air is simply a poor medium for moving heat. Pound for pound, water can carry far more thermal energy than air — by some measures a few thousand times more per unit of volume. To remove more heat using air, you have to move more of it, faster, which means larger fans, more fan energy, more noise, and rapidly diminishing returns.
At very high densities, air also struggles to reach the hottest components at all. Tightly packed GPUs create concentrated hot spots that airflow can’t fully clear, leading to thermal throttling — where chips deliberately slow down to protect themselves — and shortened hardware life. You can engineer around this for a while with containment and higher fan speeds, but eventually the curve becomes brutal: you spend more and more energy on cooling for less and less benefit. That tipping point is exactly where the air vs liquid cooling decision stops being optional.
What “going liquid” actually means
Liquid cooling isn’t a single technology — it’s a family of approaches that share one principle: a liquid absorbs heat at or very near the chip and carries it away far more efficiently than air ever could. The three main methods are:
- Direct-to-chip (cold plate): coolant flows through metal plates mounted directly onto CPUs and GPUs. This is the most widely adopted path today and integrates well into existing rack designs.
- Immersion cooling: entire servers are submerged in a non-conductive dielectric fluid that absorbs heat across every component at once.
- Rear-door heat exchangers: a liquid-cooled radiator on the back of the rack captures heat as exhaust air passes through it, often as a stepping stone toward fuller liquid adoption.
Each carries its own trade-offs in density, cost, retrofit-friendliness, and operational complexity — which is why choosing between them deserves its own discussion. We cover that in detail in our comparison of direct-to-chip, immersion, and rear-door cooling. For now, the key point is simply that all three break through the ceiling air cooling cannot.
It’s about more than temperature
It would be a mistake to read this as only a heat problem. The case for why data centers need liquid cooling is also operational and financial:
- Energy and efficiency: liquid cooling can dramatically reduce the energy spent on cooling itself, improving PUE (power usage effectiveness) and lowering the total cost of running a facility.
- Density and space: removing heat efficiently lets operators pack more compute into each square metre, meaning more capacity from fewer or smaller buildings.
- Sustainability: better efficiency translates into lower energy and, with the right design, lower water use — increasingly important as regulators in water-stressed regions tighten requirements and customers demand greener infrastructure.
- Reliability and performance: tighter, more consistent thermal control means less throttling, more stable performance, and longer equipment life.
In other words, liquid cooling doesn’t just keep AI hardware alive — it makes the whole facility cheaper, denser, and more sustainable to run.
Liquid is becoming the default, not the exception
A few years ago, liquid cooling was something only the most advanced supercomputing sites bothered with. That era is over. Industry forecasts now point to a sharp acceleration in adoption, with a large and growing share of new AI-ready capacity being designed liquid-first from day one. Major operators and hyperscalers are standardising on it, and equipment vendors are building liquid support into their flagship platforms rather than treating it as an add-on.
The question facing operators is no longer whether to adopt liquid cooling, but which method to use and when to deploy it.
Planning for an AI-ready future
If you are scoping a new build or assessing whether an existing facility can support AI workloads, cooling should be one of your first design decisions — not an afterthought bolted on once the racks are chosen. Getting it right early shapes everything downstream: power design, floor layout, density targets, and total cost of ownership.
To go deeper, explore EPG’s Cooling Solution for a systematic, liquid-first approach to AI heat, compare the main methods in our guide to direct-to-chip, immersion, and rear-door cooling, or step back and read about what makes an AI data center fundamentally different from a traditional facility. If you are evaluating a full build, see how liquid cooling fits into EPG’s complete AI Data Center solution.