Nvidia's CEO reckons that millions of AI GPUs will reduce power consumption, not increase it

HardwareNvidia’s CEO reckons that millions of AI GPUs will reduce power consumption, not increase itWhen you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.

When you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.

(Image credit: Nvidia)

Jensen Huang

The benefits of AI can be debated. But one thing we’re all sure about is that massive server farms packed full of hundreds or thousands of high-end AI GPUs, each consuming hundreds of watts, soak up a lot of power. Right?

Not Jensen Huang, the CEO of Nvidia whose catchphrase has become"the more you buy, the more you save", in reference to his company’s stratospherically expensive AI chips. Perhaps inevitably, Huang has a similar take when it comes to the power consumption associated with the latest AI models, which mostly run on Nvidia hardware.

Speaking in a Q&A followinghis Computex keynote, Huang’s point is firstly that Nvidia’s GPUs do computations much faster and more efficiently than any alternative. As he puts it, you want to “accelerate everything”. That saves you money, but it also saves you time and power.

Next, he distinguished between training AI models and inferencing them and how the latter can offer dramatically more efficient ways of getting certain computational tasks done.

“Generative AI is not about training,” he says, “it’s about inference. The goal is not the training, the goal is to inference. When you inference, the amount of energy used versus the alternative way of doing computing is much much lower. For example, I showed you the climate simulation in Taiwan— 3,000 times less power. Not 30% less, 3,000 times less. This happens in one application after another application.”

Huang also pointed out that AI training can be done anywhere, it’s doesn’t need to be geographically proximate. To put it his way, “AI doesn’t care where it goes to school.”

“The world doesn’t have enough power near population. But the world has a lot of excess energy. Just the amount of energy coming from the sun is incredible. But it’s in the wrong place. We should set up power plants and data centres for training where we don’t have population, train the model somewhere else. Move the model for inference everyone’s closer to the people—in their pocket on phones, PCs, data centres and cloud data centres,” Huang says.

The biggest gaming news, reviews and hardware deals

An Nvidia power-saving device, yesterday.(Image credit: Nvidia)

Nvidia Blackwell

Whether you’re using AI to create code, write a business plan, or create content, it’s hard to pick apart the impact it has on the production process. Maybe using AI meant you edited those photos much more quickly and efficiently. Or maybe it just added an extra layer of polish to a video production at the end.

Or maybe you’re just doing something with AI that would have been totally impossible without it, and every joule of energy you use is a net gain in the AI energy usage ledger. Equally, maybe AI lets you do things faster and therefore do more things. Each task is more efficient, but you move on to the next thing much more quickly and use much more energy as a consequence.

Computex 2024

(Image credit: Jacob Ridley)

The Taipei 101 building and Taipei skyline in Taiwan.

Just like his favourite “the more you buy, the more you save” quip there’s obviously a strong element of “he would say that”. But, broadly, it’s hard to dismiss the notion that the energy footprint of AI is problematic. It’s equally hard to imagine that AI is going to push net energy usage down any time soon, whatever Huang claims.

That day may come. Ironically, it may be with the help of AI to design a more efficient way of doing things that we get there. Who knows, maybe AI will help us work out how to make fusion energy production genuinely practical. But for now, just as it doesn’t feel like saving money when an AI start-up has to pay $40,000 a pop for one of Nvidia’s AI GPUs, it’s not easy to square the race to build all those massive AI farms with claims of reduced power consumption.

TOPICSHardware

TOPICS

More about hardwareIf you’re a content creator and gamer looking for a CPU upgrade, this Ryzen 9 9900X deal will get you $90 offAMD is now reportedly making all-American Ryzen 9000 CPU dies at TSMC’s Arizona fabLatestHow to feed pegasus in Disney Dreamlight ValleySee more latest►

More about hardware

If you’re a content creator and gamer looking for a CPU upgrade, this Ryzen 9 9900X deal will get you $90 offAMD is now reportedly making all-American Ryzen 9000 CPU dies at TSMC’s Arizona fab

AMD Ryzen 9 9900X CPU on a blue background

If you’re a content creator and gamer looking for a CPU upgrade, this Ryzen 9 9900X deal will get you $90 off

A photo of an AMD Ryzen 7 9700X processor next to its retail packaging box

AMD is now reportedly making all-American Ryzen 9000 CPU dies at TSMC’s Arizona fab

LatestHow to feed pegasus in Disney Dreamlight ValleySee more latest►

Latest

How to feed pegasus in Disney Dreamlight Valley

A players character and a winged horse in Mythopia in Disney Dreamlight Valley

How to feed pegasus in Disney Dreamlight Valley

See more latest►

Most PopularHarrowing report alleges years of horrific abuse at Brandoville Studios, an Indonesian support studio that worked on Assassin’s Creed Shadows and The Last of Us RemakeTencent says it’s not a Chinese military company and is willing to sue the US Department of Defense if it isn’t removed from a blacklistAll Zenless Zone Zero 1.5 livestream codesAsus reveals three new Slash Travel Bags for carting around your ROG Ally—however, none of them are particularly fashion forwardToday’s Wordle answer for Friday, January 10We may not have a roadmap or balance patch just yet, but at least Path of Exile 2’s bugfix patch notes are funnyDeus Ex: Mankind Divided writer didn’t like the ending either: ‘Nothing is resolved’It seems like Square’s finally consistently taking the PC ports of Final Fantasy seriouslyLike a Dragon: Pirate Yakuza in Hawaii looks more like a zany RGG take on Black Flag than I dared hopeThe most important tool in Remedy’s new co-op FPS is the shower: ‘Saving water is essential’If you missed it over the holidays, this noir Half-Life 2 mod turns you into a hardboiled detective in Prohibition-era Chicago

Most Popular

Harrowing report alleges years of horrific abuse at Brandoville Studios, an Indonesian support studio that worked on Assassin’s Creed Shadows and The Last of Us Remake

Tencent says it’s not a Chinese military company and is willing to sue the US Department of Defense if it isn’t removed from a blacklist

All Zenless Zone Zero 1.5 livestream codes

Asus reveals three new Slash Travel Bags for carting around your ROG Ally—however, none of them are particularly fashion forward

Today’s Wordle answer for Friday, January 10

We may not have a roadmap or balance patch just yet, but at least Path of Exile 2’s bugfix patch notes are funny

Deus Ex: Mankind Divided writer didn’t like the ending either: ‘Nothing is resolved’

It seems like Square’s finally consistently taking the PC ports of Final Fantasy seriously

Like a Dragon: Pirate Yakuza in Hawaii looks more like a zany RGG take on Black Flag than I dared hope

The most important tool in Remedy’s new co-op FPS is the shower: ‘Saving water is essential’

If you missed it over the holidays, this noir Half-Life 2 mod turns you into a hardboiled detective in Prohibition-era Chicago

HARDWARE BUYING GUIDESLATEST GAME REVIEWS1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads2Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop3Best mini PCs in 2025: The compact computers I love the most4Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands5Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested1Thank Goodness You’re Here! review2Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review3WD Black SN850X 8 TB NVMe SSD review4Ikea Utespelare desk review5Asus ROG Harpe Ace Mini wireless mouse review

HARDWARE BUYING GUIDESLATEST GAME REVIEWS

1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads

A bunch of the best Steam Deck accessories on a blue background.

1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads

Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads

2Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop

Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop

3Best mini PCs in 2025: The compact computers I love the most

Best mini PCs in 2025: The compact computers I love the most

4Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands

Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands

5Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested

Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested

1Thank Goodness You’re Here! review

Thank Goodness You’re Here review

1Thank Goodness You’re Here! review

Thank Goodness You’re Here! review

2Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review

Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review

3WD Black SN850X 8 TB NVMe SSD review

WD Black SN850X 8 TB NVMe SSD review

4Ikea Utespelare desk review

Ikea Utespelare desk review

5Asus ROG Harpe Ace Mini wireless mouse review

Asus ROG Harpe Ace Mini wireless mouse review

The biggest gaming news, reviews and hardware deals#

The biggest gaming news, reviews and hardware deals