Elon Musk warns city-sized power footprints will limit future AI development

HardwareGraphics CardsElon Musk warns city-sized power footprints will limit future AI developmentWhen you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.

When you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.

(Image credit: Bloomberg via Getty Images)

Elon Musk steepling his hands and looking sombre.

When it comes to training large language models, the usual refrain is that the problem is a GPU shortage. Nvidia’s dominant chips, of course, are the ones all the various AI outfits beat each other up to acquire.

But everyone’s favourite billionaire and tech prognosticator sees a different problem: We might not have enough power. Musk says the next Grok 3 generation of the AI model from his start up xAI is going to need around 100,000 ofNvidia’s H100 GPUsto train the model.

For sure, getting hold of 100,000 H100s isn’t going to be easy. Or cheap. But here’s the thing. Each H100 eats up a peak of 700W of power. So, that’s a peak of 70 megawatts for 100,000 of the things. OK, you’re probably not going to have all 100,000 running at 100% load at the same time. But then there’s more to an AI setup than just the GPUs. There’s all kinds of supporting hardware and infrastructure involved.

So, with 100,000 H100s, you’re looking at in excess of 100 megawatts or about the same as a small city. Or for another data point, in 2022 the whole of Paris had 500 megawatts worth of data centres.

So, yeah, 100 megawatts for just one LLM is a bit of a problem. And so in an interview with Norway wealth fund CEONicolai Tangen on X Spaces(viaReuters), Musk stressed that while the availability of GPUs was and will continue to be a major constraint for the development of AI models, access to sufficient electricity will increasingly become a limiting factor.

Oh, and Musk also predicted that AGI or artificial general intelligence will outpace human intelligence within two years. “If you define AGI (artificial general intelligence) as smarter than the smartest human, I think it’s probably next year, within two years,” Musk said.

The biggest gaming news, reviews and hardware deals

Anyway, Musk’s slightly patchy techno-prognostications are not exactly news. But he probably has a pretty solid idea of how many GPUs his next-gen LLM is going to need to get trained up. So that city-sized power budget thing is likely for real, and a bit of a concern.

Moreover, Grok 2, xAI’s current model, apparently only needed 20,000 H100s. So that’s a five-fold increase in GPUs from one AI model to the next. That’s the kind of scaling that doesn’t feel terribly sustainable, whether its GPU count or power consumption.

Best CPU for gaming: Top chips from Intel and AMD.Best gaming motherboard: The right boards.Best graphics card: Your perfect pixel-pusher awaits.Best SSD for gaming: Get into the game first.

Best CPU for gamingBest gaming motherboardBest graphics cardBest SSD for gaming

Best CPU for gaming: Top chips from Intel and AMD.Best gaming motherboard: The right boards.Best graphics card: Your perfect pixel-pusher awaits.Best SSD for gaming: Get into the game first.

TOPICSHardware

TOPICS

More about graphics cardsAIB vendors getting the RTX 5080’s memory config wrong could mean 50-series Super cards have more and faster VRAMEarly Radeon RX 9070 benchmarks are positive, though don’t bank too much on themLatestAll Zenless Zone Zero 1.5 livestream codesSee more latest►

More about graphics cards

AIB vendors getting the RTX 5080’s memory config wrong could mean 50-series Super cards have more and faster VRAMEarly Radeon RX 9070 benchmarks are positive, though don’t bank too much on them

Nvidia GeForce RTX 5090 render on green background

AIB vendors getting the RTX 5080’s memory config wrong could mean 50-series Super cards have more and faster VRAM

The AMD Radeon RX 9070 XT and RX 9070 RDNA 4 GPUs arranged in diagonal lines, taken from a CES 2025 presentation slide

Early Radeon RX 9070 benchmarks are positive, though don’t bank too much on them

LatestAll Zenless Zone Zero 1.5 livestream codesSee more latest►

Latest

All Zenless Zone Zero 1.5 livestream codes

Zenless Zone Zero codes - Miyabi and section four

All Zenless Zone Zero 1.5 livestream codes

See more latest►

Most PopularPath of Exile 2 players are calling foul on Elon Musk’s high-level hardcore character after he streams his struggles with core game mechanicsAlan Emrich, the game designer and writer who coined the term ‘4X,’ has diedTrack down a missing person in this ‘Geoguessr-inspired detective game’ set on an alien planetOld meets new as classic MMO players worship a famous Vtuber via gifts of bones so she can max out the Prayer skillHyper Light Breaker will cost $30 and for a limited time come with a free copy of DrifterFallout season 2 filming delayed due to massive LA firesAssassin’s Creed Shadows is delayed again ‘to better incorporate player feedback gathered over the past three months’The Freewrite Wordrunner with a built-in word counter might be the keyboard to look out for if you want to improve your writing process’I created it, let me move on’: Ex-Cloud 9 player, the Overwatch team whose blunder inspired the infamous ‘C9’ slang, watches in horror as the term moves onto Marvel RivalsLenovo’s rollable laptop screen isn’t just a CES party trick—you’ll be able to pick one up yourself in JuneNvidia CEO Jen-Hsun Huang’s simple reminder that useful quantum computing is a long way off has somehow caused industry stocks to plummet

Most Popular

Path of Exile 2 players are calling foul on Elon Musk’s high-level hardcore character after he streams his struggles with core game mechanics

Alan Emrich, the game designer and writer who coined the term ‘4X,’ has died

Track down a missing person in this ‘Geoguessr-inspired detective game’ set on an alien planet

Old meets new as classic MMO players worship a famous Vtuber via gifts of bones so she can max out the Prayer skill

Hyper Light Breaker will cost $30 and for a limited time come with a free copy of Drifter

Fallout season 2 filming delayed due to massive LA fires

Assassin’s Creed Shadows is delayed again ‘to better incorporate player feedback gathered over the past three months’

The Freewrite Wordrunner with a built-in word counter might be the keyboard to look out for if you want to improve your writing process

‘I created it, let me move on’: Ex-Cloud 9 player, the Overwatch team whose blunder inspired the infamous ‘C9’ slang, watches in horror as the term moves onto Marvel Rivals

Lenovo’s rollable laptop screen isn’t just a CES party trick—you’ll be able to pick one up yourself in June

Nvidia CEO Jen-Hsun Huang’s simple reminder that useful quantum computing is a long way off has somehow caused industry stocks to plummet

HARDWARE BUYING GUIDESLATEST GAME REVIEWS1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads2Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop3Best mini PCs in 2025: The compact computers I love the most4Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands5Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested1Thank Goodness You’re Here! review: An anarchic treasure trove of jokes and skits2Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review—like juggling chainsaws on horseback3WD Black SN850X 8 TB NVMe SSD review4Ikea Utespelare desk review5Asus ROG Harpe Ace Mini wireless mouse review

HARDWARE BUYING GUIDESLATEST GAME REVIEWS

1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads

A bunch of the best Steam Deck accessories on a blue background.

1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads

Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads

2Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop

Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop

3Best mini PCs in 2025: The compact computers I love the most

Best mini PCs in 2025: The compact computers I love the most

4Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands

Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands

5Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested

Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested

1Thank Goodness You’re Here! review: An anarchic treasure trove of jokes and skits

Thank Goodness You’re Here review

1Thank Goodness You’re Here! review: An anarchic treasure trove of jokes and skits

Thank Goodness You’re Here! review: An anarchic treasure trove of jokes and skits

2Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review—like juggling chainsaws on horseback

Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review—like juggling chainsaws on horseback

3WD Black SN850X 8 TB NVMe SSD review

WD Black SN850X 8 TB NVMe SSD review

4Ikea Utespelare desk review

Ikea Utespelare desk review

5Asus ROG Harpe Ace Mini wireless mouse review

Asus ROG Harpe Ace Mini wireless mouse review

The biggest gaming news, reviews and hardware deals#

The biggest gaming news, reviews and hardware deals