When you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.
(Image credit: Nvidia)
Most estimates put the price of an Nvidia H100 GPU at between $20,000 and $40,000. Meta along with Microsoft are Nvidia’s two biggest customers for H100, so it’s safe to assume it will be paying less than most.
Meta has also now revealed some details (viaComputerBase) about how the H100s are implemented. Apparently, they’re built into 24,576-strong clusters used for training language models. At the lower end per-unit H100 price estimate, that works out at $480 million worth of H100s per cluster. Meta has provided insight into two slightly different versions of these clusters.
To quote ComputerBase, one “relies on Remote Direct Memory Access (RDMA) over Converged Ethernet (RoCE) based on the Arista 7800, Wedge400 and Minipack2 OCP components, the other on Nvidia’s Quantum-2 InfiniBand solution. Both clusters communicate via 400 Gbps fast interfaces.”
In all candour, we couldn’t tell our Arista 7800 arse from our Quantum-2 InfiniBand elbow. So, all that doesn’t mean much to us beyond the realisation that there’s a lot more in hardware terms to knocking together some AI training hardware than just buying a bunch of GPUs. Hooking them up would appear to be a major technical challenge, too.
But it’s the 350,000 figure that is the real eye opener. Meta was estimated to have bought 150,000 H100s in 2023 and hitting that 350,000 target means upping that to fully 200,000 more of them this year.
The biggest gaming news, reviews and hardware deals
Meta’s AI Cluster: Altogether now…the Arista 7800 bone’s connected to the Quantum-2 InfiniBand bone!(Image credit: Meta)
For what it’s worth, Omnia predicts that the overall market for these AI GPUs will be double the size in 2027 that it was in 2023. So, Meta buying a huge amount of H100s in 2023 and yet even more of them this year fits the available data well enough.
What this all means for the rest of us is anyone’s guess. It’s hard to predict everything from the impact this huge demand for AI GPUs will have on availability of humble graphics-rendering chips for PC gaming, let alone the details of how upcoming AI will advance over the next year or two.
Your next upgrade(Image credit: Future)Best CPU for gaming: The top chips from Intel and AMD.Best gaming motherboard: The right boards.Best graphics card: Your perfect pixel-pusher awaits.Best SSD for gaming: Get into the game ahead of the rest.
Your next upgrade
(Image credit: Future)Best CPU for gaming: The top chips from Intel and AMD.Best gaming motherboard: The right boards.Best graphics card: Your perfect pixel-pusher awaits.Best SSD for gaming: Get into the game ahead of the rest.
(Image credit: Future)
Best CPU for gaming: The top chips from Intel and AMD.Best gaming motherboard: The right boards.Best graphics card: Your perfect pixel-pusher awaits.Best SSD for gaming: Get into the game ahead of the rest.
As if these numbers weren’t big enough, Omdia reckons Nvidia’s revenues for these big data GPUs will actually be double in 2027 what it is today. They won’t all be used for large language models and similar AI applications, but a lot of them will.
It’s interesting that Omdia is so bullish about Nvidia’s prospects in this market despite the fact that many of Nvidia’s biggest customers in this market are actually planning on building their own AI chips. Indeed, Google and Amazon already do, which is probably why they don’t buy as many Nvidia chips as Microsoft and Meta.
One thing is for sure, however, all of these numbers do rather make the gaming graphics market look puny. We’ve created a monster, folks, and there’s no going back.
TOPICSHardware
TOPICS
More about graphics cardsIs the new RTX 5070 really as fast as Nvidia’s previous flagship RTX 4090 GPU? Turns out the answer is yes. Kinda.It’s time for me to admit that AI-accelerated frame generation might actually be the way of the future and that’s a good thingLatestSquare Enix launches new anti-harassment policy to protect its employees and partners from abusive fansSee more latest►
More about graphics cardsIs the new RTX 5070 really as fast as Nvidia’s previous flagship RTX 4090 GPU? Turns out the answer is yes. Kinda.It’s time for me to admit that AI-accelerated frame generation might actually be the way of the future and that’s a good thingLatestSquare Enix launches new anti-harassment policy to protect its employees and partners from abusive fansSee more latest►
More about graphics cardsIs the new RTX 5070 really as fast as Nvidia’s previous flagship RTX 4090 GPU? Turns out the answer is yes. Kinda.It’s time for me to admit that AI-accelerated frame generation might actually be the way of the future and that’s a good thing
More about graphics cards
Is the new RTX 5070 really as fast as Nvidia’s previous flagship RTX 4090 GPU? Turns out the answer is yes. Kinda.It’s time for me to admit that AI-accelerated frame generation might actually be the way of the future and that’s a good thing
Is the new RTX 5070 really as fast as Nvidia’s previous flagship RTX 4090 GPU? Turns out the answer is yes. Kinda.
Is the new RTX 5070 really as fast as Nvidia’s previous flagship RTX 4090 GPU? Turns out the answer is yes. Kinda.
It’s time for me to admit that AI-accelerated frame generation might actually be the way of the future and that’s a good thing
It’s time for me to admit that AI-accelerated frame generation might actually be the way of the future and that’s a good thing
LatestSquare Enix launches new anti-harassment policy to protect its employees and partners from abusive fansSee more latest►
Latest
Square Enix launches new anti-harassment policy to protect its employees and partners from abusive fans
Square Enix launches new anti-harassment policy to protect its employees and partners from abusive fans
Square Enix launches new anti-harassment policy to protect its employees and partners from abusive fans
See more latest►
Most PopularElden Ring: Nightreign is getting a closed network test, and I’m totally not fuming because PC players aren’t invited to the party, or anythingIf you’re a content creator and gamer looking for a CPU upgrade, this Ryzen 9 9900X deal will get you $90 offAMD is now reportedly making all-American Ryzen 9000 CPU dies at TSMC’s Arizona fabI tried a sim racing rig that generates ‘wind’ at CES 2025 and it’s claimed to help keep VR nausea at bayFinal Fantasy 14 communities panic as it turns out change to blacklisting, meant to help reduce stalking, also lets players use mods to track their altsTikTok’s time in the US may be ticking to a close as it makes a last stand in the Supreme Court, though Trump now says he ‘opposes banning’ itMSI intros cheaper ‘back connect’ Project Zero Intel motherboards for super-clean PC builds you might actually be able to affordThermaltake’s new 2000 W PSU is too powerful to be sold in the USA and comes with four PCIe 5.0 GPU power connectorsAMD accuses Intel’s Arrow Lake of being a ‘horrible’ product and implies a lack of options for consumers has caused the Ryzen 7 9800X3D shortageThis Jinx-inspired gaming PC is my favorite of CES 2025 and I’m head over heels for the hardwareHarrowing report alleges years of horrific abuse at Brandoville Studios, an Indonesian support studio that worked on Assassin’s Creed Shadows and The Last of Us Remake
Most PopularElden Ring: Nightreign is getting a closed network test, and I’m totally not fuming because PC players aren’t invited to the party, or anythingIf you’re a content creator and gamer looking for a CPU upgrade, this Ryzen 9 9900X deal will get you $90 offAMD is now reportedly making all-American Ryzen 9000 CPU dies at TSMC’s Arizona fabI tried a sim racing rig that generates ‘wind’ at CES 2025 and it’s claimed to help keep VR nausea at bayFinal Fantasy 14 communities panic as it turns out change to blacklisting, meant to help reduce stalking, also lets players use mods to track their altsTikTok’s time in the US may be ticking to a close as it makes a last stand in the Supreme Court, though Trump now says he ‘opposes banning’ itMSI intros cheaper ‘back connect’ Project Zero Intel motherboards for super-clean PC builds you might actually be able to affordThermaltake’s new 2000 W PSU is too powerful to be sold in the USA and comes with four PCIe 5.0 GPU power connectorsAMD accuses Intel’s Arrow Lake of being a ‘horrible’ product and implies a lack of options for consumers has caused the Ryzen 7 9800X3D shortageThis Jinx-inspired gaming PC is my favorite of CES 2025 and I’m head over heels for the hardwareHarrowing report alleges years of horrific abuse at Brandoville Studios, an Indonesian support studio that worked on Assassin’s Creed Shadows and The Last of Us Remake
Most PopularElden Ring: Nightreign is getting a closed network test, and I’m totally not fuming because PC players aren’t invited to the party, or anythingIf you’re a content creator and gamer looking for a CPU upgrade, this Ryzen 9 9900X deal will get you $90 offAMD is now reportedly making all-American Ryzen 9000 CPU dies at TSMC’s Arizona fabI tried a sim racing rig that generates ‘wind’ at CES 2025 and it’s claimed to help keep VR nausea at bayFinal Fantasy 14 communities panic as it turns out change to blacklisting, meant to help reduce stalking, also lets players use mods to track their altsTikTok’s time in the US may be ticking to a close as it makes a last stand in the Supreme Court, though Trump now says he ‘opposes banning’ itMSI intros cheaper ‘back connect’ Project Zero Intel motherboards for super-clean PC builds you might actually be able to affordThermaltake’s new 2000 W PSU is too powerful to be sold in the USA and comes with four PCIe 5.0 GPU power connectorsAMD accuses Intel’s Arrow Lake of being a ‘horrible’ product and implies a lack of options for consumers has caused the Ryzen 7 9800X3D shortageThis Jinx-inspired gaming PC is my favorite of CES 2025 and I’m head over heels for the hardwareHarrowing report alleges years of horrific abuse at Brandoville Studios, an Indonesian support studio that worked on Assassin’s Creed Shadows and The Last of Us Remake
Most Popular
Elden Ring: Nightreign is getting a closed network test, and I’m totally not fuming because PC players aren’t invited to the party, or anything
If you’re a content creator and gamer looking for a CPU upgrade, this Ryzen 9 9900X deal will get you $90 off
AMD is now reportedly making all-American Ryzen 9000 CPU dies at TSMC’s Arizona fab
I tried a sim racing rig that generates ‘wind’ at CES 2025 and it’s claimed to help keep VR nausea at bay
Final Fantasy 14 communities panic as it turns out change to blacklisting, meant to help reduce stalking, also lets players use mods to track their alts
TikTok’s time in the US may be ticking to a close as it makes a last stand in the Supreme Court, though Trump now says he ‘opposes banning’ it
MSI intros cheaper ‘back connect’ Project Zero Intel motherboards for super-clean PC builds you might actually be able to afford
Thermaltake’s new 2000 W PSU is too powerful to be sold in the USA and comes with four PCIe 5.0 GPU power connectors
AMD accuses Intel’s Arrow Lake of being a ‘horrible’ product and implies a lack of options for consumers has caused the Ryzen 7 9800X3D shortage
This Jinx-inspired gaming PC is my favorite of CES 2025 and I’m head over heels for the hardware
Harrowing report alleges years of horrific abuse at Brandoville Studios, an Indonesian support studio that worked on Assassin’s Creed Shadows and The Last of Us Remake
HARDWARE BUYING GUIDESLATEST GAME REVIEWS1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads2Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop3Best mini PCs in 2025: The compact computers I love the most4Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands5Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested1Thank Goodness You’re Here! review: An anarchic treasure trove of jokes and skits2Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review—like juggling chainsaws on horseback3WD Black SN850X 8 TB NVMe SSD review4Ikea Utespelare desk review5Asus ROG Harpe Ace Mini wireless mouse review
HARDWARE BUYING GUIDESLATEST GAME REVIEWS1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads2Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop3Best mini PCs in 2025: The compact computers I love the most4Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands5Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested1Thank Goodness You’re Here! review: An anarchic treasure trove of jokes and skits2Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review—like juggling chainsaws on horseback3WD Black SN850X 8 TB NVMe SSD review4Ikea Utespelare desk review5Asus ROG Harpe Ace Mini wireless mouse review
HARDWARE BUYING GUIDESLATEST GAME REVIEWS1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads2Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop3Best mini PCs in 2025: The compact computers I love the most4Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands5Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested1Thank Goodness You’re Here! review: An anarchic treasure trove of jokes and skits2Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review—like juggling chainsaws on horseback3WD Black SN850X 8 TB NVMe SSD review4Ikea Utespelare desk review5Asus ROG Harpe Ace Mini wireless mouse review
HARDWARE BUYING GUIDESLATEST GAME REVIEWS1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads2Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop3Best mini PCs in 2025: The compact computers I love the most4Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands5Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested1Thank Goodness You’re Here! review: An anarchic treasure trove of jokes and skits2Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review—like juggling chainsaws on horseback3WD Black SN850X 8 TB NVMe SSD review4Ikea Utespelare desk review5Asus ROG Harpe Ace Mini wireless mouse review
HARDWARE BUYING GUIDESLATEST GAME REVIEWS
1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads
1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads
1
Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads
2Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop
2Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop
2
Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop
3Best mini PCs in 2025: The compact computers I love the most
3Best mini PCs in 2025: The compact computers I love the most
3
Best mini PCs in 2025: The compact computers I love the most
4Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands
4Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands
4
Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands
5Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested
5Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested
5
Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested
1Thank Goodness You’re Here! review: An anarchic treasure trove of jokes and skits
1Thank Goodness You’re Here! review: An anarchic treasure trove of jokes and skits
1
Thank Goodness You’re Here! review: An anarchic treasure trove of jokes and skits
2Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review—like juggling chainsaws on horseback
2Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review—like juggling chainsaws on horseback
2
Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review—like juggling chainsaws on horseback
3WD Black SN850X 8 TB NVMe SSD review
3WD Black SN850X 8 TB NVMe SSD review
3
WD Black SN850X 8 TB NVMe SSD review
4Ikea Utespelare desk review
4Ikea Utespelare desk review
4
Ikea Utespelare desk review
5Asus ROG Harpe Ace Mini wireless mouse review
5Asus ROG Harpe Ace Mini wireless mouse review
5
Asus ROG Harpe Ace Mini wireless mouse review
