SoftwareAINew MIT study shows what you already knew about AI: it doesn’t actually understand anythingWhen you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.
SoftwareAINew MIT study shows what you already knew about AI: it doesn’t actually understand anythingWhen you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.
When you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.
(Image credit: MIT)
The latest generative AI models are capable of astonishing, magical human-like output. But do they actually understand anything? That’ll be a big, fat no according to thelatest study from MIT(viaTechspot).
More specifically, the key question is whether the LLMs or large language models at the core ofthe most powerful chatbotsare capable of constructing accurate internal models of the world. And the answer that MIT researchers largely came up with is no, they can’t.
To find out, the MIT team developed new metrics for testing AI that go beyond simple measures of accuracy in responses and hinge on what’s known as deterministic finite automations, or DFAs.
A DFA is a problem with a sequence of interdependent steps that rely on a set of rules. Among other tasks, for the research navigating the streets of New York City was chosen.
The core lesson here is that the remarkable accuracy of LLMs in certain contexts can be misleading. “Often, we see these models do impressive things and think they must have understood something about the world. I hope we can convince people that this is a question to think very carefully about, and we don’t have to rely on our own intuitions to answer it,” says senior paper author Ashesh Rambachan.
The biggest gaming news, reviews and hardware deals
More broadly, this research is a reminder of what’s really going on with the latest LLMs. All they are actually doing is predicting what word to put next in a sequence based on having scraped, indexed and correlated gargantuan quantities of text. Reasoning and understanding are not inherent parts of that process.
Your next upgrade(Image credit: Future)Best CPU for gaming: The top chips from Intel and AMD.Best gaming motherboard: The right boards.Best graphics card: Your perfect pixel-pusher awaits.Best SSD for gaming: Get into the game ahead of the rest.
Your next upgrade
(Image credit: Future)Best CPU for gaming: The top chips from Intel and AMD.Best gaming motherboard: The right boards.Best graphics card: Your perfect pixel-pusher awaits.Best SSD for gaming: Get into the game ahead of the rest.
(Image credit: Future)
Best CPU for gaming: The top chips from Intel and AMD.Best gaming motherboard: The right boards.Best graphics card: Your perfect pixel-pusher awaits.Best SSD for gaming: Get into the game ahead of the rest.
What this new MIT research showed is that LLMs can do remarkably well without actually understanding any rules. At the same time, that accuracy can break down rapidly in the face of real-world variables.
Of course, this won’t entirely come as news to anyone familiar with using chatbots. We’ve all experienced how quickly a cogent interaction with a chatbot can degrade into hallucination or just borderline gibberish following a certain kind of interrogative prodding.
But this MIT study is useful for crystallizing that anecdotal experience into a more formal explanation. We all knew that chatbots just predict words. But the incredible accuracy of some of the responses can sometimes begin to convince you that something magical might just be happening.
This latest study is a reminder that it’s almost certainly not. Well, not unless incredibly accurate but ultimately mindless word prediction is your idea of magic.
TOPICSHardware
TOPICS
More about aiNvidia’s impressive AI-based computer tuneup tool G-Assist launches next month but the best bit is missingLogitech has announced an ‘intelligent streaming assistant’ in Streamlabs to tell you when your live stream sucksLatestToday’s Wordle answer for Saturday, January 11See more latest►
More about aiNvidia’s impressive AI-based computer tuneup tool G-Assist launches next month but the best bit is missingLogitech has announced an ‘intelligent streaming assistant’ in Streamlabs to tell you when your live stream sucksLatestToday’s Wordle answer for Saturday, January 11See more latest►
More about aiNvidia’s impressive AI-based computer tuneup tool G-Assist launches next month but the best bit is missingLogitech has announced an ‘intelligent streaming assistant’ in Streamlabs to tell you when your live stream sucks
More about ai
Nvidia’s impressive AI-based computer tuneup tool G-Assist launches next month but the best bit is missingLogitech has announced an ‘intelligent streaming assistant’ in Streamlabs to tell you when your live stream sucks
Nvidia’s impressive AI-based computer tuneup tool G-Assist launches next month but the best bit is missing
Nvidia’s impressive AI-based computer tuneup tool G-Assist launches next month but the best bit is missing
Logitech has announced an ‘intelligent streaming assistant’ in Streamlabs to tell you when your live stream sucks
Logitech has announced an ‘intelligent streaming assistant’ in Streamlabs to tell you when your live stream sucks
LatestToday’s Wordle answer for Saturday, January 11See more latest►
Latest
Today’s Wordle answer for Saturday, January 11
Today’s Wordle answer for Saturday, January 11
Today’s Wordle answer for Saturday, January 11
See more latest►
Most PopularPiranha Games will lay off employees after Mechwarrior 5: Clans ‘performed below projections’Marvel Rivals’ latest update quietly killed the game’s burgeoning mod sceneSorry everyone, Minecraft 2 is cancelled, and it might be our faultTeam Fortress 2 just had the single biggest trade in its history, with ‘the absolute best hat you can get’ going for around $40KIs the new RTX 5070 really as fast as Nvidia’s previous flagship RTX 4090 GPU? Turns out the answer is yes. Kinda.Elden Ring: Nightreign is getting a closed network test, and I’m totally not fuming because PC players aren’t invited to the party, or anythingIf you’re a content creator and gamer looking for a CPU upgrade, this Ryzen 9 9900X deal will get you $90 offAMD is now reportedly making all-American Ryzen 9000 CPU dies at TSMC’s Arizona fabI tried a sim racing rig that generates ‘wind’ at CES 2025 and it’s claimed to help keep VR nausea at bayFinal Fantasy 14 communities panic as it turns out change to blacklisting, meant to help reduce stalking, also lets players use mods to track their altsTikTok’s time in the US may be ticking to a close as it makes a last stand in the Supreme Court, though Trump now says he ‘opposes banning’ it
Most PopularPiranha Games will lay off employees after Mechwarrior 5: Clans ‘performed below projections’Marvel Rivals’ latest update quietly killed the game’s burgeoning mod sceneSorry everyone, Minecraft 2 is cancelled, and it might be our faultTeam Fortress 2 just had the single biggest trade in its history, with ‘the absolute best hat you can get’ going for around $40KIs the new RTX 5070 really as fast as Nvidia’s previous flagship RTX 4090 GPU? Turns out the answer is yes. Kinda.Elden Ring: Nightreign is getting a closed network test, and I’m totally not fuming because PC players aren’t invited to the party, or anythingIf you’re a content creator and gamer looking for a CPU upgrade, this Ryzen 9 9900X deal will get you $90 offAMD is now reportedly making all-American Ryzen 9000 CPU dies at TSMC’s Arizona fabI tried a sim racing rig that generates ‘wind’ at CES 2025 and it’s claimed to help keep VR nausea at bayFinal Fantasy 14 communities panic as it turns out change to blacklisting, meant to help reduce stalking, also lets players use mods to track their altsTikTok’s time in the US may be ticking to a close as it makes a last stand in the Supreme Court, though Trump now says he ‘opposes banning’ it
Most PopularPiranha Games will lay off employees after Mechwarrior 5: Clans ‘performed below projections’Marvel Rivals’ latest update quietly killed the game’s burgeoning mod sceneSorry everyone, Minecraft 2 is cancelled, and it might be our faultTeam Fortress 2 just had the single biggest trade in its history, with ‘the absolute best hat you can get’ going for around $40KIs the new RTX 5070 really as fast as Nvidia’s previous flagship RTX 4090 GPU? Turns out the answer is yes. Kinda.Elden Ring: Nightreign is getting a closed network test, and I’m totally not fuming because PC players aren’t invited to the party, or anythingIf you’re a content creator and gamer looking for a CPU upgrade, this Ryzen 9 9900X deal will get you $90 offAMD is now reportedly making all-American Ryzen 9000 CPU dies at TSMC’s Arizona fabI tried a sim racing rig that generates ‘wind’ at CES 2025 and it’s claimed to help keep VR nausea at bayFinal Fantasy 14 communities panic as it turns out change to blacklisting, meant to help reduce stalking, also lets players use mods to track their altsTikTok’s time in the US may be ticking to a close as it makes a last stand in the Supreme Court, though Trump now says he ‘opposes banning’ it
Most Popular
Piranha Games will lay off employees after Mechwarrior 5: Clans ‘performed below projections’
Marvel Rivals' latest update quietly killed the game’s burgeoning mod scene
Sorry everyone, Minecraft 2 is cancelled, and it might be our fault
Team Fortress 2 just had the single biggest trade in its history, with ‘the absolute best hat you can get’ going for around $40K
Is the new RTX 5070 really as fast as Nvidia’s previous flagship RTX 4090 GPU? Turns out the answer is yes. Kinda.
Elden Ring: Nightreign is getting a closed network test, and I’m totally not fuming because PC players aren’t invited to the party, or anything
If you’re a content creator and gamer looking for a CPU upgrade, this Ryzen 9 9900X deal will get you $90 off
AMD is now reportedly making all-American Ryzen 9000 CPU dies at TSMC’s Arizona fab
I tried a sim racing rig that generates ‘wind’ at CES 2025 and it’s claimed to help keep VR nausea at bay
Final Fantasy 14 communities panic as it turns out change to blacklisting, meant to help reduce stalking, also lets players use mods to track their alts
TikTok’s time in the US may be ticking to a close as it makes a last stand in the Supreme Court, though Trump now says he ‘opposes banning’ it
HARDWARE BUYING GUIDESLATEST GAME REVIEWS1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads2Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop3Best mini PCs in 2025: The compact computers I love the most4Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands5Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested1Thank Goodness You’re Here! review: An anarchic treasure trove of jokes and skits2Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review—like juggling chainsaws on horseback3WD Black SN850X 8 TB NVMe SSD review4Ikea Utespelare desk review5Asus ROG Harpe Ace Mini wireless mouse review
HARDWARE BUYING GUIDESLATEST GAME REVIEWS1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads2Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop3Best mini PCs in 2025: The compact computers I love the most4Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands5Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested1Thank Goodness You’re Here! review: An anarchic treasure trove of jokes and skits2Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review—like juggling chainsaws on horseback3WD Black SN850X 8 TB NVMe SSD review4Ikea Utespelare desk review5Asus ROG Harpe Ace Mini wireless mouse review
HARDWARE BUYING GUIDESLATEST GAME REVIEWS1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads2Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop3Best mini PCs in 2025: The compact computers I love the most4Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands5Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested1Thank Goodness You’re Here! review: An anarchic treasure trove of jokes and skits2Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review—like juggling chainsaws on horseback3WD Black SN850X 8 TB NVMe SSD review4Ikea Utespelare desk review5Asus ROG Harpe Ace Mini wireless mouse review
HARDWARE BUYING GUIDESLATEST GAME REVIEWS1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads2Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop3Best mini PCs in 2025: The compact computers I love the most4Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands5Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested1Thank Goodness You’re Here! review: An anarchic treasure trove of jokes and skits2Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review—like juggling chainsaws on horseback3WD Black SN850X 8 TB NVMe SSD review4Ikea Utespelare desk review5Asus ROG Harpe Ace Mini wireless mouse review
HARDWARE BUYING GUIDESLATEST GAME REVIEWS
1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads
1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads
1
Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads
2Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop
2Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop
2
Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop
3Best mini PCs in 2025: The compact computers I love the most
3Best mini PCs in 2025: The compact computers I love the most
3
Best mini PCs in 2025: The compact computers I love the most
4Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands
4Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands
4
Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands
5Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested
5Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested
5
Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested
1Thank Goodness You’re Here! review: An anarchic treasure trove of jokes and skits
1Thank Goodness You’re Here! review: An anarchic treasure trove of jokes and skits
1
Thank Goodness You’re Here! review: An anarchic treasure trove of jokes and skits
2Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review—like juggling chainsaws on horseback
2Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review—like juggling chainsaws on horseback
2
Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review—like juggling chainsaws on horseback
3WD Black SN850X 8 TB NVMe SSD review
3WD Black SN850X 8 TB NVMe SSD review
3
WD Black SN850X 8 TB NVMe SSD review
4Ikea Utespelare desk review
4Ikea Utespelare desk review
4
Ikea Utespelare desk review
5Asus ROG Harpe Ace Mini wireless mouse review
5Asus ROG Harpe Ace Mini wireless mouse review
5
Asus ROG Harpe Ace Mini wireless mouse review
