I tried two demos of machine learning AI NPCs, and they didn't convince me AI will lead to anything that immersive sims like Deus Ex haven't already done better

Gaming IndustryI tried two demos of machine learning AI NPCs, and they didn’t convince me AI will lead to anything that immersive sims like Deus Ex haven’t already done betterWhen you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.

When you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.

(Image credit: Nvidia, Inworld AI)

Covert Protocol AI demo

My favorite news story of 2023 had nothing to do with AI—or at least I didn’t think it did until recently, when I tried two demos from developers that are using parts of Nvidia’s “digital human technologies suite” to “bring game characters to life.” The story I’m talking about is this one:How deep was Deus Ex’s simulation? A literal piece of paper could set off a laser trap. It is about a 24-year-old videogame, and specifically something so obscure and unlikely happening in that videogame that someone had just seen it for the first time, decades later.

But I came away from the demos struggling to see the technology amounting to much more than a gimmick, skeptical that the wide open possibility space of “say anything you want” will translate into meaningful interactions, because developers still have to plan for how any given conversation ties into the rest of the game. The more I thought about them, the more it felt like an incredible amount of money and effort being spent to chase the wrong sort of believability—“natural” but ultimately hollow conversations—when those vast resources could be dedicated to a world as densely reactive as Deus Ex’s, instead.

NPCs vs. the world

The biggest gaming news, reviews and hardware deals

What’s harder for me to picture is how any interaction I have with one of these NPCs would make most videogames any better. In this buzzword-heavy promotional video for Covert Protocol, Inworld’s CEO says that their platform “unlocks groundbreaking game mechanics” and that “every player will have a unique experience of Covert Protocol because NPCs dynamically adapt to the decisions and actions they take in the game.” To those points, I’d say: One, hey man don’t forget aboutSeaman, and two, how many of those “unique” experiences will actually matter?

And that’s jarring—it highlights the fact that you can say whatever you want, but you really can’tdowhatever you want. Even if an NPC can say something surprising to me, my player agency remains just as hemmed in. Yes, human-written dialogue inevitably provides fewer options, but as a player I know all of those options matter in some way. In immersive sims especially, I know that the dialogue options I can choose from are part of the confines of the game world, but within those confines everything from an intimidation check to a stackable crate is a potential tool at my disposal.

Having those clearly defined limits, rather than illusory freedom, actually makes the world feel more “real” in its own way, or at least cohesive.

(Image credit: Inworld AI, Ubisoft)

Ubisoft AI demo

The essence of a great immersive sim is that the designers have created for the player a variety of interesting approaches to a situation, with certain explicit levers they can manipulate, but there are also the emergent elements, like physics, that let really creative players solve problems in ways the developers didn’t explicitly design for. “Thinking outside the box” lets us discover undesigned-for solutions—but it’s hard to picture that working with these sorts of AI dialogue systems when the developers still have to curate the possible outcomes.

So what does the creator of Deus Ex think?

I put this skepticism to Deus Ex director Warren Spector, who happens to be working onan upcoming immersive sim of his own(though not using any of this AI technology). He’s actually more optimistic about it than I am, though he cautioned he’s far from an expert on the ins and outs of AI. Spector told me over email that he’s “been complaining since 2008 about how terrible game conversations were” and still are, without much having changed since the ’90s. Most games still use branching dialogue trees to represent reactivity, he pointed out.

“Our lack of progress in NPC interaction is nothing short of pathetic (to be fair conversation is a tough problem and I don’t know how to solve it myself),” he said. “But branching trees turn conversation into puzzles. They’re boring. And generating enough dialogue to fail to satisfy players is time-consuming and costly. Back in ‘08 I said we needed natural language processing and sophisticated AI to make real progress. That being the case I’d be a hypocrite if I said I wasn’t at least curious! The big thing for me is that any AI we’d use would have to be trained exclusively on game-relevant information. You don’t want an NPC in a fantasy game talking about Taylor Swift.”

(To be fair to Inworld here, the company’s AI tech includes a feature it calls Fourth Wall that’s “designed to make sure your AI NPCs and AI characters always say a world-appropriate response—no matter how often players try to get them to trip up.” In practice, I do wonder if that’s going to lead to a lot of bland deflections, like the one Diego gave me about his favorite album).

My pessimistic view of developers having to account for players being able to sayanythingto NPCs was that those open-ended conversations would ultimately have to lead to a disappointingly limited set of outcomes. Spector doesn’t see that as a given, but he doesn’t think AI automatically opens the door to lots more player agency, either.

“I wouldn’t say AI would, in and of itself, limit emergent possibilities. No one really knows what impact a more freeform approach to conversation and overall behavior would have,” he said. “Anyone who says they know is way smarter than I am (or delusional…).

“Player agency is a big deal and there are lots of ways to accomplish it. If you’re crazy you can script a lot of player options. If you’re less crazy you can simulate physical forces and build game systems that allow players to use systemic possibilities, tools, the world itself, and their own wit to deal with game challenges. The question is whether there are other things to simulate beyond physical forces. There’s some great imagination and design work to throw at that. I can see ways AI could help with it. (Remember I’m not an expert on this and people who are will probably get a giggle out of my thoughts!)”

While I get Spector’s frustration at videogame dialogue being largely unchanged since the ’90s, I actually like the fact that conversations can deliver human emotion while also serving as a form of puzzle. Immersive sims are impressive because of how much they let you do within their limits, and those limits are vital. In the same way thata bigger open world isn’t always better, a lot of ultimately empty interactions aren’t going to be better than a few tightly designed meaningful ones once the novelty wears off.

TOPICSHardware

TOPICS

More about gaming industryLords of the Fallen publisher embraces fear of the DEI boogeyman, says it will not include ‘any social or political agendas’ in its gamesEpic CEO Tim Sweeney says tech leaders are ‘pretending to be Republicans’ to gain favor with Trump, skirt antitrust laws, and ultimately ‘rip off consumers and crush competitors’LatestToday’s Wordle answer for Sunday, January 12See more latest►

More about gaming industry

Lords of the Fallen publisher embraces fear of the DEI boogeyman, says it will not include ‘any social or political agendas’ in its gamesEpic CEO Tim Sweeney says tech leaders are ‘pretending to be Republicans’ to gain favor with Trump, skirt antitrust laws, and ultimately ‘rip off consumers and crush competitors’

Lords of the Fallen (2023) promotional image - very large man with a very large hammer on a very large horse charging a very small man with a very small magic sword

Lords of the Fallen publisher embraces fear of the DEI boogeyman, says it will not include ‘any social or political agendas’ in its games

Tim Sweeney

Epic CEO Tim Sweeney says tech leaders are ‘pretending to be Republicans’ to gain favor with Trump, skirt antitrust laws, and ultimately ‘rip off consumers and crush competitors’

LatestToday’s Wordle answer for Sunday, January 12See more latest►

Latest

Today’s Wordle answer for Sunday, January 12

Wordle today being played on a phone

Today’s Wordle answer for Sunday, January 12

See more latest►

Most Popular

This bizarre roguelike has a new take on the Vampire Survivors formula: letting you build your own custom weapons out of brains, eyeballs, and chimpanzee spines

18 games the PC Gamer team can’t wait to play in 2025

The Witcher 3’s now 2-year-old bonus quest is our first taste of the ‘vibe’ CD Projekt is going for in The Witcher 4

2024 was the year updates for old games beat out all the new ones for me

Train like you game with this adventure-inspired workout

‘It’s simply impossible to make a difficulty level that’s just right for all players’: How Final Fantasy 14’s lead battle designer has been playing a precarious balancing game for Dawntrail’s dungeons and raids

Please join me in getting super excited for all the cool looking survival games coming in 2025 (and beyond)

Competitive shooters are at a crucial crossroads in 2025: ‘sweaty’ teamplay vs. casual fun

Call of Duty’s $28 Squid Game skins are the perfect crossover for our capitalist dystopia, and Activision knows exactly what it’s doing

These are the 14 biggest upcoming RPGs of 2025—get ready for another amazing year for the genre

HARDWARE BUYING GUIDESLATEST GAME REVIEWS1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads2Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop3Best mini PCs in 2025: The compact computers I love the most4Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands5Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested1Thank Goodness You’re Here! review: An anarchic treasure trove of jokes and skits2Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review—like juggling chainsaws on horseback3WD Black SN850X 8 TB NVMe SSD review4Ikea Utespelare desk review5Asus ROG Harpe Ace Mini wireless mouse review

HARDWARE BUYING GUIDESLATEST GAME REVIEWS

1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads

A bunch of the best Steam Deck accessories on a blue background.

1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads

Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads

2Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop

Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop

3Best mini PCs in 2025: The compact computers I love the most

Best mini PCs in 2025: The compact computers I love the most

4Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands

Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands

5Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested

Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested

1Thank Goodness You’re Here! review: An anarchic treasure trove of jokes and skits

Thank Goodness You’re Here review

1Thank Goodness You’re Here! review: An anarchic treasure trove of jokes and skits

Thank Goodness You’re Here! review: An anarchic treasure trove of jokes and skits

2Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review—like juggling chainsaws on horseback

Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review—like juggling chainsaws on horseback

3WD Black SN850X 8 TB NVMe SSD review

WD Black SN850X 8 TB NVMe SSD review

4Ikea Utespelare desk review

Ikea Utespelare desk review

5Asus ROG Harpe Ace Mini wireless mouse review

Asus ROG Harpe Ace Mini wireless mouse review

NPCs vs. the world#

The biggest gaming news, reviews and hardware deals#

So what does the creator of Deus Ex think?#

NPCs vs. the world

The biggest gaming news, reviews and hardware deals

So what does the creator of Deus Ex think?