I spoke to an Nvidia AI-powered NPC about his ramen and his responses were frighteningly good

SoftwareAII spoke to an Nvidia AI-powered NPC about his ramen and his responses were frighteningly goodWhen you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.

When you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.

I just had a conversation with an in-game NPC that could easily appear scripted. Except it wasn’t, at all. I asked a question, the NPC answered, and all thanks to Nvidia’s ACE technology and Convai.

You might have caught sight of Nvidia ACE in action during the company’sSpecial Address stream. It’s essentially a technology that allows in-game NPCs to react and respond to players in real-time, with voiced dialogue and animations. Nvidia’s been showing off the same tech demo called Kairos, which takes place inside a ramen restaurant in a cyberpunk world, sinceACE was announced back at Computex. Over at CES 2024, I got to try it out for myself.

In the tech demo—which is build in Unreal Engine 5 and uses a platform from AI startup Convai—you play as Kai, and you’re able to speak with Jin and Nova, two NPCs in the demo’s cyberpunk world.

First off, I gave a prompt that was entered into the demo’s underlying AI system. This will be used to direct the conversation between the two NPCs before I even interact with them. I picked the first thing that came into my head, which for whatever reason was skateboarding. That meant as I walked up to both characters, I could hear them discussing the finer points of skateboarding injuries.

That’s a small part of the AI-driven system. Mostly it’s about responding to you, as another character in the world. This requires a microphone to directly ask questions and speak with the NPCs.

Below is a video of me speaking with Jinand ordering some ramen. It’s pretty weird to hold a conversation with an NPC like this, yet it’s also pretty fun. There’s a slight delay in responding to you, which comes across as an awkward pause, but honestly the delay was minimal and the general accuracy of the responses pretty good.

I’m keen to see where this sort of technology could go. On the one hand, it could mean the end of NPCs wandering around open worlds muttering the same three phrases over and over again. It could breathe new life into often robotic NPCs and make for some stronger connections with major characters in games. What springs to mind are the few major characters you can hang out with in Cyberpunk 2077. Just uncovering their backstory through non-scripted conversation could be a far less formulaic way of experiencing all that.

The biggest gaming news, reviews and hardware deals

On the other, if there’s no purpose to these conversations—i.e no quest building or story points to speak of—it could make for some trivial conversations that get stale pretty quick. I don’t feel that will ultimately be the case—all that character background is designed and programmed in—but it will take some finessing on a developer’s part to have these NPCs steer the conversation back to something pertinent to a game’s story or building out a backstory.

The Unreal Engine 5-powered demo uses a couple key models, including Automatic Speech Recognition, Text-to-Speech, Audio2Face, and Nvidia NeMo, alongside a platform from anAI startup called Convaithat integrates spatial awareness, actions, and NPC-to-NPC interactions, like the one I mentioned involving skateboarding.

(Image credit: Nvidia)

The Nvidia ACE with Convai model.

Your next upgrade(Image credit: Future)Best CPU for gaming: The top chips from Intel and AMD.Best gaming motherboard: The right boards.Best graphics card: Your perfect pixel-pusher awaits.Best SSD for gaming: Get into the game ahead of the rest.

Your next upgrade

(Image credit: Future)Best CPU for gaming: The top chips from Intel and AMD.Best gaming motherboard: The right boards.Best graphics card: Your perfect pixel-pusher awaits.Best SSD for gaming: Get into the game ahead of the rest.

(Image credit: Future)

Nvidia RTX 4070 and RTX 3080 Founders Edition graphics cards

Best CPU for gaming: The top chips from Intel and AMD.Best gaming motherboard: The right boards.Best graphics card: Your perfect pixel-pusher awaits.Best SSD for gaming: Get into the game ahead of the rest.

The actions and spatial awareness are pretty cool, too. I could ask the AI about the world around them, and they’d respond with stories and information. I could also ask for another bowl of ramen and have Jin make one up. Or ask him to turn down the lights and he’d walk off and do it. These AI are actually incredibly obliging, but there’s surely be some sort of sass meter required to create more realistic characters.

I’m keen to see how someone takes this tech and rolls it into something that feels like a good use of the tech. A VR game would perhaps be a great fit. And I’m trying not to get bogged down thinking of how it might help make some pretty awful experiences, too. Then there’s the matter ofhow voice actor’s voices are usedand what they get a say in when it comes to AI.

Nvidia says you could hook this up to a Google search if you wanted and have the AI spit facts at you, but that feels like it would be underselling what could be a pretty engrossing technology with some effective game design and well-written personas. We’ll just have to wait and see what comes out of ACE once the tech gets into developers' hands.

_____________________________________PC Gamer’s CES 2024 coverage is being published in association withAsusRepublic of Gamers.

More about aiNvidia’s impressive AI-based computer tuneup tool G-Assist launches next month but the best bit is missingLogitech has announced an ‘intelligent streaming assistant’ in Streamlabs to tell you when your live stream sucksLatestToday’s Wordle answer for Friday, January 10See more latest►

More about ai

Nvidia’s impressive AI-based computer tuneup tool G-Assist launches next month but the best bit is missingLogitech has announced an ‘intelligent streaming assistant’ in Streamlabs to tell you when your live stream sucks

Nvidia’s AI assistant named Project G-Assist

Nvidia’s impressive AI-based computer tuneup tool G-Assist launches next month but the best bit is missing

A young Asian woman opening visual aids to give her audience a better understanding while holding a podcast session.

Logitech has announced an ‘intelligent streaming assistant’ in Streamlabs to tell you when your live stream sucks

LatestToday’s Wordle answer for Friday, January 10See more latest►

Latest

Today’s Wordle answer for Friday, January 10

Today’s Wordle being played on a phone

Today’s Wordle answer for Friday, January 10

See more latest►

Most PopularTrack down a missing person in this ‘Geoguessr-inspired detective game’ set on an alien planetOld meets new as classic MMO players worship a famous Vtuber via gifts of bones so she can max out the Prayer skillHyper Light Breaker will cost $30 and for a limited time come with a free copy of DrifterFallout season 2 filming delayed due to massive LA firesAssassin’s Creed Shadows is delayed again ‘to better incorporate player feedback gathered over the past three months’The Freewrite Wordrunner with a built-in word counter might be the keyboard to look out for if you want to improve your writing process’I created it, let me move on’: Ex-Cloud 9 player, the Overwatch team whose blunder inspired the infamous ‘C9’ slang, watches in horror as the term moves onto Marvel RivalsLenovo’s rollable laptop screen isn’t just a CES party trick—you’ll be able to pick one up yourself in JuneNvidia CEO Jen-Hsun Huang’s simple reminder that useful quantum computing is a long way off has somehow caused industry stocks to plummetAfter 15 years, Minecraft has finally added two new pig variations: The warm pig and the cold pig, meaning I can delete one mod off my listIf you love a big laptop without a big price tag, this RTX 4070 17.3-incher is an ideal pick at $1,300

Most Popular

Track down a missing person in this ‘Geoguessr-inspired detective game’ set on an alien planet

Old meets new as classic MMO players worship a famous Vtuber via gifts of bones so she can max out the Prayer skill

Hyper Light Breaker will cost $30 and for a limited time come with a free copy of Drifter

Fallout season 2 filming delayed due to massive LA fires

Assassin’s Creed Shadows is delayed again ‘to better incorporate player feedback gathered over the past three months’

The Freewrite Wordrunner with a built-in word counter might be the keyboard to look out for if you want to improve your writing process

‘I created it, let me move on’: Ex-Cloud 9 player, the Overwatch team whose blunder inspired the infamous ‘C9’ slang, watches in horror as the term moves onto Marvel Rivals

Lenovo’s rollable laptop screen isn’t just a CES party trick—you’ll be able to pick one up yourself in June

Nvidia CEO Jen-Hsun Huang’s simple reminder that useful quantum computing is a long way off has somehow caused industry stocks to plummet

After 15 years, Minecraft has finally added two new pig variations: The warm pig and the cold pig, meaning I can delete one mod off my list

If you love a big laptop without a big price tag, this RTX 4070 17.3-incher is an ideal pick at $1,300

HARDWARE BUYING GUIDESLATEST GAME REVIEWS1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads2Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop3Best mini PCs in 2025: The compact computers I love the most4Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands5Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested1Thank Goodness You’re Here! review2Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review3WD Black SN850X 8 TB NVMe SSD review4Ikea Utespelare desk review5Asus ROG Harpe Ace Mini wireless mouse review

HARDWARE BUYING GUIDESLATEST GAME REVIEWS

1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads

A bunch of the best Steam Deck accessories on a blue background.

1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads

Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads

2Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop

Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop

3Best mini PCs in 2025: The compact computers I love the most

Best mini PCs in 2025: The compact computers I love the most

4Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands

Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands

5Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested

Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested

1Thank Goodness You’re Here! review

Thank Goodness You’re Here review

1Thank Goodness You’re Here! review

Thank Goodness You’re Here! review

2Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review

Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review

3WD Black SN850X 8 TB NVMe SSD review

WD Black SN850X 8 TB NVMe SSD review

4Ikea Utespelare desk review

Ikea Utespelare desk review

5Asus ROG Harpe Ace Mini wireless mouse review

Asus ROG Harpe Ace Mini wireless mouse review

The biggest gaming news, reviews and hardware deals#

The biggest gaming news, reviews and hardware deals