Microsoft's latest speech generator is so good it's afraid to release it to the public

SoftwareAIMicrosoft’s latest speech generator is so good it’s afraid to release it to the publicWhen you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.

When you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.

(Image credit: Microsoft)

Microsoft VALL-E

This thing we made is so brilliant, we can’t risk releasing it to the general public. So Microsoft basically says about it’s latest speech generator, VALL-E 2. So, does that reflect genuine concerns? Or is it a clever marketing ruse designed to get some viral traction and online chins wagging?

If it is all completely genuine, what does it say about Microsoft that it’s knowingly creating AI tools too dangerous to release? It’s a conundrum, to be sure.

Anyway, here are the basic facts of the situation.Microsoft says in a recent blog post(viaExtremetech) that it’s latest neural codec language model for speech synthesis, known as VALL-E 2, achieves “human parity for the first time”.

More specifically, “VALL-E 2 can generate accurate, natural speech in the exact voice of the original speaker, comparable to human performance.” Now, to some extent, this is nothing new. However, it’s the incredible speed with which VALL-E 2 can achieve this, or to put it another way, the incredibly limited sample or prompt it needs to achieve this feat that’s remarkable.

Microsoft’s blog post has a range of example audio clips demonstrating how well VALL-E 2 (and indeed its predecessor, VALL-E) can turn a short sample of between three and 10 seconds into convincing synthesised speech that’s often indistinguishable from a real human voice.

It’s a process known as zero-shot text-to-speech synthesis or zero-shot TTS for short. Again, the approach is nothing new, it’s the accuracy and shortness of the sample audio that’s novel.

The biggest gaming news, reviews and hardware deals

Microsoft claims VALL-E 2 is the first speech generator to achieve “human parity”.(Image credit: Microsoft)

VALL-E 2

Of course, the idea of weaponising such tools to create fake content for nefarious purposes is likewise not a new idea. But the VALL-E 2’s capabilities do seem to take the threat to a whole new level. Which is why the “Ethics Statement” appended to the blog post makes it clear that Microsoft currently has no intention of releasing VALL-E 2 to the public.

“VALL-E 2 is purely a research project. Currently, we have no plans to incorporate VALL-E 2 into a product or expand access to the public,” the statement says, adding that “it may carry potential risks in the misuse of the model, such as spoofing voice identification or impersonating a specific speaker. We conducted the experiments under the assumption that the user agrees to be the target speaker in speech synthesis. If the model is generalized to unseen speakers in the real world, it should include a protocol to ensure that the speaker approves the use of their voice and a synthesized speech detection model.”

Microsoft expressed similar concerns regarding its VASA-1,which can turn a still image of a person into convincing motion video. “It is not intended to create content that is used to mislead or deceive. However, like other related content generation techniques, it could still potentially be misused for impersonating humans,” Microsoft said of VASA-1.

Your next upgrade(Image credit: Future)Best CPU for gaming: The top chips from Intel and AMD.Best gaming motherboard: The right boards.Best graphics card: Your perfect pixel-pusher awaits.Best SSD for gaming: Get into the game ahead of the rest.

Your next upgrade

(Image credit: Future)Best CPU for gaming: The top chips from Intel and AMD.Best gaming motherboard: The right boards.Best graphics card: Your perfect pixel-pusher awaits.Best SSD for gaming: Get into the game ahead of the rest.

(Image credit: Future)

Nvidia RTX 4070 and RTX 3080 Founders Edition graphics cards

Best CPU for gaming: The top chips from Intel and AMD.Best gaming motherboard: The right boards.Best graphics card: Your perfect pixel-pusher awaits.Best SSD for gaming: Get into the game ahead of the rest.

An obvious observation, perhaps, is that the problems that come with such models aren’t exactly a surprise. You don’t have to succeed in making the perfect speech synthesis model to imagine what might go wrong if such a tool was released to the public.

So, it’s easy enough to see the problem coming, but Microsoft pressed ahead anyway. Now it claims to have achieved its aims, only to decide it’s not fit for public consumption.

It does rather beg the question of what other tools it is developing that it much know in advance are too problematic for general release. And then you inevitably wonder what Microsoft’s aim is in all this.

There’s also the inevitable genie-and-bottle conundrum. Microsoft has made this tool and it’s hard to imagine how it or something very similar doesn’t eventually end up out in the wild. In short, the ethics of it all are rather confusing. Where it all ends is still anyone’s guess.

More about aiNvidia’s impressive AI-based computer tuneup tool G-Assist launches next month but the best bit is missingLogitech has announced an ‘intelligent streaming assistant’ in Streamlabs to tell you when your live stream sucksLatestMarvel Rivals' latest update quietly killed the game’s burgeoning mod sceneSee more latest►

More about ai

Nvidia’s impressive AI-based computer tuneup tool G-Assist launches next month but the best bit is missingLogitech has announced an ‘intelligent streaming assistant’ in Streamlabs to tell you when your live stream sucks

Nvidia’s AI assistant named Project G-Assist

Nvidia’s impressive AI-based computer tuneup tool G-Assist launches next month but the best bit is missing

A young Asian woman opening visual aids to give her audience a better understanding while holding a podcast session.

Logitech has announced an ‘intelligent streaming assistant’ in Streamlabs to tell you when your live stream sucks

LatestMarvel Rivals' latest update quietly killed the game’s burgeoning mod sceneSee more latest►

Latest

Marvel Rivals' latest update quietly killed the game’s burgeoning mod scene

Marvel Rivals tier list - Wolverine

Marvel Rivals' latest update quietly killed the game’s burgeoning mod scene

See more latest►

Most PopularTikTok’s time in the US may be ticking to a close as it makes a last stand in the Supreme Court, though Trump now says he ‘opposes banning’ itMSI intros cheaper ‘back connect’ Project Zero Intel motherboards for super-clean PC builds you might actually be able to affordThermaltake’s new 2000 W PSU is too powerful to be sold in the USA and comes with four PCIe 5.0 GPU power connectorsAMD accuses Intel’s Arrow Lake of being a ‘horrible’ product and implies a lack of options for consumers has caused the Ryzen 7 9800X3D shortageThis Jinx-inspired gaming PC is my favorite of CES 2025 and I’m head over heels for the hardwareHarrowing report alleges years of horrific abuse at Brandoville Studios, an Indonesian support studio that worked on Assassin’s Creed Shadows and The Last of Us RemakeTencent says it’s not a Chinese military company and is willing to sue the US Department of Defense if it isn’t removed from a blacklistAll Zenless Zone Zero 1.5 livestream codesAsus reveals three new Slash Travel Bags for carting around your ROG Ally—however, none of them are particularly fashion forwardToday’s Wordle answer for Friday, January 10We may not have a roadmap or balance patch just yet, but at least Path of Exile 2’s bugfix patch notes are funny

Most Popular

TikTok’s time in the US may be ticking to a close as it makes a last stand in the Supreme Court, though Trump now says he ‘opposes banning’ it

MSI intros cheaper ‘back connect’ Project Zero Intel motherboards for super-clean PC builds you might actually be able to afford

Thermaltake’s new 2000 W PSU is too powerful to be sold in the USA and comes with four PCIe 5.0 GPU power connectors

AMD accuses Intel’s Arrow Lake of being a ‘horrible’ product and implies a lack of options for consumers has caused the Ryzen 7 9800X3D shortage

This Jinx-inspired gaming PC is my favorite of CES 2025 and I’m head over heels for the hardware

Harrowing report alleges years of horrific abuse at Brandoville Studios, an Indonesian support studio that worked on Assassin’s Creed Shadows and The Last of Us Remake

Tencent says it’s not a Chinese military company and is willing to sue the US Department of Defense if it isn’t removed from a blacklist

All Zenless Zone Zero 1.5 livestream codes

Asus reveals three new Slash Travel Bags for carting around your ROG Ally—however, none of them are particularly fashion forward

Today’s Wordle answer for Friday, January 10

We may not have a roadmap or balance patch just yet, but at least Path of Exile 2’s bugfix patch notes are funny

HARDWARE BUYING GUIDESLATEST GAME REVIEWS1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads2Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop3Best mini PCs in 2025: The compact computers I love the most4Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands5Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested1Thank Goodness You’re Here! review2Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review3WD Black SN850X 8 TB NVMe SSD review4Ikea Utespelare desk review5Asus ROG Harpe Ace Mini wireless mouse review

HARDWARE BUYING GUIDESLATEST GAME REVIEWS

1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads

A bunch of the best Steam Deck accessories on a blue background.

1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads

Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads

2Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop

Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop

3Best mini PCs in 2025: The compact computers I love the most

Best mini PCs in 2025: The compact computers I love the most

4Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands

Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands

5Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested

Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested

1Thank Goodness You’re Here! review

Thank Goodness You’re Here review

1Thank Goodness You’re Here! review

Thank Goodness You’re Here! review

2Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review

Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review

3WD Black SN850X 8 TB NVMe SSD review

WD Black SN850X 8 TB NVMe SSD review

4Ikea Utespelare desk review

Ikea Utespelare desk review

5Asus ROG Harpe Ace Mini wireless mouse review

Asus ROG Harpe Ace Mini wireless mouse review

The biggest gaming news, reviews and hardware deals#

The biggest gaming news, reviews and hardware deals