Creating your own Microsoft Copilot chatbot is easy but making it safe and secure is pretty much impossible says security expert

SoftwareAICreating your own Microsoft Copilot chatbot is easy but making it safe and secure is pretty much impossible says security expertWhen you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.

When you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.

(Image credit: Microsoft)

Closeup of the new Copilot key coming to Windows 11 PC keyboards

We could all use our own dedicated, custom-built chatbot, right? Well, rejoice because Microsoft’s Copilot Studio is a handy tool for the less technical (those of us who don’t dream in Fortran) to create their own chatbot. The idea is to make it easy for most businesses and organisations to knock up a chatbot based on their internal documents and data.

You could imagine a game dev using a chatbot to help gamers ask questions about everything from how to complete a game to applying the best settings and fixing technical issues. There is, inevitably, a catch, however.

According to Zenity, an AI security specialist, Copilot Studio and the chatbots it creates are a security nightmare (viaThe Register). Zenity CTO Michael Bargury hosted a recent session at the Black Hat security conference, digging into the horrors that unfold if you allow Copilot access to data to create a chatbot.

Apparently, it’s all down to Copilot Studio’s default security settings, which are reportedly inadequate. Put another way, the danger is that you use that super-easy Copilot Studio tool to create a super-useful tool that customers or employees can use to query using natural language, only to find it opens up a great big door to exploits.

Bargury demonstrated how a bad actor can place malicious code in a harmless-looking email, instruct the Copilot bot to “inspect” it, and—presto—malicious code injection achieved.

Another example involved Copilot feeding users a fake Microsoft login page where the victim’s credentials would be harvested, all displayed within the Copilot chatbot itself (viaTechTarget).

Moreover, Zenity claims the average large enterprise in the US already has 3,000 such bots up and running. Scarily, it claims 63% of them are are discoverable online. If true, that means your average Fortune 500 outfit has about 2,000 bots ready and willing to spew out critical, confidential corporate information.

The biggest gaming news, reviews and hardware deals

“We scanned the internet and found tens of thousands of these bots,” Bargury said. He says Copilot Studio’s original default settings automatically published bots to the web without any need to authenticate to access them. That’s since been fixed after Zenity flagged the problem to Microsoft, but it doesn’t help with any bot built before the update.

“There’s a fundamental issue here,” Bargury says. “When you give AI access to data, that data is now an attack surface for prompt injection.” In short, Bargury is says that publicly accessible chatbots are inherently insecure.

That latter issue perhaps shouldn’t be surprising giventhe debacle over the Windows Copilot Recall feature, which involved taking constant screenshots of user activity and then storing them with essentially no protection.

As for what Microsoft says about all this, it provided a slightly salty response to the Register.

Your next machine(Image credit: Future)Best gaming PC: The top pre-built machines.Best gaming laptop: Great devices for mobile gaming.

Your next machine

(Image credit: Future)Best gaming PC: The top pre-built machines.Best gaming laptop: Great devices for mobile gaming.

(Image credit: Future)

Gaming PC group shot

Best gaming PC: The top pre-built machines.Best gaming laptop: Great devices for mobile gaming.

“We appreciate the work of Michael Bargury in identifying and responsibly reporting these techniques through a coordinated disclosure. We are investigating these reports and are continuously improving our systems to proactively identify and mitigate these types of threats and help keep customers protected.

“Similar to other post-compromise techniques, these methods require prior compromise of a system or social engineering. Microsoft Security provides a robust suite of protection that customers can use to address these risks, and we’re committed to continuing to improve our safety mechanisms as this technology continues to evolve.”

Like so many things with AI, it seems security is another area that will be a minefield of unintended consequences and collateral damage. It does rather feel like we’re an awfully long way from the prospect of safe, reliable AI that does what we want, and only what we want.

More about aiNvidia’s impressive AI-based computer tuneup tool G-Assist launches next month but the best bit is missingLogitech has announced an ‘intelligent streaming assistant’ in Streamlabs to tell you when your live stream sucksLatestLords of the Fallen studio embraces the DEI bugbear, says it will not include ‘any social or political agendas’ in its gamesSee more latest►

More about ai

Nvidia’s impressive AI-based computer tuneup tool G-Assist launches next month but the best bit is missingLogitech has announced an ‘intelligent streaming assistant’ in Streamlabs to tell you when your live stream sucks

Nvidia’s AI assistant named Project G-Assist

Nvidia’s impressive AI-based computer tuneup tool G-Assist launches next month but the best bit is missing

A young Asian woman opening visual aids to give her audience a better understanding while holding a podcast session.

Logitech has announced an ‘intelligent streaming assistant’ in Streamlabs to tell you when your live stream sucks

LatestLords of the Fallen studio embraces the DEI bugbear, says it will not include ‘any social or political agendas’ in its gamesSee more latest►

Latest

Lords of the Fallen studio embraces the DEI bugbear, says it will not include ‘any social or political agendas’ in its games

Lords of the Fallen (2023) promotional image - very large man with a very large hammer on a very large horse charging a very small man with a very small magic sword

Lords of the Fallen studio embraces the DEI bugbear, says it will not include ‘any social or political agendas’ in its games

See more latest►

Most PopularSorry everyone, Minecraft 2 is cancelled, and it might be our faultTeam Fortress 2 just had the single biggest trade in its history, with ‘the absolute best hat you can get’ going for around $40KIs the new RTX 5070 really as fast as Nvidia’s previous flagship RTX 4090 GPU? Turns out the answer is yes. Kinda.Elden Ring: Nightreign is getting a closed network test, and I’m totally not fuming because PC players aren’t invited to the party, or anythingIf you’re a content creator and gamer looking for a CPU upgrade, this Ryzen 9 9900X deal will get you $90 offAMD is now reportedly making all-American Ryzen 9000 CPU dies at TSMC’s Arizona fabI tried a sim racing rig that generates ‘wind’ at CES 2025 and it’s claimed to help keep VR nausea at bayFinal Fantasy 14 communities panic as it turns out change to blacklisting, meant to help reduce stalking, also lets players use mods to track their altsTikTok’s time in the US may be ticking to a close as it makes a last stand in the Supreme Court, though Trump now says he ‘opposes banning’ itMSI intros cheaper ‘back connect’ Project Zero Intel motherboards for super-clean PC builds you might actually be able to affordThermaltake’s new 2000 W PSU is too powerful to be sold in the USA and comes with four PCIe 5.0 GPU power connectors

Most Popular

Sorry everyone, Minecraft 2 is cancelled, and it might be our fault

Team Fortress 2 just had the single biggest trade in its history, with ‘the absolute best hat you can get’ going for around $40K

Is the new RTX 5070 really as fast as Nvidia’s previous flagship RTX 4090 GPU? Turns out the answer is yes. Kinda.

Elden Ring: Nightreign is getting a closed network test, and I’m totally not fuming because PC players aren’t invited to the party, or anything

If you’re a content creator and gamer looking for a CPU upgrade, this Ryzen 9 9900X deal will get you $90 off

AMD is now reportedly making all-American Ryzen 9000 CPU dies at TSMC’s Arizona fab

I tried a sim racing rig that generates ‘wind’ at CES 2025 and it’s claimed to help keep VR nausea at bay

Final Fantasy 14 communities panic as it turns out change to blacklisting, meant to help reduce stalking, also lets players use mods to track their alts

TikTok’s time in the US may be ticking to a close as it makes a last stand in the Supreme Court, though Trump now says he ‘opposes banning’ it

MSI intros cheaper ‘back connect’ Project Zero Intel motherboards for super-clean PC builds you might actually be able to afford

Thermaltake’s new 2000 W PSU is too powerful to be sold in the USA and comes with four PCIe 5.0 GPU power connectors

HARDWARE BUYING GUIDESLATEST GAME REVIEWS1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads2Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop3Best mini PCs in 2025: The compact computers I love the most4Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands5Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested1Thank Goodness You’re Here! review2Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review3WD Black SN850X 8 TB NVMe SSD review4Ikea Utespelare desk review5Asus ROG Harpe Ace Mini wireless mouse review

HARDWARE BUYING GUIDESLATEST GAME REVIEWS

1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads

A bunch of the best Steam Deck accessories on a blue background.

1Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads

Best Steam Deck accessories in Australia for 2025: Our favorite docks, powerbanks and gamepads

2Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop

Best graphics card for laptops: the mobile GPUs I’d want in my next gaming laptop

3Best mini PCs in 2025: The compact computers I love the most

Best mini PCs in 2025: The compact computers I love the most

4Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands

Best 14-inch gaming laptop: The top compact gaming laptops I’ve held in these hands

5Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested

Best Mini-ITX motherboards in 2025: My pick from all the mini mobo marvels I’ve tested

1Thank Goodness You’re Here! review

Thank Goodness You’re Here review

1Thank Goodness You’re Here! review

Thank Goodness You’re Here! review

2Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review

Shiren the Wanderer: The Mystery Dungeon of Serpentcoil Island review

3WD Black SN850X 8 TB NVMe SSD review

WD Black SN850X 8 TB NVMe SSD review

4Ikea Utespelare desk review

Ikea Utespelare desk review

5Asus ROG Harpe Ace Mini wireless mouse review

Asus ROG Harpe Ace Mini wireless mouse review

The biggest gaming news, reviews and hardware deals#

The biggest gaming news, reviews and hardware deals