Monday, December 1st 2025

Microsoft Warns: Windows 11 Agentic Features May Hallucinate

A few days ago, Microsoft announced that Windows 11 is undergoing an agentic overhaul. The company indirectly warned that security vulnerabilities may be exposed, and today they issued an updated notice. "As these capabilities are introduced, AI models still face functional limitations in terms of how they behave and occasionally may hallucinate and produce unexpected outputs." After installing Windows 11 Build 26220.7262, you'll find a new toggle for "Experimental agentic features" in Settings > System under "AI Components." Fortunately, this is an optional feature and must be enabled manually.

Upon turning the feature on, Windows will show a warning that these capabilities are experimental and might affect your device. In practice the security risk is the bigger concern. New attack techniques tied to autonomous agents are already appearing, with cross-prompt injection standing out. In those attacks, malicious instructions are concealed inside ordinary documents or interface elements so an agent follows them instead of its original task. That could allow an agent to install malware, leak payment details, or carry out other harmful actions.
Microsoft says these agents run inside an "Agentic Workspace," where each agent gets a scoped, auditable account and its actions are recorded for later review. The company compares this to Windows Sandbox, but agents are designed to persist and can continue to act on files across sessions, which expands the possible attack surface. By default an agent may be granted read and write access to common folders such as Downloads, Desktop, Documents, Pictures, Music and Videos. Even with limited action sets and separate execution accounts, those defaults leave gaps until Microsoft implements stronger protections like finer-grained permissions and robust defenses against prompt injection.
Sources: via Windows Latest, Microsoft
Add your own comment

68 Comments on Microsoft Warns: Windows 11 Agentic Features May Hallucinate

#4
TumbleGeorge
DeathtoGnomesm$ has some issues with priorities.
It makes sense that the interests of the majority of users do not matter. Otherwise, the interests of the company are undoubtedly being pursued.
Posted on Reply
#5
ymdhis
Microsoft warns: Windows 11 doesn't work as intended.
Posted on Reply
#6
AusWolf
In other news: A mere 4 years after release, Windows 11 still continues being a mess.

In yet other news: Microsoft doesn't give a crap about user safety, and can't be asked to properly test updates before rolling them out.

Brilliant!
Posted on Reply
#7
Hecate91
Microsoft knows this feature might break your install or delete files without your consent, they also admitted core features in W11 are broken but don't care.
Posted on Reply
#8
Space Lynx
Astronaut
i have updates disabled, so i don't really care what the idiots do
Posted on Reply
#9
EnviousFrog
Hecate91Microsoft knows this feature might break your install or delete files without your consent, they also admitted core features in W11 are broken but don't care.
They were "working on it". Now they're "thinking about it" because they want to be agentic. Didn't say anything about fixing it though.
Posted on Reply
#10
A Computer Guy
How can we confuse users and make their user experience more volatile ... Microsoft - well I asked AI and it has an idea...
Posted on Reply
#11
lexluthermiester
TumbleGeorgeDid anyone expect anything else?
Nope. And this is why it will NOT be allowed on my PC. It's like microsoft is actually trying to be incompetent morons..
ymdhisMicrosoft warns: Windows 11 doesn't work as intended.
That's half right. When you let microsoft control things, it doesn't work the way a competent OS should. When the end user actively controls it, everything runs fine.
Posted on Reply
#12
Verpal
As long as experimental AI features aren't turn on automatically, and actually declare the potential problem to users, I don't really see a huge issue here.
Posted on Reply
#13
qlum
May is putting it softly, LLM's we have now will hallucinate this is simply a limitation of the tech. A smaller model running locally will do that especially.
Posted on Reply
#14
A Computer Guy
VerpalAs long as experimental AI features aren't turn on automatically, and actually declare the potential problem to users, I don't really see a huge issue here.
I have a question as to whether or not these things can be turned on by malware? Imagine a compromised website advert hijacking your AI to order you 200 pizzas with your favorite toppings it deduced from the data it analyzed on your PC from recall.
Posted on Reply
#15
lemonadesoda
Space Lynxi have updates disabled, so i don't really care what the idiots do
Oh, if only I could trust MS not to update things I didn't want. It is such hard work to block W from forced updates. You do not opt in to updates. It is there. W does not offer an easy way to stop updates. You've got to use tools or registry edits. And doing those is often insufficient if you DO JUST ONE manual update, where the update reverts the system back to autoupdating. There will be a moment when you manually install security updates - and the security updates will reinstall other update agents and will force reinstall CoPilot (I had just his experience with a security update). Oh, just uninstall CoPilot, it's easy. Well f that. I should not have to run around trying to figure out what W has installed behind my back and wipe its bottom. Yesterday it was coPilot. Tomorrow it could be any or all of a hundred agents in addition to CoPilot with obscure names that require a registry trawl to discover. The horror show. And what about the Windows App Store? I have that disabled, but most people don't. So all it needs is MS to say "Apps don't work unless W App Store is up to date, click here to update to latest Store" and BOOM the App Store update agent initiates all the other fkrs.

I am so close to air-gapping my PC. Blacklist firewall everything. Only allow an obscure browser in a VM to punch through on port 80, with a whole range of blacklisted IP addresses. Basically MS ones.

I can only hope that some hackers really bring half the internet down for days incl. multiple government ministries so that MS finally gets public egg on face and receives multiple injunctions from multiple governments to STOP. Governments have to recognise that W and internet is now a basic utility, after water, electric, etc. and requires regulation. A windows lean, without bells and whistles and agentic crap, should become a requirement. Gvts would never allow water utilities to "experiment with the water".

And I can't wait for the AI bubble to burst so there is no longer "share price valuation metrics" driving these stupid decisions.
Posted on Reply
#16
xSneak
Feels like windows is imploding before our eyes from AI slop.
Posted on Reply
#17
CyberPomPom
lexluthermiesterThat's half right. When you let microsoft control things, it doesn't work the way a competent OS should. When the end user actively controls it, everything runs fine.
Yep.
That's the biggest issue, we can't expect everyone to be competent enough.

With agentic Copilot MS are giving those incompetent users more tools to break their system with the help from the faking "expert" AI.
Giving confidence and no limits to people who have no clue what they're doing is not a great feature.
Posted on Reply
#18
mb194dc
It just gets worse and worse...
Posted on Reply
#19
Space Lynx
Astronaut
lemonadesodaOh, if only I could trust MS not to update things I didn't want. It is such hard work to block W from forced updates. You do not opt in to updates. It is there. W does not offer an easy way to stop updates. You've got to use tools or registry edits. And doing those is often insufficient if you DO JUST ONE manual update, where the update reverts the system back to autoupdating. There will be a moment when you manually install security updates - and the security updates will reinstall other update agents and will force reinstall CoPilot (I had just his experience with a security update). Oh, just uninstall CoPilot, it's easy. Well f that. I should not have to run around trying to figure out what W has installed behind my back and wipe its bottom. Yesterday it was coPilot. Tomorrow it could be any or all of a hundred agents in addition to CoPilot with obscure names that require a registry trawl to discover. The horror show. And what about the Windows App Store? I have that disabled, but most people don't. So all it needs is MS to say "Apps don't work unless W App Store is up to date, click here to update to latest Store" and BOOM the App Store update agent initiates all the other fkrs.

I am so close to air-gapping my PC. Blacklist firewall everything. Only allow an obscure browser in a VM to punch through on port 80, with a whole range of blacklisted IP addresses. Basically MS ones.

I can only hope that some hackers really bring half the internet down for days incl. multiple government ministries so that MS finally gets public egg on face and receives multiple injunctions from multiple governments to STOP. Governments have to recognise that W and internet is now a basic utility, after water, electric, etc. and requires regulation. A windows lean, without bells and whistles and agentic crap, should become a requirement. Gvts would never allow water utilities to "experiment with the water".

And I can't wait for the AI bubble to burst so there is no longer "share price valuation metrics" driving these stupid decisions.
there are ways to stop windows from updating permanently and i have implemented those. i'm not worried at all of this changing, my rig is fully static on win 11 right now
Posted on Reply
#20
razaron
So what if it burns a few trees for a false positive.
What have trees ever done for me? The day trees start paying tax and contributing to the NHS, is the day I'll start caring.
/s
Posted on Reply
#21
Verpal
A Computer GuyI have a question as to whether or not these things can be turned on by malware? Imagine a compromised website advert hijacking your AI to order you 200 pizzas with your favorite toppings it deduced from the data it analyzed on your PC from recall.
I assume Malware can turn on function in your PC, provided that you are already hacked and the hacker is in full control.

But, then I ask the question...... won't the hacker/whatever program can already order 200 pizza with or without Windows recall/AI?
Posted on Reply
#22
AusWolf
Space Lynxthere are ways to stop windows from updating permanently and i have implemented those. i'm not worried at all of this changing, my rig is fully static on win 11 right now
Of course there is a way... By wiping your drive and installing an OS that actually works for you instead of against you. :D

Sorry, I'll see myself out.
Posted on Reply
#23
Tek-Check
How lovely! Hundreds of billions of dollars have been invested into AI. What does Wall Street say about hallucinations?

Not only AI tools write stupidly inaccurate and misleading summaries, as exposed by Steve Burke from Gamers Nexus yesterday, but it also hallucinates. In common language, it makes up $hit due to training algorithms that have bad data triangulation system built in. In other words, it has serious methodological flaws as to how data are sampled and cross-checked.

Also, there is no equivalent of peer review system in AI world, unlike in real world science, to spot those mistakes and eliminate it before replaying to users.

AI needs a psychotherapy, a deep one...
Posted on Reply
#24
kondamin
VerpalI assume Malware can turn on function in your PC, provided that you are already hacked and the hacker is in full control.

But, then I ask the question...... won't the hacker/whatever program can already order 200 pizza with or without Windows recall/AI?
Depends what the malicious actor wants.
If all he/she wants to do is just make you foot the bill for his pizza sure.

if they want to turn your life in to a nightmare having local AI gas light you in to suicide or worse is far more interesting.
Posted on Reply
#25
Hecate91
IMO, turning off updates really isn't a solution either, and can be a security risk of stopping a hot fix or vulnerability patch, but once you allow updates you'll just have to remove all the unnecessary crap again.
If you want control of the OS, Windows hasn't been an OS that lets you have control for a long time.
Posted on Reply
Add your own comment
Nov 15th, 2026 18:32 CST change timezone

New Forum Posts

Popular Reviews

TPU on YouTube

Controversial News Posts