Microsoft’s Satya Nadella says AI models need an ‘emergency brake’

TechCrunch AI News

Summary

微软CEO Satya Nadella发文呼吁为AI模型建立“紧急制动”机制,主张将模型与编排层分离、外部化安全控制,并要求对模型操作保留可人工暂停和追溯的证据。

In a Saturday morning post, Microsoft's CEO wrote that it’s time “to step back and assess the trust architecture” of AI.
Original Article
View Cached Full Text

Cached at: 10/11/26, 12:32 AM

# Microsoft’s Satya Nadella says AI models need an ‘emergency brake’ | TechCrunch Source: [https://techcrunch.com/2026/10/10/microsofts-satya-nadella-says-ai-models-need-an-emergency-brake/](https://techcrunch.com/2026/10/10/microsofts-satya-nadella-says-ai-models-need-an-emergency-brake/) In Brief Posted: 2:47 PM PDT · October 10, 2026 ![Satya Nadella at Microsoft Ignite 2023](https://techcrunch.com/wp-content/uploads/2023/11/satya-nadella-2_web.png?w=1000)**Image Credits:**Dan DeLongMicrosoft CEO Satya Nadella is the latest tech executive to offer lengthy thoughts on how AI safety might be improved\. In[a Saturday morning post on X](https://x.com/satyanadella/status/2108931348857827686), Nadella wrote that it’s time “to step back and assess the trust architecture” of AI\. “We can’t treat Super Intelligence as a set of nested black boxes and simply accept or reject its recommendations, answers, and actions,” Nadella wrote, using[the Trump administration’s preferred term for AI](https://techcrunch.com/2026/10/04/can-super-intelligence-and-a-non-binding-safety-pact-solve-ais-image-problem/)\. As outlined by Nadella, this approach “means separating the model from the harness that orchestrates its work,” as well as “externalizing controls and safeguards\.” He also called for “every meaningful model action” to be documented with “tamper\-proof human readable evidence,” and for systems where “an authorized person” always has the ability “to pause or shut down a model mid\-task\.” “We must assume a model is compromised and contain it from the start,” he said\. “Think of it like an emergency brake\.” Nadella’s comments come as leading AI companies acknowledge more and more incidents where[they seemed to lose control of their models](https://techcrunch.com/2026/10/09/anthropic-cant-reliably-control-its-ai-agents-its-cutting-off-its-internal-evals-from-the-live-internet-instead/), and after[Anthropic CEO Dario Amodei published a plan](https://techcrunch.com/2026/09/12/anthropic-ceo-outlines-plan-to-pace-the-frontier/)for more cautious AI development\. ### Newsletters Subscribe for the industry’s biggest tech news ## Related ## Latest in AI

Similar Articles

Microsoft's Nadella says AI needs an ‘emergency brake' that humans control (2 minute read)

TLDR AI

Microsoft CEO Satya Nadella called for advanced AI systems to include containment, independent controls, and a human-controlled 'emergency brake' to pause or shut down models mid-task, proposing deterministic system design around non-deterministic models. His comments add to industry safety warnings while contrasting with the Trump administration's stance against slowing U.S. AI development.

Satya Nadella has issued a shocking warning to companies using AI

TechCrunch AI

Microsoft CEO Satya Nadella warns that companies using AI models from labs like OpenAI and Anthropic are unknowingly handing over proprietary business data, and advocates for companies to retain ownership of their data and build orchestration layers to switch between models.