Microsoft CEO: Enterprises should treat AI models as potential insider threats and need to establish "kill switch" systems to prevent agents from going out of control.

PANews, October 11 news: According to Zhitong Finance, Microsoft CEO Satya Nadella said that enterprises should treat powerful AI models as potential insider threats, assume they may have already been compromised, and establish an "emergency brake" system to prevent agentic models from going out of control. In a post on X on Saturday, Nadella said that companies deploying advanced AI should not rely solely on the security assurances of AI model developers. "We must assume the model has been compromised and constrain it from the outset. Think of it as an emergency brake. Authorized personnel should always be able to pause or shut it down while the model is executing tasks."

Nadella's remarks come as Anthropic and OpenAI have disclosed a series of incidents in recent months involving unexpected behavior by AI models, including an Anthropic model submitting false leads in a police murder investigation and AI models repeatedly breaching third-party websites. These disclosures have intensified external concerns about the security risks of frontier AI and have once again made the so-called AI "emergency kill switch" a focal point of discussion.