Satya Nadella says we should assume all AI models are ‘compromised’
In a lengthy post on X, Microsoft's CEO laid out his views on the dangers posed by highly advanced AI models and how to confront those risks. Nadella says we can no longer accept a world where AI is treated as a "set of nested black boxes" whose advice and actions we simply accept or reject. He calls for building a more transparent system where models can be contained, observed, and leaves behind "tamper-proof human readable evidence." Many of his recommendations align with what we've heard from others in the industry: timely incident disclosure, independent audits, verifiable data, and containment. It's on that last point that he appears t … Read the full story at The Verge.
Posts from this topic will be added to your daily email digest and your homepage feed.
Satya Nadella says we should assume all AI models are ‘compromised’
Microsoft’s CEO calls for putting an ‘emergency brake’ on AI.
Posts from this author will be added to your daily email digest and your homepage feed.
See All by Terrence O'Brien
Image: Cath Virginia / The Verge, Getty Images
The AI Superintelligence Slowdown
is the Verge’s weekend editor. He’s covered the tech industry for over 18 years and knows a thing or two about synths.
In a lengthy post on X, Microsoft’s CEO laid out his views on the dangers posed by highly advanced AI models and how to confront those risks. Nadella says we can no longer accept a world where AI is treated as a “set of nested black boxes” whose advice and actions we simply accept or reject. He calls for building a more transparent system where models can be contained, observed, and leaves behind “tamper-proof human readable evidence.”
Many of his recommendations align with what we’ve heard from others in the industry: timely incident disclosure, independent audits, verifiable data, and containment. It’s on that last point that he appears to go slightly farther than some others in the field, saying:
We must assume a model is compromised and contain it from the start. Think of it like an emergency brake. An authorized person should always be able to pause or shut down a model mid-task. More advanced models will require more advanced containment technologies that we need to standardize on.
Unfortunately, Nadella also refers to AI as “super intelligence” throughout the post.
Follow topics and authors from this story to see more like this in your personalized homepage feed and to receive email updates.
More in: The AI Superintelligence Slowdown
Anthropic is cutting off its internal evaluations from the internet
Anthropic published a report about investigating “unintended model actions” during “evaluations and internal use.”
Anthropic’s AI gave Philadelphia police a fake tip about an unsolved homicide
Decade-old RAM is making a comeback
‘Pure insanity’: Mathematicians will need years to make sense of OpenAI’s latest drop
GTA VI leaks continue with a lengthy (and very nude) gameplay video
The Telo MT1 is a big truck trapped in a tiny truck’s body
A free daily digest of the news that matters most.
By providing your information, you agree to our Terms of Use and our Privacy Policy. We use vendors that may also process your information to help provide our services. This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
This is the title for the native ad