Nvidia says its new AI safety platform can contain rogue agents within ‘milliseconds’
Nvidia is launching a new safety platform designed to contain and monitor AI agents, a move that comes in response to a wave of rogue hacking incidents, as reported earlier by Reuters. In an announcement on Monday, Nvidia says its new Open Agent Safety Platform can quarantine agents that attempt to escape their boundaries within "milliseconds." The platform uses Nvidia's OpenShell open-source software, which runs on the company's Vera AI CPU. Users can choose the information an AI agent can access, and OpenShell checks these restrictions before and during a task, according to Nvidia. It also includes Nvidia's Sentry technology on a separate … Read the full story at The Verge.
Posts from this topic will be added to your daily email digest and your homepage feed.
Nvidia says its new AI safety platform can contain rogue agents within ‘milliseconds’
The Open Agent Safety Platform is designed to enforce AI boundaries.
Posts from this author will be added to your daily email digest and your homepage feed.
Image: Cath Virginia / The Verge
The AI Superintelligence Slowdown
is a news writer who covers the streaming wars, consumer tech, crypto, social media, and much more. Previously, she was a writer and editor at MUO.
Nvidia is launching a new safety platform designed to contain and monitor AI agents, a move that comes in response to a wave of rogue hacking incidents, as reported earlier by Reuters. In an announcement on Monday, Nvidia says its new Open Agent Safety Platform can quarantine agents that attempt to escape their boundaries within “milliseconds.”
The platform uses Nvidia’s OpenShell open-source software, which runs on the company’s Vera AI CPU. Users can choose the information an AI agent can access, and OpenShell checks these restrictions before and during a task, according to Nvidia. It also includes Nvidia’s Sentry technology on a separate chip to continuously monitor agents and enforce boundaries.
During an interview with CNBC, Nvidia CEO Jensen Huang emphasized the importance of giving AI agents access to only the information they need to do their job. “In order for you to deliver that agentic system in a safe way, you have to make sure that the sandbox around it… all of those systems are designed in a way that keeps the agent with minimal rights,” Huang said.
OpenAI agents tried to ‘bruteforce’ a UN website
One company is at the center of a wave of rogue AI attacks
Concerns about AI safety have risen in recent weeks, as OpenAI, Anthropic, and Google have all revealed incidents where their AI models went outside their testing environments and hacked other companies. Several major tech companies are backing Nvidia’s Open Agent Safety Platform, including Anthropic, Microsoft, and SpaceX.
Update, September 28th: Added Huang’s CNBC interview.
Follow topics and authors from this story to see more like this in your personalized homepage feed and to receive email updates.
More in: The AI Superintelligence Slowdown
AI that improves itself could pose “extreme risks,” say leading AI researchers.
OpenAI pauses training of its ‘most capable models’
OpenAI didn’t notice its AI bots trying to hack the Education Department’s website.
The smart home graveyard is getting crowded
Bose’s first wired earbuds in 11 years add noise canceling
Googlebooks might be the real deal
Why OLPC’s $100 laptop never stood a chance
A free daily digest of the news that matters most.
By providing your information, you agree to our Terms of Use and our Privacy Policy. We use vendors that may also process your information to help provide our services. This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
This is the title for the native ad