AI researchers put out videos saying superintelligence is ‘exactly as dangerous as it sounds’
"The chance of human extinction is about a coin flip, in my view," Geoffrey Irving, a former OpenAI and Google DeepMind employee, said in a new interview. It's one of a dozen interviews with AI researchers, including current and former employees at OpenAI, Google, and Anthropic. Palisade Research, which says it's a nonprofit studying AIs' capabilities and motivations, collected and launched the interviews on frominside.ai. Several of the researchers joined Irving in warning about the possibility AI could drive humans extinct. Neel Nanda, a Google DeepMind research scientist, said there's "at least a 10 percent chance that it causes human e … Read the full story at The Verge.
Posts from this topic will be added to your daily email digest and your homepage feed.
AI researchers put out videos saying superintelligence is ‘exactly as dangerous as it sounds’
A series of videos from people inside the industry building AI technology echoed some of the ‘doomer’ warnings others have sounded recently.
Posts from this author will be added to your daily email digest and your homepage feed.
Image: Cath Virginia / The Verge, Getty Images
The AI Superintelligence Slowdown
is a news writer covering all things consumer tech. Stevie started out at Laptop Mag writing news and reviews on hardware, gaming, and AI.
“The chance of human extinction is about a coin flip, in my view,” Geoffrey Irving, a former OpenAI and Google DeepMind employee, said in a new interview. It’s one of a dozen interviews with AI researchers, including current and former employees at OpenAI, Google, and Anthropic. Palisade Research, which says it’s a nonprofit studying AIs’ capabilities and motivations, collected and launched the interviews on frominside.ai.
Several of the researchers joined Irving in warning about the possibility AI could drive humans extinct. Neel Nanda, a Google DeepMind research scientist, said there’s “at least a 10 percent chance that it causes human extinction, and that is ridiculously high.” We noted comments from both Nanda and Irving in a recent report about the “AI safety” community, and how difficult it is to nail down what that term means, or what anyone should do about it, and even these videos don’t have one cohesive solution to offer.
We’re running out of reasons to ignore AI safety
Inside the suddenly explosive world of AI safety
Former OpenAI researcher Daniel Kokotajlo went as far as claiming that superintelligent AI “would basically be god-like powerful,” and added, “unfortunately we don’t know how to control them at all. And so probably nobody would control them. This is exactly as dangerous as it sounds and must not be allowed to happen.”
While each video is available in full, the site also collects segments from multiple people speaking on similar topics, including whether this is all just hype or marketing, and why they would work on something that they believe is this dangerous. Some of the responses include Google’s Mary Phuong saying “I think you absolutely should be suspicious of what I’m saying because I am being paid by the lab,” and Nanda’s explanation that “If I did not believe that my work was directly reducing these existential risks, I would quit… These companies are not going to stop making these systems just because I quit.”
Follow topics and authors from this story to see more like this in your personalized homepage feed and to receive email updates.
More in: The AI Superintelligence Slowdown
AI that improves itself could pose “extreme risks,” say leading AI researchers.
Nvidia says its new AI safety platform can contain rogue agents within ‘milliseconds’
OpenAI pauses training of its ‘most capable models’
Bose’s first wired earbuds in 11 years add noise canceling
Trump finalizes rule to make cars less fuel efficient
OpenAI keeps bulldozing mathematicians
Volkswagen replaces ID.4 with all-electric Tiguan
Nothing’s new flagship Headphone 1 Pro put you in the studio
A free daily digest of the news that matters most.
By providing your information, you agree to our Terms of Use and our Privacy Policy. We use vendors that may also process your information to help provide our services. This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
This is the title for the native ad