An OpenAI safety employee has quit and is sounding the alarm
David Robinson used to write the safety reports that accompanied every major model release at OpenAI. This week, he resigned from his position and is now speaking out in an editorial in The Atlantic. It's understandable if you're feeling a bit cynical about everyone suddenly coming out of the woodwork to warn about how dangerous the thing they helped build is. They did, after all, make this mess. But that doesn't mean we should discount their warnings. Robinson says that the culture in industry is fundamentally broken. That this is a deeper issue than simply slapping a few new rules or regulations on how we handle training models. Silicon … Read the full story at The Verge.
Posts from this topic will be added to your daily email digest and your homepage feed.
An OpenAI safety employee has quit and is sounding the alarm
David Robinson used to write safety reports at OpenAI and now says its culture is ‘broken’
Posts from this author will be added to your daily email digest and your homepage feed.
See All by Terrence O'Brien
The AI Superintelligence Slowdown
is the Verge’s weekend editor. He’s covered the tech industry for over 18 years and knows a thing or two about synths.
David Robinson used to write the safety reports that accompanied every major model release at OpenAI. This week, he resigned from his position and is now speaking out in an editorial in The Atlantic.
It’s understandable if you’re feeling a bit cynical about everyone suddenly coming out of the woodwork to warn about how dangerous the thing they helped build is. They did, after all, make this mess. But that doesn’t mean we should discount their warnings.
Robinson says that the culture in industry is fundamentally broken. That this is a deeper issue than simply slapping a few new rules or regulations on how we handle training models. Silicon Valley has operated with “extreme confidence” and “perpetual sprints,” he says, building bigger and better models with “unimpeded optimism” that ignores or underestimates potential problems.
He says the time has come for AI companies to develop a sense of humility and look outside the insular, move-fast-and-break-things world of the tech industry. Specifically, he says AI needs nuclear-level safeguards:
Given today’s risks, frontier labs need to run like nuclear power plants or busy airports, with layers of redundancy and careful, time-consuming planning, so that the occasional and inevitable human error does not open a door to disaster.
Robinson is just the latest in a growing parade of researchers and safety workers who have left their positions at prominent AI firms. Jacob Coxon seems to have kicked off the exodus by quitting Anthropic and then publicly saying AI “could kill us all by the end of the decade.” He was followed by Robert O’Callahan, Bilal Chughtai, and Josh Engels at Google DeepMind, as well as Joe Benton at Anthropic.
Follow topics and authors from this story to see more like this in your personalized homepage feed and to receive email updates.
More in: The AI Superintelligence Slowdown
The FTC has reportedly opened an investigation into OpenAI and Anthropic.
AI researchers put out videos saying superintelligence is ‘exactly as dangerous as it sounds’
AI that improves itself could pose “extreme risks,” say leading AI researchers.
Keurig’s new machine uses plastic-free compressed coffee pucks
HP’s answer to the MacBook Neo is thinner, lighter, and comes with OLED
Nacon’s new PS5 controller can mix audio from your phone and console
Home Assistant says ‘Big tech ruined the cloud, so we’re out’
The People of Utah vs. Kevin O’Leary
A free daily digest of the news that matters most.
By providing your information, you agree to our Terms of Use and our Privacy Policy. We use vendors that may also process your information to help provide our services. This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
This is the title for the native ad