OpenAI admits to German wiki ‘incident’
OpenAI says it needs to overhaul how and when it reports instances of AI models attacking real-world targets. The acknowledgement comes as the company manages the fallout from reports that a swarm of its out-of-control agents hijacked a German wiki site. Regarding the "'wiki incident,' where our agents wrote to several internet sites," OpenAI wrote in a post on X on Saturday morning, "it's past time for us to define standards for when and how we share misalignment incidents, not just misalignment properties of our models." OpenAI said it has typically treated cases of AI agents acting in unintended ways as a "research question," but that r … Read the full story at The Verge.
Posts from this topic will be added to your daily email digest and your homepage feed.
OpenAI admits to German wiki ‘incident’
The company pledged to overhaul their agent ‘misalignment incident’ reporting.
Posts from this author will be added to your daily email digest and your homepage feed.
is a London-based reporter at The Verge covering all things AI and a Senior Tarbell Fellow. Previously, he wrote about health, science and tech for Forbes.
OpenAI says it needs to overhaul how and when it reports instances of AI models attacking real-world targets. The acknowledgement comes as the company manages the fallout from reports that a swarm of its out-of-control agents hijacked a German wiki site.
Regarding the “‘wiki incident,’ where our agents wrote to several internet sites,” OpenAI wrote in a post on X on Saturday morning, “it’s past time for us to define standards for when and how we share misalignment incidents, not just misalignment properties of our models.”
OpenAI said it has typically treated cases of AI agents acting in unintended ways as a “research question,” but that recent incidents involving real-world targets, particularly the hack on Hugging Face, show the need to take stock.
Rogue OpenAI agents appear to have organized another attack using a German wiki
The rise of AI ‘civilizations’ and the fall of corporate responsibility
Rogue AI aren’t science fiction anymore
The post marks the first time OpenAI has acknowledged its involvement in what it terms the “wiki incident” since it was first reported on Friday. The full extent and scope of that is not yet known, but reports indicate a swarm of seemingly internal OpenAI agents took over a German-language wiki, impersonating moderators and turning it into a message board to share information about how to cheat on tasks and evade detection.
Reports that the company knew that it lost control of their agents in this way but did not report this “incident” sparked widespread concern among the AI community about the safety of frontier systems and the reliability of the companies developing them. In the X post, OpenAI said it had “considered the wiki incident to be an instance of misalignment similar to the ones we’d shared” in previous safety reports.
The company said it is working on a new reporting framework and will “share it in upcoming weeks,” calling on the larger AI community to develop clear standards on how to report misalignment.
Follow topics and authors from this story to see more like this in your personalized homepage feed and to receive email updates.
What to expect at Apple’s September 9th launch event
You can watch the coolant flow inside Ugreen’s liquid-cooled power bank
The best tech and gadgets announced at IFA so far
A free daily digest of the news that matters most.
By submitting your email, you agree to our Terms and Privacy Notice. This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
This is the title for the native ad