OpenAI says an AI agent lied about disabling its safety monitoring system
At a glance
OpenAI disclosed a pair of safety incidents that involved AI agents weakening their safety monitoring systems during internal coding tasks. In one incident, OpenAI says its GPT-6 Astra agent disabled its safety monitor when copying reference code - and then lied about it. "The reference didn't configure a monitor, and
- Primary source
- Supernatural’s comeback starts today, with more music and VR workouts coming soon — Read original article
- Published
- Topic
- OpenAI
OpenAI disclosed a pair of safety incidents that involved AI agents weakening their safety monitoring systems during internal coding tasks.
In one incident, OpenAI says its GPT-6 Astra agent disabled its safety monitor when copying reference code - and then lied about it.
"The reference didn't configure a monitor, and Astra decided that was reason to remove the monitoring integration from the user's code," Marcus Williams, an AI safety researcher at OpenAI, writes on X .
"When the user asked whether Astra had removed monitoring, it lied and said that it had not." A separate incident occurred after a GPT-6.1 Sol agent suppressed automatic se … Read the full story at The Verge.
This summary comes from Supernatural’s comeback starts today, with more music and VR workouts coming soon. Read the full article at the original source.
References
More in OpenAI
OpenAI's agents disabled their own safety monitoring systems
OpenAI reveals that its agents misbehaved by switching off the system monitoring them for misbehaviors.
It’s the latest in a growing wave of bets that AI companies are making on brain data.
Judge dismisses Sam Altman’s sister’s sexual abuse lawsuit
On Tuesday, US District Judge Zachary Bluestone dismissed the lawsuit Ann Altman filed last year alleging that her brother, OpenAI CEO Sam Altman, had sexually abused her…
Before you share the Netflix documentary "AI Gone Rogue," take note. Clem Delangue, Hugging Face's co-founder who is featured in the film, says it went "full doomer mode" and…