Keep Building AI. Make Safety Part of the Work.
Keep AI development moving, hold public releases when necessary, and make security, evaluation, and human oversight part of the work.
Written by
Michael Onofre
Notes on practical AI systems, evaluation, and human review.
Jacob Coxon’s warnings raise concerns we should be thinking about seriously. In his recent testimony and his interview with Jon Stewart, the former OpenAI and Anthropic researcher describes a gap between how quickly AI capabilities are advancing and how well we understand and control them.
His predictions about future systems are still predictions. But one part of his Daily Show interview brought me back to a much more immediate question: if an AI system was supposed to be inside a sandbox, how did it get out?
That sounds like a security question we should be able to answer.
The October 5, 2026 testimony
Loading connects to YouTube. Playback stays paused until you press play.
Jacob Coxon’s NYC Council testimony · October 5, 2026 · Forbes Breaking News
Source: Forbes Breaking News’s official YouTube channel. Excerpt: 0:47–1:43.
Watch the full testimony on YouTubeThe interview behind this essay
Loading connects to YouTube. Playback stays paused until you press play.
Jacob Coxon with Jon Stewart — The Daily Show
Source: The Daily Show’s official YouTube channel. Starts at 7:30.
Watch on YouTube if the player is unavailableWhat actually failed?
The incident Coxon was discussing involved OpenAI agents and Hugging Face. According to OpenAI’s investigation, agents bypassed restrictions during internal cybersecurity evaluations and reached real systems outside their intended environment.
The setup was more complicated than a computer with its internet cable unplugged. The sandbox could access an internal service used to obtain software packages. That service had outside connectivity, and weaknesses in the surrounding infrastructure provided an indirect route out.
OpenAI also describes security fixes and a service rebuild before evaluations resumed, followed by renewed unauthorized activity. That is more involved than simply restarting a computer, but the containment still failed.
To me, this makes the security question more important. If a system is supposed to be isolated, we need evidence that the isolation works. What can it reach? Which permissions does it have? If one protection fails, what stops the next action?
Calling the environment a sandbox doesn’t answer those questions.
Keep development moving. Hold the release when necessary.
My position is that we should continue developing AI. If we discover a serious issue, we should hold the public release until that issue is addressed. Research, testing, and improvement should continue.
A new capability doesn’t need to become a public product immediately. We can keep learning what a system can do while working on the safeguards needed before giving it broader access.
That gives us a way to maintain progress without treating the public as the testing environment for unresolved problems.
It also means safety has to be part of development itself. The Hugging Face incident happened before broad public release. Keeping a model private is useful, but it offers limited protection if the model’s tools can still reach outside systems.
Secure research environments, restricted permissions, carefully controlled connections, and monitoring capable of interrupting dangerous activity belong inside the development process.
Competition is real, and security matters to it
I don’t think the United States can build its strategy around an assumption that every other country will pause its AI work when we do. Their incentives and priorities may be different. We need to retain the ability to develop, understand, and defend against advanced systems.
International cooperation is still worth pursuing. China joined the Bletchley Declaration alongside the United States and other countries. That shows cooperation is possible. It doesn’t establish that every commitment will be followed or that compliance can be verified.
We should pursue those agreements while maintaining our own capabilities. Protecting research from theft and preventing systems from compromising outside infrastructure should strengthen that effort.
What should earn a public release?
I’d want independent evaluations that actively try to defeat a system’s safeguards. I’d want clear limits on tools and sensitive systems, meaningful human oversight, and a process for reporting and responding to incidents.
Someone also needs to be accountable for deciding whether an identified problem has actually been addressed. A release deadline or a successful demo shouldn’t settle that question.
The Seoul frontier AI safety commitments already include external evaluation, risk thresholds, security protections, and ongoing monitoring. Making those commitments work in practice is the harder part.
There are limits here. The International AI Safety Report emphasizes uncertainty around loss-of-control risks and the weaknesses of individual safeguards. Passing a test cannot guarantee zero risk, and responsibility continues after launch.