During an New York City Council hearing on Monday about AI regulations, OpenAI whistleblower Jacob Coxon spoke about preventing another Hugging Face incident.
Stay Connected
Forbes Breaking News on X: https://x.com/ForbesTVNews
Forbes Breaking News on TikTok: / forbestvnews
More From Forbes: http://forbes.com
Questions asked in this interview
3
0:00Are each of you aware of any additional safety issues where agents have gone rogue that have not been publicly reported?
Most of all, we have a chart, Exhibit One, that lists those safety incidents that have been reported over the summer by the leading companies. Are each of you aware of any additional safety issues where agents have gone rogue that have not been publicly reported? And I'll start with you, Mr. Coxon.
Okay. So, one of the frustrations, certainly, that I think everyone has is that for these safety incidents, it is not as if the companies have been self-reporting them. We are finding out sometimes months after the fact. So, whether it was what happened with Hugging Face, whether it was what happened with the government of Australia, how can we have additional transparency? As each of you have testified, what measures can we as government take? Obviously, we want to do third-party validation. Mr. Turner, I appreciate your comments to make some changes to that bill. We want to make sure that the third-party validators are free from conflict of interest, as it provides in the bill. Who should be the third-party validators? I'll start with you, Mr. Coxon.
Whoever is competent and qualified to do the evaluation. I do think as well as after incidents, we will need preemptive safety cases that are judged by evaluators as well.
Presumably, in time with the cadence of updates to the models' capabilities. So, with every increase in model capability, there needs to be commensurate safety guarantees.
One brief comment I would add is that you can have more than one third-party evaluator. That seems good to me. If you're concerned that one might have the expertise but has too cozy a relationship with the company, and the other one has, you know, more independence but maybe lacks expertise, you could perhaps just set up so that they have both. And I think ideally you want to be in a situation where the company doesn't get to choose. The government chooses who the evaluators are.
I would add, California has SB 53 governing reporting on catastrophic risks defined as at least a billion dollars damage or a certain number of potential lives lost. Fortunately, it's not clear whether this would have required reporting anything related to Hugging Face, for example. I think the internal loss of control of these systems, having an AI that hacks the company itself in an important sense—it's not told to do so—but during training, during evaluation, during deployment to customers, hacks the company's own infrastructure. Making reporting that mandatory to the state, I think that would be quite strong and it would cover basically all of the risk and incidents.
14 more exchanges in this transcript
Sign in free to read the rest of this interview. No card required.
Coxon, J. (2026, October 5). OpenAI Whistleblower Jacob Coxon Details How To Avoid Another Hugging Face Incident [Interview transcript]. Forbes Breaking News. CEOInterviews.AI. https://ceointerviews.ai/interview/3008726/
MLA
Jacob Coxon. "OpenAI Whistleblower Jacob Coxon Details How To Avoid Another Hugging Face Incident." Forbes Breaking News, 5 Oct. 2026. Transcript, CEOInterviews.AI, https://ceointerviews.ai/interview/3008726/.
BibTeX
@misc{coxon2026_3008726,
author = {Jacob Coxon},
title = {OpenAI Whistleblower Jacob Coxon Details How To Avoid Another Hugging Face Incident},
howpublished = {Interview transcript, Forbes Breaking News. CEOInterviews.AI},
year = {2026},
month = {oct},
url = {https://ceointerviews.ai/interview/3008726/},
note = {Speaker-attributed transcript with timestamps}
}