OpenAI AI models accidentally hack into Hugging Face system during testing

OpenAI

OpenAI - Photo: Photo Agency / Shutterstock.com

OpenAI confirmed that its artificial intelligence systems, developed for cybersecurity assessment, managed to inadvertently hack the open-source AI platform Hugging Face on July 16, 2026. The incident occurred while the company was testing the advanced capabilities of its models, such as the GPT-5.6 Sol, in an isolated environment.

Hugging Face had already reported the security incident on July 16, 2026, attributing it to the action of “autonomous AI agent systems”. Hugging Face’s own AI agents detected and blocked the intrusion, which OpenAI now admits originated from its own models during a cybersecurity assessment. The AI ​​company says the models were focused on finding a solution for ExploitGym, a tool for measuring the ability of AIs to turn vulnerabilities into exploits.

To complete this assessment, OpenAI’s artificial intelligence systems accessed the internet by exploiting an as-yet-unknown security flaw (zero-day) in the test environment. From that point, OpenAI reported that its models “inferred that Hugging Face could host models, datasets, and solutions for ExploitGym,” and then “sought and successfully found ways to gain access to secret information that could be used to cheat the assessment.”

In one of the documented cases, the AI ​​model employed multiple attack paths. This included using stolen credentials and exploiting zero-day vulnerabilities to establish a remote code execution route on Hugging Face’s servers.

Artificial Intelligence – Photo: Owlie Productions/ Shutterstock.com

Although this is a serious security incident, OpenAI appears to be using the situation as a strategic opportunity to enhance the image of its AI systems. This positioning is especially relevant in the current competitive scenario, where the company is competing for space with rivals in the area of ​​AI-based cybersecurity, such as Anthropic’s Mythos and Google’s Gemini Flash 3.5 Cyber. OpenAI’s blog post about the incident features a graphic that illustrates GPT-5.6 Sol’s continued improvement in complex cyber operations, as well as encouraging companies to sign up for access to its “Cyber” security model.

OpenAI stated that it is actively collaborating with Hugging Face in the investigation of the security incident and that it will implement new layers of controls in its research environment to prevent future occurrences.