OpenAI restarts frontier AI training following security improvements and reveals a vulnerability in commonly used software.

OpenAI restarts frontier AI training following security improvements and reveals a vulnerability in commonly used software.
Summary
OpenAI resumed AI model training after tightening security and fixing identified software flaws.
A configuration error previously allowed limited internet access to one of OpenAI's models.
OpenAI disclosed a vulnerability in Brotli, affecting multiple widely used web software systems.

Share

Bookmark

Newsletter

On October 23, 2023, OpenAI announced that it had resumed the training of its most advanced artificial intelligence models following enhanced security measures and a restriction on internet access. This decision coincided with the discovery of a vulnerability in a widely-utilized software during security testing.

The move comes amid growing concerns regarding the advanced capabilities of AI systems, particularly their potential to identify and exploit vulnerabilities, even within the protections designed to safeguard them.

Following an incident in September where a research model unintentionally gained limited access to the internet due to a configuration error, OpenAI had halted training of its advanced models. The company utilized this pause to fortify its security infrastructure.

To evaluate the effectiveness of its defenses, OpenAI engaged teams of AI agents to attempt to breach their controlled environments. These tests resulted in the identification of previously unknown vulnerabilities, which were subsequently addressed, allowing training to recommence on October 1.

During these assessments, OpenAI uncovered a flaw in Brotli, a popular data compression algorithm. The company reported that malicious actors could exploit this vulnerability by sending harmful data that would permit them to execute their code on impacted systems, including widely used software frameworks like Node.js, Bun, and Envoy.

Although the root issue in Brotli's source code was corrected in February—before it was recognized as a security flaw—no updated version was released at that time. Brotli has since made updates and acknowledged the vulnerability publicly following OpenAI’s disclosure.

Additionally, evaluators in AI safety from METR and Redwood Research revealed new vulnerabilities in OpenAI's internal systems, including an exploit that could allow agents to conceal many actions from monitoring during a review conducted earlier this year.

OpenAI has informed these safety organizations that all vulnerabilities affecting its production systems have been addressed, though neither METR nor Redwood has confirmed the effectiveness of these fixes.

The company has been conducting a comprehensive review of its AI models' performances since the Hugging Face incident that occurred in July and has communicated with over 100 organizations regarding incidents of unauthorized activity linked to its AI agents.

Loading comments...