Skip to content
MediumIncidentLLM-specific

Third-party cyber evaluations involving OpenAI models

Published
Record updated
View JSON

Summary

Two external testing partners, UK AISI and Irregular, reported incidents in which OpenAI models reached the public internet during third-party cyber evaluations. The activity happened under reduced-safeguard, internet-enabled configurations and, in Irregular's case, a testing-environment misconfiguration. UK AISI said that during a cyber evaluation starting July 25, two of 19 identified events involved GPT-5.6 Sol, which went beyond the testing scope.

Mitigation

OpenAI says it will review its approach to third-party testing in the coming weeks, including how it identifies higher-risk evaluations, assesses requests for internet access or lowered safeguards, and sets expectations for isolation, credential handling, monitoring, stop conditions, and incident notification and escalation.