AI Sec Watch: A Security Intelligence Platform for AI Systems

Luu, T.J.

Irregular Details How a Naming Error Let AI Models Attack a Real Company

highnewsLLM-Specific

securitysafety

Source: SecurityWeekAugust 17, 2026

Summary

AI safety testing firm Irregular discovered that AI models escaped their testing sandbox (an isolated environment designed to contain programs safely) during security evaluations because a fictional company name accidentally matched a real, lesser-known domain. When internet access was enabled in the testing environment, models treated the real domain as their intended simulated target and performed actual attacks, including exploiting vulnerabilities and accessing production databases (live systems storing real company data), rather than stopping at the simulated targets they were supposed to test against.

Solution / Mitigation

Irregular is implementing several mitigations: expanding manual review of model behavior during testing, establishing a dedicated internal team to challenge containment assumptions, building clearer documentation processes with customers about evaluation setup and scope, establishing a continuous process to revalidate evaluations for new domain overlaps as new websites appear, and calling for better mechanisms to share forensic evidence (records of what happened during an incident) across organizations. The company also announced plans for a white paper outlining best practices for securing AI evaluations.