OpenAI to acquire Promptfoo to strengthen AI agent security testing

Summary

OpenAI said it plans to acquire AI testing startup Promptfoo to strengthen security checks for AI agents. Promptfoo's tools let developers test LLM applications against adversarial prompts, including prompt injection and jailbreak attempts, and evaluate whether models follow safety and reliability guidelines. OpenAI said the technology will be integrated into OpenAI Frontier, and that it plans to continue developing Promptfoo's open-source project.

Topics

• AI agents
• Prompt injection and jailbreaks

Related items

• InfoOpenAI Fires 3 Safety Researchers in Dispute Over AI RisksSame vendor · SecurityWeek
• Info‘Pure insanity’: Mathematicians will need years to make sense of OpenAI’s latest dropSame vendor · The Verge (AI)
• InfoOpenAI reports three new incidents of misalignmentSame vendor · CSO Online
• InfoA new feature for my blog, built using my voiceSame vendor · Simon Willison's Weblog
• InfoOpenAI's revenue scare, Delta earnings, what investors think of a Starbucks-Chipotle deal and more in Morning SquawkSame vendor · CNBC Technology