Skip to content
InfoNewsLLM-specific

How OpenAI’s Performance Factory keeps ChatGPT fast

Published
Record updated
View JSON

Summary

OpenAI built the Performance Factory, a cloud-based system of Codex-powered workflows that automatically investigates and resolves performance regressions in ChatGPT. Its first workflow, the Regression Workflow, opens a task when a performance alert fires, has an agent investigate and propose a fix for engineer review, and then uses another agent to verify performance returns to baseline. In just over three months, it tracked more than 1,700 investigations and root caused over 600 cases.