Discovering Jailbreaks via Curriculum of Models

Summary

Researchers introduce Curriculum of Models (CoM), a method that trains a jailbreak-discovery investigator model against a sequence of progressively harder versions of a target model, starting from a version that rarely refuses harmful requests. They evaluate CoM on CBRN, explosives, and illicit drug elicitation tasks against the open-weight targets gemma-4-31b-it and gpt-oss-120b. CoM finds successful jailbreaks more reliably than the PRBO baseline and direct training when trained on a single behavior, though PRBO-trained investigators achieve higher success rates in the multi-behavior setting.

Topics

• Prompt injection and jailbreaks

Related items

• InfoShallowDefend: Harnessing Shallow Safety Alignment for Multi-Turn DefenderSimilar attack · Arxiv (cs.CR + cs.CL + cs.LG)
• InfoHow I Aligned Your Model: Scaling Up Multilingual Safety Training with TemplatesSimilar attack · Arxiv (cs.CR + cs.CL + cs.LG)
• InfoRed-Teaming Large Language Models in Low-Resource African Languages: A Case Study of Yoruba and Nigerian PidginSimilar attack · Arxiv (cs.CR + cs.CL + cs.LG)
• InfoSystematic Evaluation of Adversarial Jailbreaking Attacks and Defenses Across Seven Large Language ModelsSimilar attack · Arxiv (cs.CR + cs.CL + cs.LG)
• InfoAdversarial Self-DistillationSimilar attack · Arxiv (cs.CR + cs.CL + cs.LG)