Skip to content
InfoResearchPreprintLLM-specific

SkillScreen: High-Recall Screening of Malicious Agent Skills with Decision Models

Published
Record updated
View JSON

Summary

SkillScreen is a compact decision model that scores whether an agent skill is malicious directly from its SKILL.md file in a single forward pass. On MaliciousSkillBench it reaches 99% recall on unseen attack families while flagging 20-25% of benign skills, fewer than the word-level classifier and prompted LLM judges tested. It also generalizes better than a fully fine-tuned encoder to unseen sources, though unfamiliar benign sources sharply raise false positives.