Skip to content
InfoResearchPreprintLLM-specific

PGuard: A Native, Streaming, and Plug-in Guardrail for Multimodal Large Language Models

Published
Record updated
View JSON

Summary

PGuard is a native, streaming guardrail that runs inside a multimodal LLM's backbone rather than as an external serving dependency. It uses dynamic layer gating over residual-stream representations to detect safety-relevant signals per token during prefill and decoding. It adds only 0.82-2.26% end-to-end overhead on Qwen3.5-122B-A10B served by SGLang, and on text queries with Qwen3.5-9B it reaches an average F1 of 0.836 across more than 30 benchmarks.