CertMoE: Robustness Certification for Mixture-of-Experts LLMs via Routing-Aware Smoothing

Summary

CertMoE is a robustness certification framework for Mixture-of-Experts LLMs that accounts for input-dependent routing. It certifies that perturbed Top-K routing stays within a certified expert pool, then certifies prediction consistency of the induced sub-network, yielding a joint probabilistic guarantee. Experiments show existing certificates are frequently violated under dynamic routing, while CertMoE reduces the empirical violation rate from more than 30% to 0.