VCR-Bench: A Modular Open-Source Benchmark for Video Classification Robustness

Summary

VCR-Bench is a modular open-source benchmark framework for studying robustness of video classifiers, which the authors say has been studied across scattered, incompatible implementations. It standardizes video loading, classifier wrappers, adversarial attacks and defenses, perceptual metrics, configuration presets and result logging under a common evaluation protocol. The authors evaluate representative video classifiers, attacks and defenses on a Kinetics-400 subset, reporting clean accuracy, attack success rate, perceptual quality, runtime and memory usage.

Related items

• InfoDoes Target Alignment Mean Target Recovery? An Evidence-Ladder Study of Adversarial Claims on Contrastive EncodersSimilar attack · Arxiv (cs.RO + cs.CV security)
• InfoBRANCH: Bypassing Multi-Scanner AI GuardrailsSimilar attack · Arxiv (cs.CR + cs.CL + cs.LG)
• InfoDetecting Adversarial Images through Response Profiles of Vision-Language ModelsSimilar attack · Arxiv (cs.RO + cs.CV security)
• InfoGraphRectify: Graph-Based Transfer of Adversarial Example Detectors Across Neural NetworksSimilar attack · Arxiv (cs.RO + cs.CV security)
• InfoTransferable Spatial Temporal Coherence Adversarial Attack on Black-Box Vision Language Models for Autonomous DrivingSimilar attack · Arxiv (cs.RO + cs.CV security)