Skip to content
InfoResearchPeer-reviewed

SMInject: Specious Malignant Injection Attacks With Semantically-Enhanced Tokens in Cross-Modal Retrieval

Published
Record updated
View JSON

Summary

SMInject is a new injection attack framework against pre-trained multimodal models used in cross-modal retrieval. It generates deceptive injections that combine concepts through causal correlation across modalities, and aligns them in the encoded embedding space to boost effectiveness. On representative multimodal models, it reportedly achieves over 14% higher attack success rate and 6% higher Hit@5 than state-of-the-art methods while preserving overall model utility.