Dataset Distillation Sweeper: Backdoor Defense for Multimodal Learning
- Published
- Record updated
Summary
Researchers present Dataset Distillation Sweeper (DDaS), a defense against backdoor attacks on multimodal pre-trained models that are downloaded from third-party platforms and fine-tuned on downstream datasets. DDaS runs cyclic dataset distillation with the pre-trained model to separate backdoor datasets from clean ones, without invasive changes to the model backbone. The authors report attack success rate reductions of over 97% (Image-to-Text) and 93% (Text-to-Image) in image-text retrieval, and 99% in Visual Question Answering, with accuracy loss under 1% and within 2% respectively.
Mitigation
DDaS itself is the proposed mitigation: it uses the multimodal pre-trained models to perform cyclic dataset distillation to distinguish backdoor datasets from clean datasets and obtain a clean model, without invasive modifications to the model backbone. Code is at https://github.com/grey1989/DDaS.
Related items
- CriticalGHSA-9x8x-crjq-g64h: Jupyter MCP Server: Browser DNS rebinding can hijack the Jupyter backend through management routesSimilar attack · GitHub Advisory Database
- HighGHSA-24pw-rf5p-mgp7: Jupyter MCP Server: Unauthenticated management routes can hijack the Jupyter backend in standalone HTTP modeSimilar attack · GitHub Advisory Database
- HighGHSA-m932-63jc-4jqq: k8s-mcp-server: Missing authentication on default SSE/HTTP transport allows unauthenticated Kubernetes tool executionSimilar attack · GitHub Advisory Database
- HighGHSA-3mgh-93r5-r7jf: CodeWhale: exec_shell parallel-readonly classifier auto-approves fd/rg/git grep exec flags enabling silent RCESimilar attack · GitHub Advisory Database
- HighGHSA-qx49-fqc8-xw99: Model Context Protocol Python SDK: OAuth client could send credentials to an authorization server chosen by the MCP serverSimilar attack · GitHub Advisory Database