Skip to content
InfoResearchPeer-reviewedLLM-specific

Syntax-Oriented Shortcut: A Syntax Level Perturbing Algorithm for Preventing Text Data From Being Learned

Published
Record updated
View JSON

Summary

Researchers propose UTE-SS, an algorithm that makes text examples unlearnable by adding syntax-level perturbations that models learn as a shortcut. The method uses a syntax template generator to select an optimal syntax per category and a perturbing text generator to rewrite in-class texts with that template. Experiments on eight Transformer-based pretrained language models across four NLP tasks show its effectiveness and flexibility, and the code is public at https://github.com/libolb/UTE-SS.