Multiobjective Simulated Annealing-Based Stopwords Substitution for Rubbish Text Attack

Researchers found that modern natural language processing (NLP) models, which are AI systems trained to understand text, are very vulnerable to "rubbish text" attacks where sentences are heavily modified to become nonsensical to humans but still produce the same prediction from the model. The team developed a new algorithm called MOSA-S2 that uses multiobjective simulated annealing (a optimization technique that balances multiple competing goals) and stopword substitution (replacing words with meaningless filler words) to generate better adversarial examples, revealing that these NLP models may not truly understand language semantics despite their confidence in predictions.