Skip to content
InfoResearchPreprintLLM-specific

Factual Yet One-Sided: Stance Poisoning and Evidence Balancing in Retrieval-Augmented Generation

Published
Record updated
View JSON

Summary

This research shows that RAG systems take on the stance of retrieved documents: at a mean poisoning share of 18.9% in ProCon documents, four generation models from different vendors shifted toward the poisoning direction, and the shift grew monotonically across four concentration levels. The authors propose a Stance-Balancing Middleware between retriever and generator, combining stance detection, fixed balancing (2 supporting, 2 opposing, 1 neutral) and a debiasing prompt, with no extra LLM calls. The method reduced stance deviation by an estimated 0.106 to 0.350 across eight settings, with residual pro-poisoning estimates of +0.045 to +0.063 in some cross-model results.

Mitigation

The source proposes a Stance-Balancing Middleware positioned between the retriever and the generator, consisting of stance detection, fixed balancing (2 supporting + 2 opposing + 1 neutral), and a debiasing prompt, without additional large language model calls.