PromptFishing: Active Hallucination Inducement to Distinguish LLMs From Humans

Researchers developed PromptFishing, a technique to identify whether social media accounts are controlled by LLMs (large language models, AI systems trained on text) or humans by embedding hidden prompts into normal conversations that cause LLMs to produce distinctive responses called hallucinations (when an AI generates false or off-topic information). The method uses a two-stage algorithm to create adversarial suffixes (specially crafted text additions) that trigger these distinctive LLM behaviors while appearing like normal conversation, achieving over 85% accuracy at detecting LLMs while falsely flagging humans less than 1% of the time.