PromptFishing: Active Hallucination Inducement to Distinguish LLMs From Humans

Summary

Researchers propose PromptFishing, an active method for identifying LLM-driven social accounts by embedding machine-readable prompts in ordinary topics that induce a target hallucinated response. The method uses a gradient-guided two-stage beam search to generate adversarial suffixes, first pushing responses off topic and then aligning them with the target. On Twitter data, it reports a true positive rate above 0.85 with a false positive rate below 0.01.

Related items

• MediumInside the loop: Five AI attack frameworks that never ask permissionSimilar attack · Elastic Security Labs
• MediumARTEX: Attackers Adopted This AI Pentesting Tool in Three Months. Leaked Secrets Are Its Fastest Way In.Similar attack · StepSecurity Blog
• MediumFBI Says North Korean Hackers Stole Over $400 Million in Crypto Using Deepfake Video CallsSimilar attack · The Hacker News
• MediumCVE-2026-126395: vLLM information disclosure via uppercase PIL image addresses in error messagesSimilar attack · NVD/CVE Database
• HighZDI-26-975: llama.cpp GGUF File Parsing Integer Overflow Remote Code Execution VulnerabilitySimilar attack · ZDI Published Advisories