{"data":{"id":"da82b092-783e-44a5-82ce-99f15fd8a3b6","title":"Where the Savings Go: The Limits of Hiding Cross-Tenant Cache Hits in LLM Serving","summary":"This research examines cross-tenant prefix-cache timing leakage in LLM serving engines, where a cache hit reveals whether other users sent a given text. Step-based schedulers pass the saved time to every request queued behind the hit, so an attacker can detect cached texts of 256 tokens or more with advantage at least 0.98 using one probe on one vLLM instance at up to half capacity. Hiding only the hit request falls to one probe, and the authors prove a rate-limited tenant's gain from content written by k other accounts is at most of order k times the allowed leakage.","solution":"Exact hiding is attainable in principle on one instance, but mechanisms that only pause or hold work know skipped work's duration only approximately, so under saturated prefill they must pad every step that may hold a hit, at a price that grows with time rather than with hits.","labels":["security","research"],"sourceUrl":"https://arxiv.org/abs/2611.20291v1","publishedAt":"2026-11-15T22:38:13.000Z","cveId":null,"cweIds":null,"cvssScore":null,"cvssSeverity":null,"severity":"info","attackType":["data_extraction"],"issueType":"research","affectedPackages":null,"affectedPackageNames":null,"affectedPackageRefs":null,"affectedVendors":[],"affectedVendorsRaw":["vLLM","SGLang"],"classifierModel":"claude-haiku-5-5","classifierPromptVersion":"v4","summaryPromptVersion":"v2","headline":null,"headlinePromptVersion":null,"cvssVector":null,"attackVector":null,"attackComplexity":null,"privilegesRequired":null,"userInteraction":null,"exploitMaturity":null,"epssScore":null,"epssCheckedAt":null,"kevDateAdded":null,"advisoryAliases":null,"affectedPackagesSource":null,"affectedPackagesCheckedAt":null,"patchAvailable":null,"disclosureDate":"2026-11-15T22:38:13.000Z","fixReleasedAt":null,"daysToFix":null,"fixCheckedAt":null,"capecIds":null,"crossRefCount":0,"attackSophistication":"moderate","impactType":["confidentiality"],"aiComponentTargeted":"inference","llmSpecific":true,"classifierConfidence":0.95,"researchCategory":"preprint","atlasIds":null}}