Skip to content
MediumVulnerabilityLLM-specific

GHSA-7h4p-rffg-7823: vLLM: temperature=NaN and temperature=Infinity bypass validation and propagate to GPU kernels

Published
Record updated
View JSON
Affected
  • vllm <= 0.23.0
Fixed in
No fixed version was stated when the source was last read.
Known exploitation
Not listed in the CISA Known Exploited Vulnerabilities catalog at the last check.
EPSS
0.4%

Summary

vLLM's temperature validation in sampling_params.py uses comparison operators that evaluate to False for NaN and positive Infinity, so both values pass every guard. These values reach GPU sampling kernels, where they cause undefined behavior or CUDA errors that can crash the inference worker and degrade service for all concurrent users. The source notes that -Infinity is correctly rejected.

Mitigation

Add math.isfinite(self.temperature) check in _verify_args(). Reject non-finite float values with a 400 error. A fix was merged in https://github.com/vllm-project/vllm/pull/45116