Loading
A high-throughput and memory-efficient inference and serving engine for LLMs
Declares an LLM dependency since 2023-08-25 (version 0.1.4).
Advisories that name vllm as affected. Advisory records do not state an ecosystem, so packages with the same name in other ecosystems also match. For a version-exact check of your own dependencies, use Stack Check.
As declared in PyPI metadata for version 0.31.0. Optional extras are listed with their extra name.
Among the packages in the registry; not every dependent on PyPI.