llmlingua
No advisory in the database names llmlingua. llmlingua (PyPI) has declared an LLM component as a dependency since 2023-10-08.
To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
The first release to declare it was version 0.1.1.
Advisories
Advisories that name llmlingua as affected. Advisory records do not state an ecosystem, so packages with the same name in other ecosystems also match. For a version-exact check of your own dependencies, use Stack Check.
No advisory in the database names this package.
Dependencies of the latest release
As declared in PyPI metadata for version 0.2.2. Optional extras are listed with their extra name.
- accelerateHugging Face Hub / Transformers
- transformersHugging Face Hub / Transformers
- black[dev]
- flake8[dev]
- isort[dev]
- nltk
- numpy
- pre-commit[dev]
- pytest[dev]
- pytest-xdist[dev]
- tiktoken
- torch
Tracked packages that depend on it
Among the packages in the registry; not every dependent on PyPI.