PyPI page
Home page
Author:
The vLLM Project
License:
Apache 2.0
Summary:
Library for utilization of compressed safetensors of neural network models
Latest version:
0.20.1
Required dependencies:
loguru
|
psutil
|
pydantic
|
torch
|
transformers
Optional dependencies:
accelerate
|
black
|
datasets
|
flake8
|
isort
|
markdown
|
mkdocstrings-python
|
nbconvert
|
pre-commit
|
pymdown-extensions
|
pytest
|
wheel
|
zensical
Downloads last day:
154,389
Downloads last week:
1,044,134
Downloads last month:
3,946,107
7-day smoothing