vllm-gguf-plugin

PyPI page
Home page
Author: None
Summary: Out-of-tree GGUF quantization plugin for vLLM
Latest version: 0.0.3
Required dependencies: gguf | torch | vllm
Optional dependencies: pre-commit

Downloads last day: 550
Downloads last week: 3,612
Downloads last month: 6,760