PyPI page
Home page
Author:
Mooncake Authors
Summary:
A KVCache-centric Disaggregated Architecture for large-scale LLM inference and training.
Latest version:
0.3.14
Required dependencies:
aiohttp
|
msgpack
|
requests
|
typing-extensions
Optional dependencies:
paramiko
Downloads last day:
2,600
Downloads last week:
11,868
Downloads last month:
67,148
7-day smoothing