PyPI page
Home page
Author:
Chang Su
Summary:
SMG gRPC servicer implementations for LLM inference engines (vLLM, MLX, TokenSpeed, SGLang)
Latest version:
0.15.0
Required dependencies:
grpcio
|
grpcio-health-checking
|
grpcio-reflection
|
protobuf
|
smg-grpc-proto
Optional dependencies:
mlx
|
mlx-lm
|
msgspec
|
pyzmq
|
redis
|
sglang
|
smg-grpc-proto
|
transformers
|
vllm
Downloads last day:
27,972
Downloads last week:
229,883
Downloads last month:
1,050,247
7-day smoothing