PyPI page
Home page
Author:
FlashInfer team
Summary:
FlashInfer: Kernel Library for LLM Serving
Latest version:
0.7.2.post1
Required dependencies:
apache-tvm-ffi
|
click
|
cuda-python
|
cuda-tile
|
einops
|
nccl-extensions
|
nccl4py
|
ninja
|
numpy
|
nvidia-cudnn-frontend
|
nvidia-cutlass-dsl
|
nvidia-ml-py
|
packaging
|
requests
|
tabulate
|
torch
|
tqdm
Optional dependencies:
apache-tvm-ffi
|
nvidia-cuda-nvcc
|
nvidia-cutlass-dsl
|
nvidia-cutlass-dsl-libs-base
|
nvidia-cutlass-dsl-libs-core
|
nvidia-cutlass-dsl-libs-cu12
|
nvidia-cutlass-dsl-libs-cu13
|
nvshmem4py-cu13
|
rich
|
safetensors
|
torch
Downloads last day:
142,624
Downloads last week:
938,583
Downloads last month:
2,960,391
7-day smoothing