PyPI page
Home page
Author:
Jaymin Bhan
Summary:
LLM benchmark harness (vLLM, SGLang, HF, or any OpenAI-compatible server) that records every prompt, response, and score to one SQLite ledger with a built-in viewer
Latest version:
0.1.2
Required dependencies:
bitsandbytes
|
datasets
|
flask
|
httpx
|
huggingface-hub
|
latex2sympy2-extended
|
pyyaml
|
sglang
|
vllm
|
waitress
Optional dependencies:
accelerate
|
torch
|
transformers
Downloads last day:
0
Downloads last week:
12
Downloads last month:
244