The current version has a known security vulnerability. Review the advisory and consider upgrading.
Downloads in the 30 and 7 days to October 10, 2026. Refreshed weekly.
Package Information
Package Insights
- No releases in 476 days despite active commits
- High downloads but no recent maintenance activity
((week_daily_avg - month_daily_avg) / month_daily_avg) * 100More insights and metrics
Downloads by OS
Python Versions
Top Countries
Weekly Downloads
GitHub Stars
Dependencies
- aiohttp
- fastapi
- httpx
- markdown2
- nh3
- numpy
- prompt-toolkit >=3.0.0
- pydantic
- requests
- rich >=10.0.0
- shortuuid
- tiktoken
- uvicorn
15 optional dependencies
-
accelerate>=0.21[model-worker]extra == "model-worker"
-
anthropic>=0.3[llm-judge]extra == "llm-judge"
-
black==23.3.0[dev]extra == "dev"
-
einops[train]extra == "train"
-
flash-attn>=2.0[train]extra == "train"
-
gradio>=4.10[webui]extra == "webui"
-
openai<1[llm-judge]extra == "llm-judge"
-
peft[model-worker]extra == "model-worker"
-
protobuf[model-worker]extra == "model-worker"
-
pylint==2.8.2[dev]extra == "dev"
-
ray[llm-judge]extra == "llm-judge"
-
sentencepiece[model-worker]extra == "model-worker"
-
torch[model-worker]extra == "model-worker"
-
transformers>=4.31.0[model-worker]extra == "model-worker"
-
wandb[train]extra == "train"
Used By
- flashrag-dev 3.0K/mo
- greaterprompt 403/mo
- lm-polygraph 395/mo
- trustllm 367/mo
- pyterrier-rag 331/mo
- eagle-llm 303/mo
- comfyui 301/mo
- tracllm 281/mo
- easyjailbreak 270/mo
- rewardbench 234/mo