PyRank
BerriAI

litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
PyPI GitHub
More links
Download Stats
Monthly downloads
95.0M
Weekly downloads
21.7M
GitHub stars *
61.4K

Downloads in the 30 and 7 days to October 10, 2026. Refreshed weekly.

Package Information

Latest Version
1.105.1
Requires Python
<3.15,>=3.10
Licence
MIT
Last Release
2 days ago
Author
BerriAI
First Release
July 27, 2023
Total Releases
1,493
Previous security advisories

Package Insights

What's this?
Score breakdown - each component scores 0-100, weighted by percentage
Maintenance
100
Popularity
97
Adoption
70
Community
90
Provenance
0
How the maintenance status was determined
Last commit
0 days ago
Monthly downloads
94,978,222
• Active
Activity within 30 days
Stable
Activity within 31-180 days
Minimal
Activity within 181-365 days, or no activity data
At Risk
No activity for > 365 days, but > 10,000 monthly downloads
Archived
Repository flagged as archived on GitHub
How the popularity category was determined
Monthly downloads
94,978,222
Stars
61,356
Stars per 1k downloads
0.65
• Industry Standard
> 10,000,000 monthly downloads
Hidden Gem
< 0.5 stars per 1k downloads and > 100,000 monthly downloads
Community Favorite
> 5 stars per 1k downloads
Rising Star
Balanced ratio of stars to downloads
Unknown
Fewer than 1,000 monthly downloads, or no star data
How download momentum is calculated
Week daily avg
3,093,822
Month daily avg
3,165,941
Momentum
-2.3%
((week_daily_avg - month_daily_avg) / month_daily_avg) * 100
More insights and metrics
Python version support tiers
requires_python
<3.15,>=3.10
Cutting Edge
Minimum supported version is 3.14 or newer
Modern
Minimum supported version is 3.11 to 3.13
• Legacy
Supports 3.10 or older (or Python 2)
Unknown
No requires_python specified or unparseable
License categories
License
MIT
• Permissive
MIT, Apache, BSD, ISC, Unlicense, CC0, etc.
Copyleft
GPL, LGPL, AGPL, MPL, EPL, etc.
Proprietary
Commercial, all rights reserved, custom EULAs
Unknown
No license specified, or none of the above match
How the release cadence was determined
Last release
2 days ago
Total releases
1,493
Releases/year
463.0
• Rapid
Last release within 365 days and > 12 releases/year
Regular
Last release within 365 days
Slow
Last release 366-730 days ago
Stalled
Last release > 730 days ago, or no releases
Unknown
No usable release date available
How contributor risk was determined
Contributors
1,938
Monthly downloads
94,978,222
High Load
≤ 2 contributors and ≥ 50,000 monthly downloads
Moderate Load
< 10 contributors and ≥ 500,000 monthly downloads
Low Load
< 25 contributors and ≥ 5,000,000 monthly downloads, or sole maintainer with ≥ 10,000 monthly downloads
• Balanced
Enough contributors for the package's popularity
Unknown
No contributor data available
Engagement
95
 
Issue Burden
29.7
per 1k stars
Discussions
10.4
per 1k stars
Fork Ratio
15.6%
contrib / forks
Stale Release
No
 
PR Velocity
Active
 
Not all downloads include detailed metadata. Breakdowns reflect the subset that does.

Downloads by OS

Linux 2.1M
Windows 20.8K
macOS 14.1K

Python Versions

3.12
55.0% 1.1M
3.13
18.7% 389.5K
3.11
13.4% 279.2K
3.10
9.4% 196.7K
3.14
3.4% 71.0K

Top Countries

1. US US
1.5M
2. SG SG
167.0K
3. NL NL
104.9K
4. IN IN
58.7K
5. DE DE
42.6K
6. HK HK
38.7K
7. JP JP
27.2K
8. CA CA
23.0K
9. FR FR
13.7K
10. IE IE
13.6K

Weekly Downloads

GitHub Stars *

Dependencies

18
86 optional dependencies
  • a2a-sdk<2.0,>=1.1.0[extra-proxy]
    extra == "extra-proxy"
  • anthropic<1.0,>=0.84.0[proxy-runtime]
    extra == "proxy-runtime"
  • apscheduler<4.0,>=3.11.2[proxy]
    extra == "proxy"
  • audioread>=3.0.1[stt-nvidia-riva]
    extra == "stt-nvidia-riva"
  • aurelio-sdk<1.0,>=0.0.19[semantic-router]
    python_full_version < "3.14" and extra == "semantic-router"
  • aws-sdk-bedrock-runtime<0.12.0,>=0.10.0[bedrock-realtime]
    python_full_version >= "3.12" and extra == "bedrock-realtime"
  • azure-ai-contentsafety<2.0,>=1.0.0[proxy-runtime]
    extra == "proxy-runtime"
  • azure-identity<2.0,>=1.25.2[extra-proxy]
    extra == "extra-proxy"
  • azure-identity<2.0,>=1.25.2[proxy]
    extra == "proxy"
  • azure-keyvault-secrets<5.0,>=4.10.0[extra-proxy]
    extra == "extra-proxy"
  • azure-storage-blob<13.0,>=12.28.0[proxy]
    extra == "proxy"
  • azure-storage-file-datalake<13.0,>=12.20.0[proxy-runtime]
    extra == "proxy-runtime"
  • backoff<3.0,>=2.2.1[proxy]
    extra == "proxy"
  • boto3<2.0,>=1.43.1[proxy]
    extra == "proxy"
  • cryptography<51.0,>=49.0.0[proxy]
    extra == "proxy"
  • ddtrace<5.0,>=4.8.2[proxy-runtime]
    extra == "proxy-runtime"
  • detect-secrets<2.0,>=1.5.0[proxy-runtime]
    extra == "proxy-runtime"
  • diskcache<6.0,>=5.6.3[caching]
    extra == "caching"
  • expression<6.0,>=5.6.0[proxy]
    extra == "proxy"
  • fastapi<1.0,>=0.136.3[proxy]
    extra == "proxy"
  • fastapi-sso<1.0,>=0.19.0[proxy]
    extra == "proxy"
  • google-cloud-aiplatform<2.0,>=1.133.0[google]
    extra == "google"
  • google-cloud-aiplatform<2.0,>=1.133.0[proxy-runtime]
    extra == "proxy-runtime"
  • google-cloud-iam<3.0,>=2.19.1[extra-proxy]
    extra == "extra-proxy"
  • google-cloud-kms<3.0,>=2.24.2[extra-proxy]
    extra == "extra-proxy"
  • google-cloud-speech<3.0,>=2.40.0[stt-vertex-chirp]
    extra == "stt-vertex-chirp"
  • google-cloud-speech<3.0,>=2.40.0[proxy-runtime]
    extra == "proxy-runtime"
  • google-genai<2.0,>=1.37.0[proxy-runtime]
    extra == "proxy-runtime"
  • granian<3.0,>=2.7.4[proxy]
    extra == "proxy"
  • grpcio==1.78.0[grpc]
    extra == "grpc"
  • grpcio==1.78.0[proxy-runtime]
    extra == "proxy-runtime"
  • gunicorn<24.0,>=23.0.0[proxy]
    extra == "proxy"
  • hiredis<4.0,>=3.0.0[proxy]
    extra == "proxy"
  • httpx2<3,>=2.5.0[mcp]
    extra == "mcp"
  • httpx2<3,>=2.5.0[proxy]
    extra == "proxy"
  • inquirerpy<1.0,>=0.3.4[cli]
    extra == "cli"
  • inquirerpy<1.0,>=0.3.4[proxy]
    extra == "proxy"
  • keyring<26.0,>=25.6.0[cli]
    extra == "cli"
  • langfuse<5.0,>=4.7[proxy-runtime]
    extra == "proxy-runtime"
  • litellm-enterprise==0.1.71[proxy]
    extra == "proxy"
  • litellm-proxy-extras==0.4.102.post1[proxy]
    extra == "proxy"
  • llm-sandbox<1.0,>=0.3.39[proxy-runtime]
    extra == "proxy-runtime"
  • mangum<1.0,>=0.17.0[proxy-runtime]
    extra == "proxy-runtime"
  • mcp<3,>=2.2.0[mcp]
    extra == "mcp"
  • mcp<3,>=2.2.0[proxy]
    extra == "proxy"
  • mlflow<4.0,>=3.11.1[mlflow]
    extra == "mlflow"
  • numpy>=1.26.0[stt-nvidia-riva]
    extra == "stt-nvidia-riva"
  • numpydoc<2.0,>=1.8.0[utils]
    extra == "utils"
  • nvidia-riva-client>=2.15.0[stt-nvidia-riva]
    extra == "stt-nvidia-riva"
  • opentelemetry-api==1.33.1[proxy-runtime]
    extra == "proxy-runtime"
  • opentelemetry-exporter-otlp==1.33.1[proxy-runtime]
    extra == "proxy-runtime"
  • opentelemetry-instrumentation-fastapi==0.54b1[proxy-runtime]
    extra == "proxy-runtime"
  • opentelemetry-sdk==1.33.1[proxy-runtime]
    extra == "proxy-runtime"
  • orjson<4.0,>=3.11.6[proxy]
    extra == "proxy"
  • polars<2.0,>=1.38.1[proxy]
    extra == "proxy"
  • prisma<1.0,>=0.11.0[extra-proxy]
    extra == "extra-proxy"
  • prometheus-client<1.0,>=0.20.0[proxy-runtime]
    extra == "proxy-runtime"
  • psycopg<4.0,>=3.2[extra-proxy]
    extra == "extra-proxy"
  • psycopg-binary<4.0,>=3.2[extra-proxy]
    extra == "extra-proxy"
  • pydantic<3,>=2.12.0[proxy]
    extra == "proxy"
  • pydantic<3,>=2.12.0[mcp]
    extra == "mcp"
  • pyjwt<3.0,>=2.13.0[proxy]
    extra == "proxy"
  • pynacl<2.0,>=1.6.2[proxy]
    extra == "proxy"
  • pypdf<7.0,>=6.16.1[proxy-runtime]
    extra == "proxy-runtime"
  • pyroscope-io<1.0,>=0.8.16[proxy]
    sys_platform != "win32" and extra == "proxy"
  • python-multipart<1.0,>=0.0.27[proxy]
    extra == "proxy"
  • python3-saml<2.0,>=1.16.0[saml]
    extra == "saml"
  • pyyaml<7.0,>=6.0.3[proxy]
    extra == "proxy"
  • pyyaml<7.0,>=6.0.3[cli]
    extra == "cli"
  • redisvl<1.0,>=0.4.1[extra-proxy]
    extra == "extra-proxy"
  • requests<3.0,>=2.32.0[cli]
    extra == "cli"
  • resend<3.0,>=2.23.0[extra-proxy]
    extra == "extra-proxy"
  • restrictedpython<9.0,>=8.5[proxy]
    extra == "proxy"
  • rich<14.0,>=13.9.4[cli]
    extra == "cli"
  • rich<14.0,>=13.9.4[proxy]
    extra == "proxy"
  • rq<3.0,>=2.7.0[proxy]
    extra == "proxy"
  • semantic-router<1.0,>=0.1.15[semantic-router]
    python_full_version < "3.14" and extra == "semantic-router"
  • sentry-sdk<3.0,>=2.21.0[proxy-runtime]
    extra == "proxy-runtime"
  • soundfile<1.0,>=0.12.1[proxy]
    extra == "proxy"
  • soundfile>=0.12.1[stt-nvidia-riva]
    extra == "stt-nvidia-riva"
  • starlette<2.0,>=1.0.1[proxy]
    extra == "proxy"
  • tomlkit<1.0,>=0.13.3[cli]
    extra == "cli"
  • tomlkit<1.0,>=0.13.3[proxy]
    extra == "proxy"
  • uvicorn<1.0,>=0.33.0[proxy]
    extra == "proxy"
  • uvloop<1.0,>=0.22.1[proxy]
    sys_platform != "win32" and extra == "proxy"
  • websockets<16.0,>=15.0.1[proxy]
    extra == "proxy"

Used By

2601
View all 2601 dependents

Repository details

Forks
12.4K
Issues
1.8K
Last Commit
2 hr ago
Contributors
1,938
Open PRs
3,671
Archived
No

Data and sources

Tracking Since
September 26, 2026
Data Updated
October 11, 2026
Data Freshness
Fresh
Sources and methodology