PyRank
mjpost

sacrebleu

Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons
PyPI GitHub Verified repo
No known security advisories. The current version has no OSV.dev malware reports and no critical or high-severity vulnerabilities.

sacrebleu has 4M monthly downloads and 1K GitHub stars. Version 2.6.0 supports Python 3.9+, first published in 2017.

It is stably maintained under a permissive license, last released in Jan 2026.

It is built on top of colorama, lxml and numpy. It is used by 149 tracked packages, including lm-eval, tf-models-nightly and unbabel-comet.

Shared Repository
This package shares its GitHub repository (mjpost/sacrebleu) with 1 other package. Stars, forks, and other GitHub metrics reflect the entire repository.
Downloads
Day
119.2K
Week
874.1K
Month
4.0M
Stars
1.2K
Forks
172
Issues
17
Version
2.6.0

Package Insights

What's this?
Score breakdown - each component scores 0-100, weighted by percentage
Maintenance
65
Popularity
65
Adoption
70
Community
50
Provenance
100
How the maintenance status was determined
Last commit
176 days ago
Monthly downloads
4,019,914
Active
Activity within 30 days
• Stable
Activity within 31-180 days
Minimal
Activity within 181-365 days, or no activity data
At Risk
No activity for > 365 days, but > 10,000 monthly downloads
Archived
Repository flagged as archived on GitHub
How the popularity category was determined
Monthly downloads
4,019,914
Stars
1,250
Stars per 1k downloads
0.31
Industry Standard
> 10,000,000 monthly downloads
• Hidden Gem
< 0.5 stars per 1k downloads and > 100,000 monthly downloads
Community Favorite
> 5 stars per 1k downloads
Rising Star
Balanced ratio of stars to downloads
Unknown
Fewer than 1,000 monthly downloads, or no star data
How download momentum is calculated
Week daily avg
124,869
Month daily avg
133,997
Momentum
-6.8%
((week_daily_avg - month_daily_avg) / month_daily_avg) * 100
Python version support tiers
requires_python
>=3.9
Cutting Edge
Minimum supported version is 3.12 or newer
• Modern
Minimum supported version is 3.9, 3.10, or 3.11
Legacy
Supports 3.8 or older (or Python 2)
Unknown
No requires_python specified or unparseable
License categories
License
Apache-2.0
• Permissive
MIT, Apache, BSD, ISC, Unlicense, CC0, etc.
Copyleft
GPL, LGPL, AGPL, MPL, EPL, etc.
Proprietary
Commercial, all rights reserved, custom EULAs
Unknown
No license specified, or none of the above match
How the release cadence was determined
Last release
176 days ago
Total releases
73
Releases/year
8.4
Rapid
Last release within 365 days and > 12 releases/year
• Regular
Last release within 365 days
Slow
Last release 366-730 days ago
Stalled
Last release > 730 days ago, or no releases
Unknown
No usable release date available
How contributor risk was determined
Contributors
45
Monthly downloads
4,019,914
High Load
≤ 2 contributors and ≥ 50,000 monthly downloads
Moderate Load
< 10 contributors and ≥ 500,000 monthly downloads
Low Load
< 25 contributors and ≥ 5,000,000 monthly downloads, or sole maintainer with ≥ 10,000 monthly downloads
• Balanced
Enough contributors for the package's popularity
Unknown
No contributor data available
Engagement
52
 
Issue Burden
13.6
per 1k stars
Discussions
0.0
per 1k stars
Fork Ratio
26.2%
contrib / forks
Stale Release
No
 
PR Velocity
Quiet
 

Weekly Downloads

GitHub Stars

Not all downloads include detailed metadata. Breakdowns reflect the subset that does.

Downloads by OS

Linux 80.3K
Windows 1.4K
macOS 839

Python Versions

3.12
42.2% 33.9K
3.10
29.0% 23.3K
3.11
12.2% 9.8K
3.9
9.1% 7.3K
3.13
7.4% 5.9K

Top Countries

1. US US
54.8K
2. JP JP
9.1K
3. CH CH
3.5K
4. SG SG
3.1K
5. NL NL
1.8K
6. IL IL
1.7K
7. ID ID
1.0K
8. NO NO
1.0K
9. FI FI
706
10. GB GB
625

Package Information

License
Apache-2.0
First Release
October 27, 2017
Last Release
5 months ago
Last Commit
5 months ago
Latest Version
2.6.0
Total Releases
73
Contributors
45
Open PRs
2
Archived
No
Wheels
py3
Keywords
machine translation evaluation NLP natural language processing computational linguistics
Tracking Since
January 6, 2026
Data Updated
July 5, 2026
Data Freshness
Fresh

Links