swebench has 47.7M monthly downloads and 5K GitHub stars. Version 4.1.0 supports Python 3.10+, first published in 2023.
It is stably maintained under a permissive license, last released in Sep 2025.
It is built on top of beautifulsoup4, chardet and datasets. It is used by 7 tracked packages, including swekit, benchmaker and sweagent.
GitHub topics include benchmark, language-model and software-engineering.
Package Insights
- No releases in 188 days despite active commits
((week_daily_avg - month_daily_avg) / month_daily_avg) * 100Weekly Downloads
GitHub Stars
Downloads by OS
Python Versions
Top Countries
Dependencies
- beautifulsoup4
- chardet
- datasets
- docker
- ghapi
- gitpython
- modal
- pre-commit
- python-dotenv
- requests
- rich
- tenacity
- tqdm
- unidiff
29 optional dependencies
- anthropic[inference]
- anthropic[datasets]
- flash-attn[inference]
- jedi[inference]
- jedi[datasets]
- mike[docs]
- mkdocs[docs]
- mkdocs-glightbox[docs]
- mkdocs-include-markdown-plugin[docs]
- mkdocs-material[docs]
- mkdocstrings[docs]
- mkdocstrings-python[docs]
- openai[datasets]
- openai[inference]
- peft[inference]
- protobuf[datasets]
- protobuf[inference]
- pymdown-extensions[docs]
- pytest[test]
- pytest-cov[test]
- requests[inference]
- sentencepiece[datasets]
- sentencepiece[inference]
- tiktoken[datasets]
- tiktoken[inference]
- torch[inference]
- transformers[datasets]
- transformers[inference]
- triton[inference]