PyRank

Swe Bench Python Packages

Python packages with the GitHub topic swe-bench. Sorted by relevance, with stars and monthly downloads.
sipyourdrink-ltd
bernstein

Audit-grade multi-agent orchestration for CLI coding agents (Claude Code, Codex, Gemini CLI, +40 more). HMAC-chained audit log, signed agent cards, per-artefact lineage, air-gap deploy. The orchestrator your compliance team will sign off on. https://bernstein.run

174K 634 57
greynewell
mcpbr

Benchmark your MCP server.

3K 10 2
xmpuspus
awb

Benchmark harness measuring AI coding tool+workflow performance, not just model capability. 100 tasks, sigmoid scoring, 12 capability dimensions, gap analysis.

2K 10 5
scitix
agent-sandbox-e2b

Fast, Multi-Cloud Sandbox Engine for AI Agents

2K 8 0
0bserver07
chimera-run

Open-source Python framework for building coding agents. Pick your provider, pick your tools, pick your loop. Chimera wires them together. Recreate SWE-Agent, Aider, Cline, Codex in a few lines, or design something entirely new.

1K 1 0
vishal-dehurdle
state-harness

Runtime safety net for LLM agents. Detects token spirals, kills doomed tasks early, tells you exactly why. Rust core, Python SDK. pip install state-harness

1K 16 2
scitix
agent-sandbox-harbor

Fast, Multi-Cloud Sandbox Engine for AI Agents

1K 8 0
razroo
state-trace

Agent state infrastructure: state-trace Python working memory plus @razroo/parallel-mcp durable MCP orchestration.

634 2 0
semcod
qualbench

CI for AI-generated code — measures production readiness, not just correctness

627 0 0
ahmedEid1
forgejudge

Open, always-on leaderboard + CI gate for autonomous coding agents — every patch sandboxed, every run traced, every regression fails the build. $0 stack.

598 0 1
he-yufeng
issuebenchkit

Turn a real GitHub issue into a repeatable coding-agent benchmark task

568 3 0
stzifkas
agent-sieve

Transparent feedback compression middleware for LLM coding agents

565 1 3
smallcloudai
refact

A python client to refact-lsp server

428 4K 318
shreyash-sharma
provenant

Wiki-based retrieval for AI coding agents. 65× token reduction, +24pp Coverage@5 on SWE-bench Verified.

420 24 12
KRLabsOrg
squeez

Squeeze verbose LLM agent tool output down to only the relevant lines

352 20 0
omnipotence-eth
godspeed-coding-agent

Security-first open-source coding agent with parallel tool execution, multimodal input, 4-tier permissions, audit trails, and 200+ LLM provider support

236 0 0
HumphreySun98
repoagentbench

SWE-bench for your codebase. Turn merged PRs into reproducible coding-agent benchmarks.

160 32 0