Leaderboard Python Packages

evalica

Evalica, your favourite evaluation toolkit

scandeval

The robust European language model benchmark.

elf

A modern Advent of Code helper that fetches inputs, submits answers, and tracks your progress.

polymarket-paper-trader

Paper trading simulator for Polymarket

euroeval

The robust European language model benchmark.

coinrithm-sdk

Let any AI agent (Claude, ChatGPT/Codex, Gemini) paper-trade on CoinRithm with a key you mint and control. Hosted MCP, local MCP, OpenAPI, skill + prompts.

screamingface

ScreamingFace is an open toolkit for composing model fusions: several models answering together, graded against a real research benchmark. Every run reproduces from a single line, on your own keys.

xcpcio

The ICPC Series Competition Leaderboard Visualization Engine

hwbench

Linux hardware info and benchmark CLI in Python (CPU, GPU, memory, disk), with a public leaderboard scored against a reference machine (1000 points).

mlx-chronos

Community-driven benchmark suite for MLX inference engines on Apple Silicon

agentsynth-ai

Outcome-verified agent trajectories, benchmarks, and RL environments — with a live leaderboard and a CI gate for your agents. Offline-first, MIT.

cogdl

CogDL: A Comprehensive Library for Graph Deep Learning (WWW 2023)

floweringagents-mcp

🌸 A living registry where AI agent systems are seen for what they actually build. Donation-supported. Olympic spirit. Entry #0001.

forgejudge

Open, always-on leaderboard + CI gate for autonomous coding agents — every patch sandboxed, every run traced, every regression fails the build. $0 stack.

url4

ScreamingFace is an open toolkit for composing model fusions: several models answering together, graded against a real research benchmark. Every run reproduces from a single line, on your own keys.

glossobench

Open-source, judge-agnostic LLM benchmark for any language — natural or AI-developed. Turn hours to minutes, save days of benchmark cost! Public data, no gate, $0 offline evaluation.

arenakit

Bradley-Terry leaderboards with simultaneous confidence control — across 106,134 LMArena votes only 1 of 54 neighbouring pairs survives, against 5 when each is judged on its own.

wakatime-leaderboards

Display your Wakatime Leaderboards Stats in your GitHub profile

lightmlboard

Light implementation of a leaderboard for a machine learning competition

sightread

Exact game-state extraction benchmark for vision-language models - can VLMs read the board at first sight?

ghfind

Discover the best developers — and become one. Drop a GitHub handle for a 0–100 value & trust score in 30s: see your gaps, discover top devs, get found. Exposes PR farmers, AI bots & fork-hoarders. Deterministic scoring, self-hostable.

luna-ml

Luna ML - ML Leaderboard for your team with automatic model evaluation

sensebench

LLM leaderboard for English Word Sense Disambiguation on lexEN, a lexicographer-verified WSD evaluation dataset.

leaderboard-summarizer

Extracts and organizes leaderboard/ranking data from text via smart pattern matching and retries, delivering clean, structured summaries effortlessly.