Brier Score Python Packages

thesis-ci

CI for investment theses: write the tests that would prove a thesis wrong in YAML, lint a research archive so every number cites a filing and public files carry no valuation or advice, freeze each quarter's thresholds once results are out, and Brier-score forecasts. Python CLI and GitHub Action. 中文版: zh-CN/

clef-evals

Calibration-first evaluation toolkit for Cloudflare's Clef decision models. Judge cheap, audit confidence.

asktheboard

A board of expert personas whose every decision is a pre-registered, time-anchored, reality-graded bet. BYOK; the board that keeps score, before the fact.

superior-scoring-rules

Scoring rules like the Brier Score (Mean Squared Error, Quadratic Score) and Log Loss (Cross-Entropy, Negative Log-Likelihood, Logarithmic Score) can favor incorrect predictions. To address this limitation, the Probabilistic Brier Score (PBS) and Probabilistic Logarithmic Loss (PLL) have been introduced for probabilistic classifiers.

augur-cli

Log your forecasts. Resolve them. Find out how good your probabilities actually are. A zero-dependency, local-first calibration journal + practice range for your terminal.