Model Comparison Python Packages

jaxns

Probabilistic Programming and Nested sampling in JAX

regscorepy

This is the repo for a python package that does model comparison between different regression models.

cli-modelarium

Statistically rigorous LLM comparison CLI for terminal-first developers. Compare 10 cloud providers + local models side-by-side with bootstrap confidence intervals, significance testing (paired t-test, McNemar), LLM as judge, hallucination detection, and CI/CD assertions.

finetunecheck

Diagnostic tool for LLM fine-tuning outcomes

dissectml

The missing middle layer between EDA and AutoML — unified pipeline from deep data understanding to model comparison in 3 function calls. Deep EDA, 36-model battle arena, statistical significance testing, target leakage detection, and publication-ready HTML reports.

madys

Manifold Age Determination for Young Stars

bayes-compass

COMPASS: Comparison Of Models using Probabilistic Assessment in Simulation-based Settings

lazygrid

Automatic, efficient and flexible implementation of complex machine learning pipeline generation and cross-validation.

model-compare

model-compare evaluates AI models side‑by‑side based on user tasks, rating accuracy, creativity, and efficiency to guide model choice.

octopus-ml

A collection of handy ML and data visualization and validation tools. Go ahead and train, evaluate and validate your ML models and data with minimal effort.

depth-lens

Cost-vs-accuracy CI for LLM ops. Pick the cheapest API tier, compare self-hosted vLLM vs cloud APIs on one Pareto, and grade free-form output with an LLM-as-judge - all on your own data with Wilson 95% CIs.

llm-bench-cost

Rank LLM APIs by cost-effectiveness against Arena ELO scores · 按 Arena ELO 性价比对 LLM API 实时定价排名

bfas

Brute Force Architecture Search