Bandit Algorithms Python Packages

orts

Odds-Ratio Thompson Sampling: bandits and A/B tests whose baseline keeps moving. Paper: arXiv 2609.19709

pyxab

PyXAB - A Python Library for X-Armed Bandit and Online Blackbox Optimization Algorithms

smpybandits

🔬 Research Framework for Single and Multi-Players 🎰 Multi-Arms Bandits (MAB) Algorithms, implementing all the state-of-the-art algorithms for single-player (UCB, KL-UCB, Thompson...) and multi-player (MusicalChair, MEGA, rhoRand, MCTop/RandTopM etc).. Available on PyPI: https://pypi.org/project/SMPyBandits/ and documentation on

flashspec

Adaptive speculative-decoding inference engine with Triton-optimised verification and online bandit draft selection.

banditzoo

Python library of bandits and RL agents in different real-world environments

contextual-bandits-algos

A comprehensive Python library implementing a variety of contextual and non-contextual multi-armed bandit algorithms—including LinUCB, Epsilon-Greedy, Upper Confidence Bound (UCB), Thompson Sampling, KernelUCB, NeuralLinearBandit, and DecisionTreeBandit—designed for reinforcement learning applications