Marl Python Packages

torchrl

A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.

torchrl-nightly

A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.

multi-agent-rlenv

Strongly typed reinforcement learning environment framework

jaxmarl

Multi-Agent Reinforcement Learning with JAX

vmas

VMAS is a vectorized differentiable simulator designed for efficient Multi-Agent Reinforcement Learning benchmarking. It is comprised of a vectorized 2D physics engine written in PyTorch and a set of challenging multi-robot scenarios. Additional scenarios can be implemented through a simple and modular interface.

pogema

[ICLR-2025] POGEMA stands for Partially-Observable Grid Environment for Multiple Agents. This is a grid-based environment that was specifically designed to be flexible, tunable and scalable. It can be tailored to a variety of PO-MAPF / MAPF settings.

benchmarl

BenchMARL is a library for benchmarking Multi-Agent Reinforcement Learning (MARL). BenchMARL allows to quickly compare different MARL algorithms, tasks, and models while being systematically grounded in its two core tenets: reproducibility and standardization.

generals

Develop your agent for generals.io!

pymarlzooplus

An Extended Benchmarking of Multi-Agent Reinforcement Learning Algorithms in Complex Fully Cooperative Tasks

sorrel

A Python interface for simple and flexible MARL environments.

xdrl

🔬 Explainability for deep RL.

marl

Multi-agent reinforcement learning framework