Gym Environment Python Packages

shimmy

An API conversion tool for popular external reinforcement learning environments

craftground

⚡⚡ Lightning Fast (~300TPS) Reinforcement Learning environment on latest Minecraft 🏝️

highway-env

A minimalist environment for decision-making in autonomous driving

rlcard

Reinforcement Learning / AI Bots in Card (Poker) Games - Blackjack, Leduc, Texas, DouDizhu, Mahjong, UNO.

vmas

VMAS is a vectorized differentiable simulator designed for efficient Multi-Agent Reinforcement Learning benchmarking. It is comprised of a vectorized 2D physics engine written in PyTorch and a set of challenging multi-robot scenarios. Additional scenarios can be implemented through a simple and modular interface.

pogema

[ICLR-2025] POGEMA stands for Partially-Observable Grid Environment for Multiple Agents. This is a grid-based environment that was specifically designed to be flexible, tunable and scalable. It can be tailored to a variety of PO-MAPF / MAPF settings.

rtgym

Easily implement custom Gymnasium environments for real-time applications

gym-trading-env

A simple, easy, customizable Gymnasium environment for trading.

rlgym

A Gym-like environment for Reinforcement Learning in Rocket League

evogym

A large-scale benchmark for co-optimizing the design and control of soft robots, as seen in NeurIPS 2021.

tactics2d

Tactics2D: A Reinforcement Learning Environment Library with Generative Scenarios for Driving Decision-making

rlgym-api

A Gym-like environment for Reinforcement Learning in Rocket League

gym-electric-motor

Gym Electric Motor (GEM): An OpenAI Gym Environment for Electric Motors

rlgym-rocket-league

A Gym-like environment for Reinforcement Learning in Rocket League

ratinabox

A python package for simulating movement and spatial cell types (e.g. place cells, grid cells) in continuous environments.

gymnasium-sudoku

Gymnasium-based Sudoku environment for reinforcement learning research/experiments

tile-match-gym

Tile matching gym environment for reinforcement learning research.

loopquest

A Production Tool for Embodied AI

memory-gym

A gym that contains the memory benchmarks Mortar Mayhem, Mystery Maze and Searing Spotlights

easyagents

Reinforcement Learning for Practitioners.

highrl

A library for training robots using RL under the scheme of multi-level RL.

flappy-bird-gym

An OpenAI Gym environment for the Flappy Bird game

drlkit

A High Level Python Deep Reinforcement Learning library. Great for beginners, for prototyping and quickly comparing algorithms

bbs-gym

Terminal-agent that sprees through BBS doors, TUIs, and text worlds.