torchrl has 1.1M monthly downloads and 3K GitHub stars. Version 0.13.2 supports Python 3.10+, first published in 2018.
It is actively maintained, last released in Jun 2026.
It is built on top of cloudpickle, hoptorch and numpy. It is used by 19 tracked packages, including infralib, rl4co and benchmarl.
GitHub topics include ai, control and decision-making.
Package Insights
((week_daily_avg - month_daily_avg) / month_daily_avg) * 100Weekly Downloads
GitHub Stars
Downloads by OS
Python Versions
Top Countries
Dependencies
- cloudpickle
- hoptorch >=0.1.4
- numpy
- packaging
- pyvers
- tensordict <0.14.0,>=0.13.0
- torch >=2.1.0
82 optional dependencies
- accelerate[grpo]
- accelerate[llm]
- autoflake[dev]
- autoflake[utils]
- autopep8[utils]
- bitsandbytes[grpo]
- botorch[pilco]
- brax[brax]
- datasets[llm]
- dm-control[dm-control]
- dm-meltingpot[marl]
- einops[llm]
- flash-attn[grpo]
- genesis-world[genesis]
- gpytorch[pilco]
- gymnasium[gym-continuous]
- gymnasium[atari]
- h5py[offline-data]
- huggingface-hub[offline-data]
- hydra-core[utils]
- hydra-submitit-launcher[utils]
- immutabledict[llm]
- jax[brax]
- langdetect[llm]
- minari[offline-data]
- moviepy[rendering]
- mujoco[gym-continuous]
- nltk[llm]
- open-spiel[open-spiel]
- pandas[offline-data]
- peft[grpo]
- pettingzoo[marl]
- pillow[offline-data]
- playwright[llm]
- pre-commit[utils]
- pre-commit[dev]
- procgen[procgen]
- protobuf[llm]
- psutil[tests]
- pytest[tests]
- pytest-asyncio[tests]
- pytest-benchmark[tests]
- pytest-cov[tests]
- pytest-error-for-skips[tests]
- pytest-forked[tests]
- pytest-instafail[tests]
- pytest-isolate[tests]
- pytest-mock[tests]
- pytest-random-order[tests]
- pytest-repeat[tests]
- pytest-rerunfailures[tests]
- pytest-timeout[tests]
- pyyaml[tests]
- ray[grpo]
- requests[offline-data]
- safetensors[llm]
- scikit-learn[offline-data]
- scipy[tests]
- sentencepiece[llm]
- sglang[llm-sglang]
- sglang[llm-all]
- tensorboard[utils]
- torch[replay-buffer]
- torchcodec[rendering]
- torchcodec[video]
- torchrl[grpo]
- torchrl[llm-all]
- torchrl[llm-sglang]
- torchrl[llm-vllm]
- torchsnapshot[checkpointing]
- torchvision[offline-data]
- tqdm[grpo]
- tqdm[offline-data]
- tqdm[utils]
- transformers[grpo]
- transformers[llm]
- vllm[llm-all]
- vllm[llm-vllm]
- vmas[marl]
- wandb[grpo]
- wandb[utils]
- xformers[grpo]