megatron-core has 188K monthly downloads and 17K GitHub stars. Version 0.18.0 supports Python 3.12+, first published in 2023.
It is actively maintained under a permissive license, last released in Jun 2026.
It is built on top of numpy, packaging and torch. It is used by 11 tracked packages, including mcore-bridge, sapiens-transformers and megatron-bridge.
GitHub topics include large-language-models, model-para and transformers.
Package Insights
((week_daily_avg - month_daily_avg) / month_daily_avg) * 100Weekly Downloads
GitHub Stars
Downloads by OS
Python Versions
Top Countries
Dependencies
37 optional dependencies
- accelerate[mlm]
- accelerate[training]
- av[dev]
- causal-conv1d[ssm]
- datasets[dev]
- einops[dev]
- emerging-optimizers[dev]
- fastapi[dev]
- flash-linear-attention[dev]
- flashinfer-python[dev]
- flask-restful[mlm]
- flask-restful[training]
- hypercorn[dev]
- mamba-ssm[ssm]
- megatron-energon[dev]
- multi-storage-client[dev]
- nvidia-modelopt[dev]
- nvidia-resiliency-ext[dev]
- omegaconf[training]
- omegaconf[mlm]
- onnxscript[dev]
- openai[dev]
- opentelemetry-api[dev]
- orjson[dev]
- quart[dev]
- sentencepiece[mlm]
- sentencepiece[training]
- tensorstore[dev]
- tiktoken[training]
- tiktoken[mlm]
- tqdm[dev]
- transformer-engine[te]
- transformers[mlm]
- transformers[training]
- wandb[mlm]
- wandb[training]
- wget[dev]