Mlx Python Packages

einops

Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)

mlx-lm

Run LLMs with MLX

mlx

MLX: An array framework for Apple silicon

mlx-vlm

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

mlx-metal

MLX: An array framework for Apple silicon

mlx-audio

A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

mlx-whisper

Examples in the MLX framework

transformerlab

The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.

rapid-mlx

The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replacement. Works with Claude Code, Cursor, Aider.

mlx-cpu

MLX: An array framework for Apple silicon

mflux

MLX native implementations of state-of-the-art generative image models

flama

The production framework for Predictive and Generative AI. Serve any model as an API in one line, with OpenAI/Anthropic/Ollama-compatible endpoints, a built-in chat UI, and native MCP.

ltcai

Local-first private AI memory layer / Digital Brain for conversations, documents, decisions, and model-agnostic knowledge.

llmfit

Hundreds of models & providers. One command to find what runs on your hardware.

mlx-openai-server

A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI framework, it provides an efficient, scalable, and user-friendly solution for running MLX-based vision and language models locally with an OpenAI-compatible interface.

mlx-cuda-13

MLX: An array framework for Apple silicon

mlx-tune

Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.

vmlx

vMLX - JANGTQ Uber Compressed MLX Models - L2 Disk Cache (survives restart) + L1 Paged (super fast ttft) + Hybrid SSM Scheduler + Cont Batching + etc!

mlx-code

Git-Native Coding Agent for Mac

mlx-gen

Generative image model runtimes for MLX.

squish-ai

⚡️ The fastest way to run local LLMs on Apple Silicon — sub-second model loads, beats Ollama on throughput, tail latency, and full-response time. OpenAI/Ollama-compatible. No cloud, no API keys.

veloxquant-mlx

TurboQuant MLX implementation for Apple Silicon Faster KV cache quantization optimized for MLX

omi-med-stt

On-device English medical speech-to-text — CLI for Omi Med STT v1 (MLX / NeMo / parakeet.cpp)

pyroboframes

Fast ML dataloader for robot learning. LeRobot datasets, hardware video decode, multi-output formats (NumPy/MLX/PyTorch/JAX).