Mistral Python Packages

liger-kernel

Efficient Triton Kernels for LLM Training

agentops

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

liger-kernel-nightly

Efficient Triton Kernels for LLM Training

agentkthx

⚛️ AgentKthx - minimal, modular, python stdlib, agentic framework for tool calling AI agents. Runs locally with Ollama, BitNet, TurboQuant, in the cloud with OpenRouter, ZAI, HuggingFace, and Google Gemini. Extensible via a manifest-based plugin system for additional backends and features.

agentmake

AgentMake AI: a kit for developing agentic AI applications that support 24 AI backends and and work with 7 agentic components, such as tools and agents. (Developer: Eliran Wong) Supported backends: anthropic, azure, azure_any, cohere, custom, deepseek, genai, github, github_any, googleai, groq, llamacpp, mistral, ollama, openai, vertexai, xai

nemo-automodel

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

airunner

Offline inference engine for art, real-time voice conversations, LLM powered chatbots and automated workflows

local-deep-research

~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted.

bytez

1 API key. 220,000+ AI models. Bytez is the largest serverless Model Inference API on the internet. Let's build ✨

intelli

Build multi-model chatbots and agents from intent, with Claude Code and Codex.

openllm

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

agentnova

⚛️ AgentKthx - minimal, modular, python stdlib, agentic framework for tool calling AI agents. Runs locally with Ollama, BitNet, TurboQuant, in the cloud with OpenRouter, ZAI, HuggingFace, and Google Gemini. Extensible via a manifest-based plugin system for additional backends and features.

openllm-client

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

padwan-ai

Minimal, provider-agnostic Python client for large language models, built on niquests.

vibepod

Unified CLI for running AI coding agents in isolated containers. Includes built-in local metrics collection, HTTP traffic tracking, and an analytics dashboard to track agent actions.

ludwig

Low-code framework for building custom LLMs, neural networks, and other AI models

openllm-core

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

padwan-llm

Minimal, provider-agnostic Python client for large language models, built on niquests.

llmtranslate

A Python library for language detection and translation using langchain ChatModels

freelm

Free LLM API for Python & Node.js: a free-only, lightweight LiteLLM/OpenRouter alternative. One OpenAI-compatible client and local /v1 endpoint over Gemini, Groq, OpenRouter, Cloudflare, Mistral, NIM, Z.ai, Cohere & Kilo, with LLM fallback that races slow providers and key rotation. Works with no API keys.

onellm

Unified interface for interacting with various LLMs hundreds of models, caching, fallback mechanisms, and enhanced reliability.

maxtext

A simple, performant, and scalable Jax LLM!

poe-api-wrapper

👾 A Python API wrapper for Poe.com. With this, you will have free access to GPT-4, Claude, Llama, Gemini, Mistral and more! 🚀

friendli-client

[⛔️ DEPRECATED] Friendli: the fastest serving engine for generative AI