Groq Python Packages

agentops

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

agentmake

AgentMake AI: a kit for developing agentic AI applications that support 24 AI backends and and work with 7 agentic components, such as tools and agents. (Developer: Eliran Wong) Supported backends: anthropic, azure, azure_any, cohere, custom, deepseek, genai, github, github_any, googleai, groq, llamacpp, mistral, ollama, openai, vertexai, xai

ai-synapse

Free AI inference router for developers - 21 providers, OpenAI-compatible

bazinga-indeed

BAZINGA - Distributed AI that belongs to everyone

freellmpool

Free LLM API pool: 19 LLM providers cataloged, 235 routes, 355 cataloged chat models, keyless start when available.

compare-prompts

A lightweight CLI tool for evaluating LLM prompts. Run prompts side-by-side to instantly compare token usage, tone, reading level, and API costs. Natively supports OpenAI, Anthropic, Gemini, Groq, and Ollama. Perfect for safely refactoring prompts, tuning bot personalities, or proving that "be concise" actually lowers your bill.

poe-api-wrapper

👾 A Python API wrapper for Poe.com. With this, you will have free access to GPT-4, Claude, Llama, Gemini, Mistral and more! 🚀

celai

Open source framework designed to accelerate the development of omnichannel AI virtual assistants.

pytector

Easy to use LLM Prompt Injection Detection and Prompt Input Sanitization / Detector Python Package with support for local models, API-based safeguards, and LangChain guardrails.

toolmate

ToolMate AI, developed by Eliran Wong, is a cutting-edge AI companion that seamlessly integrates agents, tools, and plugins to excel in conversations, generative work, and task execution. Supports custom workflow and plugins to automate multi-step actions.

aipdf

A tool to OCR PDFs using gen-AI models

freelm

Free, always-up LLM client & gateway for Python and TypeScript — one OpenAI-compatible API over free-tier OpenRouter, Google Gemini, NVIDIA NIM, Groq, Cerebras & Mistral with automatic failover, key rotation, streaming and live model discovery.

commify

Commify: You Should Commit Yourself. Commify is a CLI tool that generates meaningful, structured commit messages for Git repositories using AI.

iflow-mcp-astrabert-tysva

Learn TypeScript chatting effortlessly with AI

freeride-gateway

One free AI endpoint, every free tier behind it. Local OpenAI-compatible gateway routing across OpenRouter, Groq, NVIDIA NIM, Cloudflare Workers AI, and HuggingFace with automatic failover.

lakshana

Zero-config schema discovery for document collections. Drop a folder of PDFs, get a JSON Schema.

dct-agent

Multi-server AI agent supporting Ollama, OpenAI-compatible providers (DeepSeek, Qwen, Groq) & OpenRouter. Multi-agent squads, DAG orchestration, background tasks, vision, and autonomous coding tools.

toolmate-lite

ToolMate AI, developed by Eliran Wong, is a cutting-edge AI companion that seamlessly integrates agents, tools, and plugins to excel in conversations, generative work, and task execution. Supports custom workflow and plugins to automate multi-step actions.

youtube-dubber

Dub any YouTube video into Hindi (and 19 other languages) with a casual, engaging neural voice.

pi-coding-agent

A minimal terminal AI coding agent — LLM tool-use loop with sandboxed file/shell tools

cascade-review

AI-powered code reviewer with SonarQube rule simulation, blast radius analysis, and LLM change summary. Routes across local (Ollama), Groq, OpenRouter, Claude, Gemini, and OpenAI. Zero setup cost. Works as a CLI and GitHub Action.

cli-fsd

LLM-enabled companion utility for your terminal.

toolmate-android

ToolMate AI, developed by Eliran Wong, is a cutting-edge AI companion that seamlessly integrates agents, tools, and plugins to excel in conversations, generative work, and task execution. Supports custom workflow and plugins to automate multi-step actions.

llmkit-cli

Run any LLM with one config file. No framework lock-in.