Groq Python Packages

agentops

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

hazzel

A terminal coding agent you can actually read — every change shown as a diff before it touches disk.

agentmake

AgentMake AI: a kit for developing agentic AI applications that support 24 AI backends and and work with 7 agentic components, such as tools and agents. (Developer: Eliran Wong) Supported backends: anthropic, azure, azure_any, cohere, custom, deepseek, genai, github, github_any, googleai, groq, llamacpp, mistral, ollama, openai, vertexai, xai

ai-jury

Stdlib-only Python CLI that orchestrates universal AI agent providers (Claude Code, Codex, Antigravity, OpenRouter, DeepSeek, Groq, local models, Aider) into a multi-agent PR review jury — debate, verify, synthesize one verdict. Local-first, secure by default.

mforege

A personal AI agent CLI — file/shell tools, long-term memory, live diffs, and an IDE-style terminal UI. pip install mforege

bazinga-indeed

BAZINGA - Distributed AI that belongs to everyone

celai

Open source framework designed to accelerate the development of omnichannel AI virtual assistants.

modelhop

Intelligent LLM router that saves 60-90% on API costs by hopping to the cheapest capable model

boothpy

A lightweight, zero-dependency Python checkpoint layer for structured LLM output reliability.

neutral-llm-gateway

Neutral LLM gateway: typed contracts, provider adapters, explicit retry/fallback/usage/cost accounting.

hermes-legal-advisor

Free, multi-provider AI contract analysis. Scores risk, suggests redlines, gives a sign/negotiate/reject verdict. Works with Groq/Gemini free tiers or fully offline, no API key required.

cadre-ai

A team of AI agents that builds or finishes a project on free model keys, spreading work across every provider and staying inside each one's limits.

freellmpool

Free LLM gateway: 22 LLM providers, 178 enabled chat routes, 431 cataloged chat models; keyless start when available.

commify

Commify: You Should Commit Yourself. Commify is a CLI tool that generates meaningful, structured commit messages for Git repositories using AI.

cachellm-proxy

A drop-in semantic cache for LLM APIs. One proxy routes to OpenAI, Gemini, Groq, Claude, Ollama and Bedrock. 77% hit rate, 78% lower cost, zero wrong answers on new questions.

aipdf

A tool to OCR PDFs using gen-AI models

pytector

Easy to use LLM Prompt Injection Detection and Prompt Input Sanitization / Detector Python Package with support for local models, API-based safeguards, safeguard for tool calls, and LangChain guardrails.

freelm

Free LLM API for Python & Node.js: a free-only, lightweight LiteLLM/OpenRouter alternative. One OpenAI-compatible client and local /v1 endpoint over Gemini, Groq, OpenRouter, Cloudflare, Mistral, NIM, Z.ai, Cohere & Kilo, with LLM fallback that races slow providers and key rotation. Works with no API keys.

freeride-gateway

One free AI endpoint, every free tier behind it. Local OpenAI-compatible gateway routing across OpenRouter, Groq, NVIDIA NIM, Cloudflare Workers AI, and HuggingFace with automatic failover.

cli-fsd

Natural language interface for AI

llmswap

Ask, compare, and synthesize across 10 LLM providers. Python SDK, CLI, local Arena, MCP, and privacy-aware

poe-api-wrapper

👾 A Python API wrapper for Poe.com. With this, you will have free access to GPT-4, Claude, Llama, Gemini, Mistral and more! 🚀

llm-project-generator

Generate tested terminal LLM chatbot projects for Groq, Google Gemini, OpenAI, and Anthropic Claude.

pocketgroq

PocketGroq is a powerful Python library that simplifies integration with the Groq API, offering advanced features for natural language processing, web scraping, and autonomous agent capabilities. Key Features Seamless integration with Groq API for text generation and completion Chain of Thought (CoT) reasoning for complex problem-solving and more.