Llamacpp Python Packages

spark-nlp

State of the Art Natural Language Processing

1.2M 4K 742

drydock-cli

Local-first TUI coding agent for Gemma 4 + llama.cpp. Built-in GraphRAG retrieval and cookbook of domain recipes. Install: pip install drydock-agent (renamed from drydock-cli).

86K 1 1

khoj

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.

39K 35K 2K

xinference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

28K 9K 844

gptme

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!

26K 4K 395

khoj-assistant

12K 35K 2K

llama-cpp-agent

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.

10K 648 71

ramalama

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

8K 3K 348

pyllamacpp

Python bindings for llama.cpp

6K 68 24

jang

JANG — GGUF for MLX. YOU MUST USE JANG_Q RUNTIME. Adaptive Mixed-Precision Quantization + Runtime for Apple Silicon

6K 201 24

drydock-agent

Local-first TUI coding agent for Gemma 4 + llama.cpp. Built-in GraphRAG retrieval and cookbook of domain recipes. Install: pip install drydock-agent (renamed from drydock-cli).

4K 1 1

easy-llama

Python package wrapping llama.cpp for on-device LLM inference

4K 106 7

toolmate

ToolMate AI, developed by Eliran Wong, is a cutting-edge AI companion that seamlessly integrates agents, tools, and plugins to excel in conversations, generative work, and task execution. Supports custom workflow and plugins to automate multi-step actions.

3K 178 23

llmware

Unified framework for building enterprise RAG pipelines with small, specialized models

3K 15K 3K

lexicont

Policy-driven agent for real-time text moderation

3K 1 1

translate-shell

Translate text by google, bing, youdaozhiyun, haici, stardict, openai, large language model of local machine, etc at same time from CLI, GUI (GNU/Linux, Android, macOS and Windows), REPL, python, shell and vim.

2K 52 3

steadytext

Deterministic text generation and embeddings with zero configuration

2K 44 3

developergpt

DeveloperGPT is a LLM-powered command line tool that enables natural language to terminal commands and in-terminal chat.

2K 45 5

claude-codex-local

Local backend bridge for Claude Code, Codex, and Pi.

2K 36 1

toolmate-lite

2K 178 23

toolmate-android

1K 178 23

exxa

Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and minimal learning curve.

1K 27 4

llama-optimus

llama-optimus is a lightweight Python tool to automatically optimize llama.cpp performance flags for maximum tg & pp token/s throughput. Powered by Bayesian optimization with Optuna

1K 39 6

urban-worm

Workflow of reproducible multimodal inference for urban environment evaluation.

1K 5 4