Retrieval Augmented Generation Python Packages

fastembed

Fast, Accurate, Lightweight Python library to make State of the Art Embedding

redisvl

Redis Vector Library. The AI-native Python client for Redis.

haystack-ai

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

flagembedding

Retrieval and Retrieval-augmented LLMs

flashrank

Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cross-encoders and more. Created by Prithivi Da, open for PRs & Collaborations.

graph-retriever

Graph traversal for improved RAG

langchain-graph-retriever

Graph traversal for improved RAG

pageindex

📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG

lightrag-hku

[EMNLP2025] LightRAG: Simple and Fast Retrieval-Augmented Generation

colpali-engine

The code used to train and run inference with the ColVision models, e.g. ColPali, ColQwen2, and ColSmol.

needle-python

Needle simplifies building RAG pipelines.

farm-haystack

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

pocketflow

Pocket Flow: 100-line LLM framework. Let Agents build Agents!

cdklabs-generative-ai-cdk-constructs

AWS Generative AI CDK Constructs are sample implementations of AWS CDK for common generative AI patterns.

clarifai

Experience the power of Clarifai’s AI platform with the python SDK. 🌟 Star to support our work!

txtai

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

fastembed-gpu

Fast, Accurate, Lightweight Python library to make State of the Art Embedding

mlx-embeddings

MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.

biocypher

A unifying framework for biomedical research knowledge graphs

knowledge-rag

Local RAG MCP server for Claude Code — hybrid search (semantic + BM25), cross-encoder reranking, 13 MCP tools, 20 format parsers. Zero external servers, zero API keys.

mxbai-rerank

Crispy reranking models by Mixedbread

schemarouter

Typed capability routing and governed execution for AI agents across APIs, tools, and data systems.

axon-rag

Local-first RAG engine with cited answers from your own docs. GraphRAG, sealed sharing, MCP-native, VS Code Copilot integration. Nothing leaves your machine.

raganything

"RAG-Anything: All-in-One RAG Framework"