Retrieval Augmented Generation Python Packages

fastembed

Fast, Accurate, Lightweight Python library to make State of the Art Embedding

redisvl

Redis Vector Library (RedisVL) -- the AI-native Python client for Redis.

haystack-ai

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

flashrank

Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cross-encoders and more. Created by Prithivi Da, open for PRs & Collaborations.

flagembedding

Retrieval and Retrieval-augmented LLMs

lightrag-hku

[EMNLP2025] "LightRAG: Simple and Fast Retrieval-Augmented Generation"

needle-python

Needle simplifies building RAG pipelines.

graph-retriever

Graph traversal for improved RAG

langchain-graph-retriever

Graph traversal for improved RAG

colpali-engine

The code used to train and run inference with the ColVision models, e.g. ColPali, ColQwen2, and ColSmol.

clarifai

Experience the power of Clarifai’s AI platform with the python SDK. 🌟 Star to support our work!

mlx-embeddings

MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.

farm-haystack

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

pageindex

📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG

txtai

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

pocketflow

Pocket Flow: 100-line LLM framework. Let Agents build Agents!

raganything

"RAG-Anything: All-in-One RAG Framework"

cdklabs-generative-ai-cdk-constructs

AWS Generative AI CDK Constructs are sample implementations of AWS CDK for common generative AI patterns.

fastembed-gpu

Fast, Accurate, Lightweight Python library to make State of the Art Embedding

biocypher

A unifying framework for biomedical research knowledge graphs

local-deep-research

~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted.

mxbai-rerank

Crispy reranking models by Mixedbread

autorag

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

vaultspec-rag

GPU-accelerated semantic search for your docs and source code - hybrid dense + sparse RAG on a local Qdrant backend, served to Claude Code and other MCP clients. The search companion to vaultspec-core.