Retrieval Augmented Generation Python Packages

fastembed

Fast, Accurate, Lightweight Python library to make State of the Art Embedding

redisvl

Redis Vector Library (RedisVL) -- the AI-native Python client for Redis.

haystack-ai

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

flashrank

Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cross-encoders and more. Created by Prithivi Da, open for PRs & Collaborations.

flagembedding

Retrieval and Retrieval-augmented LLMs

needle-python

Needle simplifies building RAG pipelines.

langchain-graph-retriever

Graph traversal for improved RAG

graph-retriever

Graph traversal for improved RAG

lightrag-hku

[EMNLP2025] "LightRAG: Simple and Fast Retrieval-Augmented Generation"

clarifai

Experience the power of Clarifai’s AI platform with the python SDK. 🌟 Star to support our work!

colpali-engine

The code used to train and run inference with the ColVision models, e.g. ColPali, ColQwen2, and ColSmol.

mlx-embeddings

MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.

farm-haystack

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

pageindex

📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG

txtai

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

cdklabs-generative-ai-cdk-constructs

AWS Generative AI CDK Constructs are sample implementations of AWS CDK for common generative AI patterns.

raganything

"RAG-Anything: All-in-One RAG Framework"

nvidia-rag

This NVIDIA RAG blueprint serves as a reference solution for a foundational Retrieval Augmented Generation (RAG) pipeline.

cognitx-codegraph

🕸️ Code knowledge graph for Claude Code & AI coding agents — index TypeScript, NestJS, React into Neo4j and query architecture in Cypher

pocketflow

Pocket Flow: 100-line LLM framework. Let Agents build Agents!

local-deep-research

~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted.

fastembed-gpu

Fast, Accurate, Lightweight Python library to make State of the Art Embedding

biocypher

A unifying framework for biomedical research knowledge graphs

mxbai-rerank

Crispy reranking models by Mixedbread