Chunking Algorithm Python Packages

chonkie

🦛 CHONK docs with Chonkie ✨ — The lightweight ingestion library for fast, efficient and robust RAG pipelines

fastcdc

FastCDC implementation in Python https://pypi.org/project/fastcdc/

pyfastcdc

A high-performance FastCDC 2020 implementation written in Python + Cython

chunk-your-tools

Chunk MCP tools: Tool with required properties; optional Properties and Enums

chunk-your-skills

Chunk Skills: Frontmatter; Index of markdown headers 2 nodes; recompose with PageIndex natural page form

lumberjack-py

Structure-aware document splitter for RAG — parses any document into a unified AST and chunks by section/block boundaries. 面向 RAG 的结构感知文档分割器——将任何文档解析为统一的 AST，并按节/块边界进行分割。

raglens-toolkit

A ground-up, provider-agnostic toolkit for building, benchmarking, and rigorously evaluating Retrieval-Augmented Generation systems — structure-aware PDF ingestion, five retrieval strategies, and RAGAS end-to-end evaluation, wrapped in a pip install-able CLI and a Streamlit dashboard.