chunking-algorithm
🦛 CHONK docs with Chonkie ✨ — The lightweight ingestion library for fast, efficient and robust RAG pipelines
FastCDC implementation in Python https://pypi.org/project/fastcdc/
A high-performance FastCDC 2020 implementation written in Python + Cython
