content-defined-chunking
For Python apps that ship data to devices: each one checks it's genuine, downloads only changes, and searches offline.
Find (partial content) duplicate files.
Open-source toolkit for lossless, reference-based reconstruction of large binary artifacts using deterministic CDC and compact SBD1 seeds.
Print FastCDC rolling hash chunks and checksums.
Steadlith reuses unchanged RAG chunks with content-defined identities, cache-aware planning, and transactional indexing.
🧬 The 21st Century Data Format for AI. CDC deduplication, Zero-Download cloud streaming, O(1) random access. Built in Rust.
