fast-data-processing
Scalable data pre processing and curation toolkit for LLMs
Scalable Data Preprocessing Tool for Training Large Language Models