Data Selection Python Packages

transformers-domain-adaptation

:no_entry: [DEPRECATED] Adapt Transformer-based language models to new text domains

data-selection

Data Selection with Importance Resampling

scar-tool

[ACL 2025 main] SCAR: Data Selection via Style Consistency-Aware Response Ranking for Efficient Instruction-Tuning of Large Language Models

dataflex

Data-centric LLM training with dynamic sample selection, domain mixture optimization, and example reweighting inside the LLaMA-Factory training loop.

gen-dedup

Generative deduplication