PyRank

Preference Optimization Python Packages

Python packages with the GitHub topic preference-optimization. Sorted by monthly downloads, with stars and forks.
warlockee
oxrl

A lightweight post-training framework for LLMs and VLMs. 51 algorithms, 38 verified models. Scales with DeepSpeed, vLLM, and Ray.

160 20 2