PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Preference Optimization Python Packages

Python packages with the GitHub topic preference-optimization. Sorted by relevance, with stars and monthly downloads.
warlockee
oxrl

A lightweight post-training framework for LLMs and VLMs

182 17 2
    • Data from PyPI, GitHub, ClickHouse, and BigQuery