PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Llm Optimization Python Packages

Python packages with the GitHub topic llm-optimization. Sorted by relevance, with stars and monthly downloads.
pythongiant
kvboost

Make LLM inference faster with chunk-level KV cache reuse

1K 7 0
lucifer-ux
contextcore

ContextCore: An MCP server for Claude (or any AI tool) that enables massive token saving through hybrid search (BM25 + Embeddings)

381 20 5
doramirdor
nadir-llm

Nadir is a Python package designed to dynamically choose the best llm for your prompt by balancing complexity and cost and response time.

281 68 3
villagecomputing
superpipe-py

build unstructured to structured data transformation pipelines

243 108 2
villagecomputing
labelkit

Superpipe - optimized LLM pipelines for structured data

180 108 2
    • Data from PyPI, GitHub, ClickHouse, and BigQuery