PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Prefix Cache Python Packages

Python packages with the GitHub topic prefix-cache. Sorted by relevance, with stars and monthly downloads.
jjang-ai
vmlx

vMLX - JANGTQ Uber Compressed MLX Models - L2 Disk Cache (survives restart) + L1 Paged (super fast ttft) + Hybrid SSM Scheduler + Cont Batching + etc!

9K 736 80
Venkat2811
wombatkv

Object-storage-native KV cache for LLM inference & RL. Cross-restart, cross-conversation, cross-engine via shared S3 bucket.

133 14 1
    • Data from PyPI, GitHub, ClickHouse, and BigQuery