llm-optimization
Make local LLM inference faster with chunk-level KV cache reuse
Unified local search and indexing for Claude and other AI tools
Nadir is a Python package designed to dynamically choose the best llm for your prompt by balancing complexity and cost and response time.
build unstructured to structured data transformation pipelines