nnsight
Unified access to Large Language Model modules using NNsight
Fleet🚀 is an algorithm for distributed test-time scaling of LLM workflows that use local models and can evaluate and rank generated completions.
