PyRank

Lightseek Python Packages

Python packages with the GitHub topic lightseek. Sorted by monthly downloads, with stars and forks.
lightseekorg
tokenspeed-mla

TokenSpeed is a speed-of-light LLM inference engine.

2.1M 3K 342
smg-project
smg-grpc-proto

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

1.3M 565 185
smg-project
smg-grpc-servicer

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

1.2M 565 185
smg-project
tokenspeed-smg

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

12K 565 185
smg-project
tokenspeed-smg-grpc-proto

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

10K 565 185
smg-project
tokenspeed-smg-grpc-servicer

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

10K 565 185
smg-project
smg

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

9K 565 185
lightseekorg
tokenspeed-cutedsl-kda

TokenSpeed is a speed-of-light LLM inference engine.

3K 3K 342
lightseekorg
tokenspeed

TokenSpeed is a speed-of-light LLM inference engine.

567 3K 342
lightseekorg
tokenspeed-kernel-amd

TokenSpeed is a speed-of-light LLM inference engine.

542 3K 342
lightseekorg
tokenrl

TokenSpeed is a speed-of-light LLM inference engine.

108 3K 342
lightseekorg
tokenspeed-kernel-npu

TokenSpeed is a speed-of-light LLM inference engine.

89 3K 342
lightseekorg
tokenspeed-situ

TokenSpeed is a speed-of-light LLM inference engine.

62 3K 342
lightseekorg
tokenspeed-trtllm-kda

TokenSpeed is a speed-of-light LLM inference engine.

1 3K 342