Open Source Llm Python Packages

openllm

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

openllm-core

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

openllm-client

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

gittxt

Gittxt: Get Text from Git — Optimized for AI.

sagify

Machine Learning Training, Tuning and Deployment on AWS

vulkan-ilm

Pythonic LLM inference on legacy GPUs using Vulkan — GPU-accelerated local AI for AMD, Intel, and NVIDIA without CUDA.