Llama3 Python Packages

unsloth

Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.6, DeepSeek, gpt-oss locally.

unsloth-zoo

Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.6, DeepSeek, gpt-oss locally.

llamafactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

liger-kernel

Efficient Triton Kernels for LLM Training

liger-kernel-nightly

Efficient Triton Kernels for LLM Training

khoj

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.

xinference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

nemo-automodel

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

khoj-assistant

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.

maxtext

A simple, performant, and scalable Jax LLM!

bytez

1 API key. 220,000+ AI models. Bytez is the largest serverless Model Inference API on the internet. Let's build ✨

celai

Open source framework designed to accelerate the development of omnichannel AI virtual assistants.

toolmate

ToolMate AI, developed by Eliran Wong, is a cutting-edge AI companion that seamlessly integrates agents, tools, and plugins to excel in conversations, generative work, and task execution. Supports custom workflow and plugins to automate multi-step actions.

intelli

Build multi-model chatbots and agents from intent.

chimeraforge

PyPI capacity-planning CLI for LLM deployment. pip install chimeraforge.

picollm

On-device LLM Inference Powered by X-Bit Quantization

picollmdemo

On-device LLM Inference Powered by X-Bit Quantization

markdown-table-repair

Markdown Table Repair is a Python package that repairs and cleans malformed Markdown tables, converting them into structured pandas DataFrames.

llmtuner

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

socaity

SDK for generative AI.

toolmate-lite

ToolMate AI, developed by Eliran Wong, is a cutting-edge AI companion that seamlessly integrates agents, tools, and plugins to excel in conversations, generative work, and task execution. Supports custom workflow and plugins to automate multi-step actions.

llm-templates

Instruction/chat prompts creation library for text generation LLMs. It supports local and Hugging Face models.

toolmate-android

ToolMate AI, developed by Eliran Wong, is a cutting-edge AI companion that seamlessly integrates agents, tools, and plugins to excel in conversations, generative work, and task execution. Supports custom workflow and plugins to automate multi-step actions.