Llama2 Python Packages

openllm

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

openllm-client

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

ludwig

Low-code framework for building custom LLMs, neural networks, and other AI models

openllm-core

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

python-tgpt

AI Chat in Terminal + Package + REST-API

multillm

🚀 Invoke multiple large language models concurrently and the rank results. Add new models and ranking functions quickly.. ⭐

maxtext

A simple, performant, and scalable Jax LLM!

friendli-client

[⛔️ DEPRECATED] Friendli: the fastest serving engine for generative AI

autollm

Ship RAG based LLM web apps in seconds.

exxa

Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and minimal learning curve.

picollm

On-device LLM Inference Powered by X-Bit Quantization

fastapi-gen

Build LLM-enabled FastAPI applications without build configuration.

picollmdemo

On-device LLM Inference Powered by X-Bit Quantization

bert-classifier

A repository for training transformer based models

llm-templates

Instruction/chat prompts creation library for text generation LLMs. It supports local and Hugging Face models.

one-line-llm-tuner

This repository is the source code for fine tuning any LLM in just one line 🔥

llama-recipes

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services

llmgraph

Create knowledge graphs with LLMs

google-jetstream

JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

llm-toolkit

Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

xllm

🦖 X—LLM: Cutting Edge & Easy LLM Finetuning

periflow-client

[⛔️ DEPRECATED] Friendli: the fastest serving engine for generative AI

nlp-models

A repository for training transformer based models

pyaskit

AskIt: Unified programming interface for programming with LLMs (GPT-3.5, GPT-4, Gemini, Claude, Cohere, Llama 2)