Llama2 Python Packages

opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

maxtext

A simple, performant, and scalable Jax LLM!

openllm

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

ludwig

Low-code framework for building custom LLMs, neural networks, and other AI models

openllm-core

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

friendli-client

[⛔️ DEPRECATED] Friendli: the fastest serving engine for generative AI

bert-classifier

A repository for training transformer based models

python-tgpt

AI Chat in Terminal + Package + REST-API

nlp-models

A repository for training transformer based models

openllm-client

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

llama-recipes

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services

multillm

🚀 Invoke multiple large language models concurrently and the rank results. Add new models and ranking functions quickly.. ⭐

google-jetstream

JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

autollm

Ship RAG based LLM web apps in seconds.

picollm

On-device LLM Inference Powered by X-Bit Quantization

picollmdemo

On-device LLM Inference Powered by X-Bit Quantization

gguf-modeldb

A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more models from hf repos and more. It's super easy to use and comes prepacked with best preconfigured open source models: dolphin phi-2 2.7b, mistral 7b v0.2, mixtral 8x7b v0.1, solar 10.7b and zephyr 3b

llm-templates

Instruction/chat prompts creation library for text generation LLMs. It supports local and Hugging Face models.

exxa

Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and minimal learning curve.

llama-cookbook

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services

llmgraph

Create knowledge graphs with LLMs

fastapi-gen

Build LLM-enabled FastAPI applications without build configuration.

one-line-llm-tuner

This repository is the source code for fine tuning any LLM in just one line 🔥

tgpt2

AI Chat in Terminal + Package + REST-API