Llama2 Python Packages

openllm

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

ludwig

Low-code framework for building custom LLMs, neural networks, and other AI models

opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

friendli-client

Friendli Suite Client

google-jetstream

JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

bert-classifier

A repository for training transformer based models

openllm-core

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

python-tgpt

AI Chat in Terminal + Package + REST-API

nlp-models

A repository for training transformer based models

openllm-client

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

autollm

Ship RAG based LLM Web API's, in seconds.

maxtext

A simple, performant and scalable Jax LLM!

multillm

VerifAI MultiLLM: A module to invoke multiple LLMs concurrently and rank their results

llmgraph

Create knowledge graphs with LLMs

picollm

On-device LLM Inference Powered by X-Bit Quantization

fastapi-gen

Build LLM-enabled FastAPI applications without build configuration.

exxa

Exa - Pytorch

gguf-modeldb

A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more models from hf repos and more. It's super easy to use and comes prepacked with best preconfigured open source models: dolphin phi-2 2.7b, mistral 7b v0.2, mixtral 8x7b v0.1, solar 10.7b and zephyr 3b

llama-recipes

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services

llm-templates

Instruction/chat prompts creation library for text generation LLMs. It supports local and Hugging Face models.

llava-torch

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

picollmdemo

On-device LLM Inference Powered by X-Bit Quantization

llama-cookbook

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services

tgpt2

AI Chat in Terminal + Package + REST-API