Mixtral Python Packages

maxtext

A simple, performant, and scalable Jax LLM!

picollm

On-device LLM Inference Powered by X-Bit Quantization

picollmdemo

On-device LLM Inference Powered by X-Bit Quantization

petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

easy-llms

Easy '1-line' calling of every LLM from OpenAI, MS Azure, AWS Bedrock, GCP Vertex, and Ollama

nollama

NoLlama is a lightweight terminal-based interface for interacting with Large Language Models (LLMs) from major providers or from your local ollama instance.

groqchat

A terminal chatbot, powered by Groq Cloud API (Windows / macOS / Linux / Android / iOS)

gchat

A terminal chatbot, powered by Groq Cloud API (Windows / macOS / Linux / Android / iOS)

h2ogpt

No description available

moewatch

A lightweight diagnostic and audit library for Mixture-of-Experts (MoE) models in HuggingFace Transformers

githubaipy

A Python package to interact with GitHub AI models.

test-petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

mixtral-py

A Python module for running the Mixtral-8x7B language model with customisable precision and attention mechanisms.