Mixtral Python Packages

maxtext

A simple, performant and scalable Jax LLM!

petals

Easy way to efficiently run 100B+ language models without high-end GPUs

picollm

On-device LLM Inference Powered by X-Bit Quantization

picollmdemo

On-device LLM Inference Powered by X-Bit Quantization

easy-llms

Easy "1-line" calling of all LLMs from OpenAI, MS Azure, AWS Bedrock, GCP Vertex, and Ollama

nollama

A terminal-based interface for interacting with large language models (LLMs)

groqchat

A terminal chatbot, powered by Groq Cloud API (Windows / macOS / Linux / Android / iOS)

gchat

A terminal chatbot, powered by Groq Cloud API (Windows / macOS / Linux / Android / iOS)

githubaipy

A Python package to interact with GitHub AI models.

h2ogpt

Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/

mixtral-py

A Python module for running the Mixtral-8x7B language model with customisable precision and attention mechanisms.

test-petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading