Mixtral Python Packages

maxtext

A simple, performant, and scalable Jax LLM!

picollm

On-device LLM Inference Powered by X-Bit Quantization

petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

easy-llms

Easy "1-line" calling of all LLMs from OpenAI, MS Azure, AWS Bedrock, GCP Vertex, and Ollama

picollmdemo

On-device LLM Inference Powered by X-Bit Quantization

groqchat

A terminal chatbot, powered by Groq Cloud API (Windows / macOS / Linux / Android / iOS)

gchat

A terminal chatbot, powered by Groq Cloud API (Windows / macOS / Linux / Android / iOS)

h2ogpt

Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/

nollama

NoLlama is a lightweight terminal-based interface for interacting with Large Language Models (LLMs) from major providers or from your local ollama instance.

githubaipy

Small python wrapper of Github Models API

moewatch

👻 MoEWatch: A lightweight diagnostic and audit library for Mixture-of-Experts (MoE) models in HuggingFace Transformers — the pytest for MoE models.

test-petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

mixtral-py

A Python module for running the Mixtral-8x7B language model with customisable precision and attention mechanisms.