Huggingface Python Packages

datasets

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

sagemaker

A library for training and deploying machine learning models on Amazon SageMaker

skops

skops is a Python library helping you share your scikit-learn based models and put them in production

sagemaker-core

A library for training and deploying machine learning models on Amazon SageMaker

redisvl

Redis Vector Library (RedisVL) -- the AI-native Python client for Redis.

sagemaker-train

A library for training and deploying machine learning models on Amazon SageMaker

daft

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

chronos-forecasting

Chronos: Pretrained Models for Time Series Forecasting

sahi

Framework agnostic sliced/tiled inference + interactive ui + error analysis plots

kubeflow

Universal Python SDK to run AI workloads on Kubernetes

detoxify

Trained models & code to predict toxic comments on all 3 Jigsaw Toxic Comment Challenges. Built using ⚡ Pytorch Lightning and 🤗 Transformers. For access to our API, please email us at contact@unitary.ai.

lighteval

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

cdklabs-generative-ai-cdk-constructs

AWS Generative AI CDK Constructs are sample implementations of AWS CDK for common generative AI patterns.

swarms

The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework. Website: https://swarms.ai

lilbee

Terminal-first local search and AI chat over your documents, code, and crawled websites. Semantic + hybrid search, vision OCR, auto-built wiki, browsable GGUF model catalog. Works as CLI, TUI, MCP server, REST API, or Python library. Offline by default, no sidecar services.

kubeflow-training

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

mflux

MLX native implementations of state-of-the-art generative image models

optimum-rbln

⚡ A seamless integration of HuggingFace Transformers & Diffusers with RBLN SDK for efficient inference on RBLN NPUs.

autotrain-advanced

🤗 AutoTrain Advanced

whichllm

Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

soup-cli

Soup turns the pain of LLM fine-tuning into a simple workflow. One config, one command, done.

griptape

Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.

llmx

An API for Chat Fine-Tuned Large Language Models (llm)

rs-bpe

A ridiculously fast Python BPE (Byte Pair Encoder) implementation written in Rust