Huggingface Python Packages

datasets

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

sagemaker

A library for training and deploying machine learning models on Amazon SageMaker

skops

skops is a Python library helping you share your scikit-learn based models and put them in production

sagemaker-core

A library for training and deploying machine learning models on Amazon SageMaker

redisvl

Redis Vector Library (RedisVL) -- the AI-native Python client for Redis.

sagemaker-train

A library for training and deploying machine learning models on Amazon SageMaker

daft

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

chronos-forecasting

Chronos: Pretrained Models for Time Series Forecasting

sahi

Framework agnostic sliced/tiled inference + interactive ui + error analysis plots

kubeflow

Universal Python SDK to run AI workloads on Kubernetes

detoxify

Trained models & code to predict toxic comments on all 3 Jigsaw Toxic Comment Challenges. Built using ⚡ Pytorch Lightning and 🤗 Transformers. For access to our API, please email us at contact@unitary.ai.

optimum-rbln

⚡ A seamless integration of HuggingFace Transformers & Diffusers with RBLN SDK for efficient inference on RBLN NPUs.

whichllm

Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

mflux

MLX native implementations of state-of-the-art generative image models

autotrain-advanced

🤗 AutoTrain Advanced

kubeflow-training

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

griptape

Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.

lilbee

A local AI search engine: it runs and manages local AI models, searches your files and code, and crawls the web, all in one program. Cited answers, local-first, with an MCP server for your coding agent. TUI, CLI, REST API, and Python library. Works with Ollama and LM Studio.

swarms

The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework. Website: https://swarms.ai

cdklabs-generative-ai-cdk-constructs

AWS Generative AI CDK Constructs are sample implementations of AWS CDK for common generative AI patterns.

lighteval

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

terradev-cli

An imperative command-line-interface for AI workload orchestration

llmx

An API for Chat Fine-Tuned Large Language Models (llm)

rs-bpe

A ridiculously fast Python BPE (Byte Pair Encoder) implementation written in Rust