Tpu Python Packages

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

skypilot

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

skypilot-nightly

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

torchax

torchax is a PyTorch frontend for JAX. It gives JAX the ability to author JAX programs using familiar PyTorch syntax. It also provides JAX-Pytorch interoperability, meaning, one can mix JAX & Pytorch syntax together when authoring ML programs, and run it in every hardware JAX can run.

vllm-tpu

A high-throughput and memory-efficient inference and serving engine for LLMs

trainy-skypilot-nightly

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

tensor2tensor

Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.

decimer

DECIMER Image Transformer is a deep-learning-based tool designed for automated recognition of chemical structure images. Leveraging transformer architectures, the model converts chemical images into SMILES strings, enabling the digitization of chemical data from scanned documents, literature, and patents.

xpk

xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerators such as TPUs and GPUs on GKE.

aphrodite-engine

Large-scale LLM inference engine

google-jetstream

JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

yolov4

YOLOv4 Implemented in Tensorflow 2.

tpucare

Automatically take good care of your preemptible TPUs

revlib

Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload

adanet

Fast and flexible AutoML with learning guarantees.

ai-dynamo-vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

gradient-accumulator

:dart: Gradient Accumulation for TensorFlow 2

ac-scheduler

SkyPilot: Run AI on Any Infra — Unified, Faster, Cheaper. (Fork by Jason-AC)

cfnet

A counterfactual explanation library using Jax

nextai-prism

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

deepsaki

DeepSaki is an add-on to TensorFlow. It provides a variaty of custom classes ranging from activation functions to entire models, helper functions to facilitate connectiong to your, compute HW and many more!

vllm-acc

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-xft

A high-throughput and memory-efficient inference and serving engine for LLMs

wxy-test

A high-throughput and memory-efficient inference and serving engine for LLMs