Tpu Python Packages

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

skypilot

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

torchax

torchax is a PyTorch frontend for JAX. It gives JAX the ability to author JAX programs using familiar PyTorch syntax. It also provides JAX-Pytorch interoperability, meaning, one can mix JAX & Pytorch syntax together when authoring ML programs, and run it in every hardware JAX can run.

skypilot-nightly

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

vllm-cpu-nightly

A high-throughput and memory-efficient inference and serving engine for LLMs

trainy-skypilot-nightly

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

vllm-tpu

A high-throughput and memory-efficient inference and serving engine for LLMs

tensor2tensor

Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.

decimer

DECIMER Image Transformer is a deep-learning-based tool designed for automated recognition of chemical structure images. Leveraging transformer architectures, the model converts chemical images into SMILES strings, enabling the digitization of chemical data from scanned documents, literature, and patents.

jax-tpu-embedding

High-performance large-scale embedding acceleration for JAX on Google TPU SparseCores.

aphrodite-engine

Large-scale LLM inference engine

xpk

xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerators such as TPUs and GPUs on GKE.

tpuasm

tpuasm 是 TPU 机器指令包的汇编器与反汇编器

fastsar

SAR image formation for spotlight, sliding spotlight, stripmap and burst collections on x86 CPUs, Nvidia GPUs and Google Cloud TPUs: factorized and exact backprojection, polar format, from CPHD to SICD

revlib

Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload

adanet

Fast and flexible AutoML with learning guarantees.

nextai-prism

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

google-jetstream

JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

ac-scheduler

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

vllm-xft

A high-throughput and memory-efficient inference and serving engine for LLMs

yolov4

YOLOv4 Implemented in Tensorflow 2.

tpucare

Automatically take good care of your preemptible TPUs

ai-dynamo-vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

colabapi

Run Google Colab from your terminal: persistent runtime, GPU/TPU shell, keepalive, live resource monitor, and a systemd service. A ban safe CLI wrapper over Google's official colab CLI that never handles your password.