Google · KV Cache Transfer
TPU Sync
Google has released TPU Sync, an Apache-2.0 C++ library with Python wheels for PyTorch and JAX that moves KV caches and model weights across TPU HBM, host DRAM, storage and the data centre network. Google reports over 90% lower KV transfer latency on 235B to 480B MoE models, with Qwen3 235B KV transfer falling from several seconds to about 230 ms in its internal tests on TPU v7x. The README says it is not yet recommended for general use, and the RL and storage tiering features are experimental.
Open the source ↗Similar Developer Tools releases
- cuBLAS Ozaki-II and 2M FP64 Algorithms
NVIDIA · FP64 GEMM Emulation · Week 47, 2026
- SGLang-Neuron
RadixArk with Annapurna Labs (AWS) · Trainium inference plugin · Week 47, 2026
- TLX (Triton Low-Level Extensions)
Meta (Engineering at Meta) · GPU Kernel Extension · Week 47, 2026
- NVIDIA OpenShell, Snapshot and Kubernetes Engine
NVIDIA · Agent Runtime Infra · Week 47, 2026
- TPU 8tx and TPU 8i Max
Google · TPU Agent Infrastructure · Week 47, 2026
- NVIDIA Dynamo Recipes for Korean Open Models
NVIDIA · Dynamo Deployment Recipes · Week 47, 2026
More from Google
- TPU 8tx and TPU 8i Max
Google · TPU Agent Infrastructure · Week 47, 2026
- Elephant-Goldfish Model (EGM)
Google · Agent design review · Week 45, 2026
- Colab in Google AI plans
Google · Cloud Notebooks · Week 44, 2026
- Gemini 3.8 Flash TTS
Google · Expressive Gemini TTS · Week 40, 2026
- Gemini 3.8 Live
Google · Live Voice Agent · Week 39, 2026
- Gemini 3.8 Flash and Flash Cyber
Google · Gemini 3.8 Flash · Week 36, 2026
Published by Quanta AI Labs, an AI agency in India. Browse every week in AI News Weekly.