Nicheloom visits: 66,659 all-time · 9,226 in the last 7 days

The opportunity tracker for new startups.

Today: 2,572 launches · Niche of the day: browser-based utility tools · See what launched today →

Google Releases TPU Sync: Open-Source KV Cache Transfer for TPUs

MarkTechPost · Nov. 13, 2026, 10:32 a.m.

Google has released TPU Sync, an open-source C++ library that moves KV caches and weights across TPU memory, host DRAM, storage, and networks. Google reports more than 90% lower KV transfer latency on 235B to 480B MoE models.

Read the original article →

← Back to AI News