Google Releases TPU Sync: Open-Source KV Cache Transfer for TPUs
MarkTechPost · Nov. 13, 2026, 10:32 a.m.
Google has released TPU Sync, an open-source C++ library that moves KV caches and weights across TPU memory, host DRAM, storage, and networks. Google reports more than 90% lower KV transfer latency on 235B to 480B MoE models.