Google's Training Supercomputers from TPU v2 to Ironwood: Five Generations
This paper presents a technical overview of Google's five generations of training supercomputers, from TPU v2 to Ironwood, detailing their architecture, system design, and the innovations in networking, cooling, and reliability that enabled scaling to large-scale AI workloads.