Need a lot of compute? How does 8,960 TPUs sound?

Google revealed a performance-optimized version of its Tensor Processing Unit (TPU) called the v5p designed to reduce the time commitment associated with training large language models.…