Cluster

A large array of networked GPUs (often tens of thousands) working as one training system. The physical embodiment of “compute,” housed in data centres whose construction drives much of the capital spending you see announced.