Elon Musk plans to scale the xAI supercomputer to a million GPUs — currently at over 100,000 H100 GPUs and counting
Elon Musk’s AI company, xAI, is set to expand its Colossus supercomputer to over one million GPUs, reports theFinancial Times. Thus, the expanded Colossus machine will be one of the most powerful supercomputers in the world. However, it will require significant investments, supply, and infrastructure availability. Colossus, which is used to train the large language model behind Grok, already operates over 100,000 H100 processors from Nvidia and isset to double the number of GPUsshortly to become the largest supercomputer in a single building....