Elon Musk's xAI to build billion-dollar supercomputer for advanced Grok chatbot

Elon Musk's startup, xAI, is reportedly planning to build a supercomputer by fall 2025 to power an advanced version of its Grok chatbot.

According to The Information, Musk presented the ambitious project to investors, referring to it as a "gigafactory of compute." This supercomputer will rely on tens of thousands of NVIDIA H100 GPUs and is expected to cost billions of dollars.

The planned GPU cluster will be at least four times larger than those used by xAI’s competitors. Musk has indicated that the third version of Grok will require a significant increase in computing power, with at least 100,000 GPUs, compared to the 20,000 GPUs currently used for Grok 2.0. Currently, Grok is in version 1.5, released in April, and can process visual information and text. Additionally, xAI recently began offering AI-generated news summaries powered by Grok to premium users.