In a stunning display of technological prowess and rapid execution, xAI, the artificial intelligence company founded by Elon Musk, has unveiled its groundbreaking supercomputer project, dubbed “Colossus.” The system, boasting an unprecedented 100,000 Nvidia H100 GPUs on a single RDMA fabric, was brought online in Memphis, Tennessee, in just 122 days from conception to completion.
Colossus represents a significant milestone in the field of AI, with xAI claiming it to be “the most powerful AI training system in the world.” The project’s ambitious scale is evident not only in its current configuration but also in its future plans. Elon Musk announced via social media that Colossus is set to double in size within months, expanding to 200,000 GPUs by incorporating an additional 50,000 H200 GPUs.
“This weekend, the @xAI team brought our Colossus 100k H100 training cluster online. From start to finish, it was done in 122 days,” Musk tweeted, highlighting the remarkable speed of the project’s implementation.
The sheer computational power of Colossus comes with significant energy requirements. Initial estimates suggest that the system’s power consumption could range between 42 to 56 megawatts, based on the H100 GPU’s specifications and typical data center efficiencies. The project’s plans indicate a phased approach to power usage, starting with 50 megawatts available by August 2024 and ultimately aiming for 150 megawatts.
This substantial power demand was a key factor in selecting Memphis as the project’s location. The city’s robust power infrastructure, supported by Memphis Light, Gas, and Water (MLGW) and the Tennessee Valley Authority (TVA), was crucial in meeting Colossus’s energy needs.
Why Memphis?
xAI’s choice of Memphis for Project Colossus was strategic, influenced by several factors:
- Power Infrastructure: The city’s ability to provide the necessary electrical capacity was paramount.
- Economic Incentives: Memphis offered attractive economic development packages, recognizing the project’s potential to transform the city into a tech hub.
- Available Facilities: The former Electrolux facility, acquired by Phoenix Investors, provided a ready-to-use industrial space, accelerating the project’s timeline.
- Expedited Process: The Greater Memphis Chamber’s ability to fast-track approvals and negotiations aligned with xAI’s aggressive timeline.
Founded by Elon Musk and officially announced on July 12, 2023, xAI has quickly established itself as a major player in the AI field. The company recently secured a $6 billion Series B funding round in May 2024, valuing it at $24 billion. This substantial backing from investors like Valor Equity Partners, Andreessen Horowitz, and Sequoia Capital underscores the high expectations for xAI’s innovations.
• xAI’s Colossus supercomputer is located in Memphis, Tennessee.
• The project was completed in 122 days, featuring 100,000 liquid-cooled NVIDIA H100 GPUs on a single RDMA fabric
• Plans are in place to add 50,000 H200 GPUs, doubling the system’s capacity.
• Colossus aims to advance AI training and scientific research.
• Local debates focus on the environmental impact and resource consumption.
