A 4U liquid-cooled server with eight NVIDIA H100 GPUs on one HGX board: the building block of Colossus’s racks.
More about this server
Supermicro’s 4U liquid-cooled GPU server holds an NVIDIA HGX board with eight H100 GPUs linked by NVLink and NVSwitch, plus two Intel Xeon host CPUs and 32 memory slots. Cold plates on the chips carry heat into a liquid loop.
When
The Supermicro and ServeTheHome case study of December 2024 describes xAI using this 4U Universal GPU system in Colossus. The model here follows Supermicro’s reference datasheet and manual; the exact deployed SKU is not published.
Why it matters
Eight of these servers and a coolant distribution unit make one Colossus rack of 64 GPUs. The server is where GPUs meet the CPUs, network adapters and liquid cooling they depend on, the role the GB300 compute tray plays in newer NVIDIA racks.
March 22, 2022 · Figure 1 and H100 SXM5 configuration
One GH100 compute die, five enabled HBM3 stacks; schematic layers and connection paths.
Original authored geometry. No private CAD, exact facility floor plan, performance simulation, or current deployment total is implied. Cooling and networking lines show relationships, not surveyed routes.