This is an automated archive made by the Lemmit Bot.

The original was posted on /r/hardware by /u/Due_Calligrapher_800 on 2024-11-29 08:48:05+00:00.


So Pat tweeted that Elon used Intel Xeon for their xAI “head node” in colossus.

From what I understand Colossus is made up of about 1,600 racks, each rack with 64 H100s and 16 x86 CPUs. This would give a total of ~25,000 CPUs in the racks alone.

Is this what is referred to as the head node? Or is the head node something separate to the 16 CPUs that are in each rack?

Trying to get a gauge of how many Xeons will be used in Colossus once it is up and running at its full configuration of ~200,000 GPUs next year. Anyone know?