Think about how huge Nvidia's GB200 AI superchip is in individual. Nope, it's even greater than that
Nvidia’s Jensen Huang introduced the all-singing, all-dancing GB200 AI superchip again in March of 2024, as a part of the Blackwell reveal at GTC. Nevertheless, it has been troublesome to get an impression of simply how huge one is likely to be in individual—till now, that’s.
Dr. Moritz Lehmann has posted photographs of the mighty AI mega-system on the Nvidia subreddit, and I will spare teasing you any longer. It is an absolute honker of a board, demonstrated by a helpfully-spread hand for scale in what appears to be like suspiciously like a Vulcan salute:
Palms-on with the actual huge GPUs: GB200 NVL72 – Grace CPU + 2x B200 180GB on every node, linked by 130TB/s NVLink backbone from r/nvidia
The GB200 Grace Blackwell Superchip consists of 1 72-core Nvidia Grace CPU and two Blackwell AI GPUs and might be configured with as much as 372 GB of HBM3e reminiscence, with a complete bandwidth of 16 TB/s. I do not find out about you, however I reckon these specs make the typical gaming rig look a bit pedestrian. Thoughts you, it isn’t like the typical client may afford one.
In response to a commenter asking how a lot a GB200 prices, Lehmann replied: “one complete NVL72 rack with 18 of those nodes goes for $3 million.” Ah, fairly reasonably priced then. I will take two, do not money the cheque till Tuesday.
There’s additionally a slightly tasty shot of the NVLink backbone, which was held up by Huang himself at Computex 2025. The Nvidia head honcho commented on the time that it was a wrestle to carry at 70 lbs, and it definitely appears to be like like a hefty beast within the photographs.
Thoughts you, on the subject of the capabilities, these super-sized dimensions come as no shock. It accommodates 5,000 cables making for a mixed size of two miles, and has a complete bandwidth capability of 130 TB/s. Or, as Huang memorably put it, “the height visitors of the complete web is 900 terabits per second. Divide that by eight. This strikes extra visitors than the complete web.”
It is also received numerous orange connectors. That is my contribution to the dialogue right here. I like orange and black. Collectively they give the impression of being good. Additionally the GB200 may be very massive, very highly effective, and really costly. Collectively we be taught, ey?