Intellectually Curious podcast

Inside Vera Rubin: How NVIDIA Builds a Rack-Scale Supercomputer

0:00
5:45
Recuar 15 segundos
Avançar 15 segundos

What does it take to make 72 GPUs work together on a single AI problem? Inside NVIDIA’s Vera Rubin NVL72, 36 Vera CPUs share a liquid-cooled rack with 72 Rubin GPUs. The CPUs coordinate the work, the GPUs perform the calculations, and a network called NVLink moves data between them.

We look inside the rack to see why those connections matter. When an AI model has a long conversation to keep track of, moving information to the chip that needs it can be as important as the speed of the chip itself.


Note:  This podcast was AI-generated, and sometimes AI can make mistakes.  Please double-check any critical information.

Sponsored by Embersilk LLC

Mais episódios de "Intellectually Curious"