David Bombal podkast

#622: How NVIDIA Connects 72 GPUs in One Rack

17.11.2026
0:00
29:23
Do tyłu o 15 sekund
Do przodu o 15 sekund
NVIDIA CTO Michael Kagan joins David Bombal to explain AI networking, NVLink, and why GPUs alone are not enough to scale AI data centers. How do you connect 72 GPUs in a rack? What is the difference between scale up, scale out, and scale across? And why do latency and network jitter matter when GPUs need to work together? Michael explains how NVIDIA approaches these challenges using NVLink, InfiniBand, and Spectrum-X Ethernet. He also shares the story of co-founding Mellanox, joining NVIDIA, and building the networking behind increasingly large AI systems. We discuss the path toward million-GPU systems, connecting AI factories across sites, and how simulation and shared experience could help robots learn. Michael finishes with advice for the next generation of engineers and founders. If you're learning networking, working with data centers, or exploring AI infrastructure, this conversation will help you understand how the pieces fit together. What would you like Michael to explain next? Let us know in the comments. Big thank you to ‪@NVIDIA‬ for sponsoring my trip to GTC Berlin 2026 and to them for sponsoring this video. // Michael Kagan SOCIAL // LinkedIn: / mikagan Blog: https://blogs.nvidia.com/blog/author/... // David's SOCIAL // Discord: discord.com/invite/usKSyzb Twitter: www.twitter.com/davidbombal Instagram: www.instagram.com/davidbombal LinkedIn: www.linkedin.com/in/davidbombal Facebook: www.facebook.com/davidbombal.co TikTok: tiktok.com/@davidbombal YouTube: / @davidbombal Spotify: open.spotify.com/show/3f6k6gE... SoundCloud: / davidbombal Apple Podcast: podcasts.apple.com/us/podcast... // MY STUFF // https://www.amazon.com/shop/davidbombal // SPONSORS // Interested in sponsoring my videos? Reach out to my team here: [email protected] // MENU // 0:00 - Intro 0:37 - Michael Kagen introduction and backstory 06:15 - Scaling AI with networking 10:59 - AI Factory 15:58 - Scale up, scale out & scale across explained 17:20 - How it is all connected // NVIDIA NVLink 20:07 - How big will AI get? // Millions of GPUs 22:26 - NVIDIA open-source projects 23:17 - The future of AI 26:42 - Advice for the younger generation 28:49 - Conclusion Please note that links listed may be affiliate links and provide me with a small percentage/kickback should you use them to purchase any of the items listed or recommended. Thank you for supporting me and this channel! Disclaimer: This video is for educational purposes only. #nvidia #nvidiagtc #networking

Więcej odcinków z kanału "David Bombal"