
0:00
29:23
NVIDIA CTO Michael Kagan joins David Bombal to explain AI networking, NVLink, and why GPUs alone are not enough to scale AI data centers.
How do you connect 72 GPUs in a rack? What is the difference between scale up, scale out, and scale across? And why do latency and network jitter matter when GPUs need to work together?
Michael explains how NVIDIA approaches these challenges using NVLink, InfiniBand, and Spectrum-X Ethernet. He also shares the story of co-founding Mellanox, joining NVIDIA, and building the networking behind increasingly large AI systems.
We discuss the path toward million-GPU systems, connecting AI factories across sites, and how simulation and shared experience could help robots learn. Michael finishes with advice for the next generation of engineers and founders.
If you're learning networking, working with data centers, or exploring AI infrastructure, this conversation will help you understand how the pieces fit together. What would you like Michael to explain next? Let us know in the comments.
Big thank you to @NVIDIA for sponsoring my trip to GTC Berlin 2026 and to them for sponsoring this video.
// Michael Kagan SOCIAL //
LinkedIn: / mikagan
Blog: https://blogs.nvidia.com/blog/author/...
// David's SOCIAL //
Discord: discord.com/invite/usKSyzb
Twitter: www.twitter.com/davidbombal
Instagram: www.instagram.com/davidbombal
LinkedIn: www.linkedin.com/in/davidbombal
Facebook: www.facebook.com/davidbombal.co
TikTok: tiktok.com/@davidbombal
YouTube: / @davidbombal
Spotify: open.spotify.com/show/3f6k6gE...
SoundCloud: / davidbombal
Apple Podcast: podcasts.apple.com/us/podcast...
// MY STUFF //
https://www.amazon.com/shop/davidbombal
// SPONSORS //
Interested in sponsoring my videos? Reach out to my team here: [email protected]
// MENU //
0:00 - Intro
0:37 - Michael Kagen introduction and backstory
06:15 - Scaling AI with networking
10:59 - AI Factory
15:58 - Scale up, scale out & scale across explained
17:20 - How it is all connected // NVIDIA NVLink
20:07 - How big will AI get? // Millions of GPUs
22:26 - NVIDIA open-source projects
23:17 - The future of AI
26:42 - Advice for the younger generation
28:49 - Conclusion
Please note that links listed may be affiliate links and provide me with a small percentage/kickback should you use them to purchase any of the items listed or recommended. Thank you for supporting me and this channel!
Disclaimer: This video is for educational purposes only.
#nvidia #nvidiagtc #networking
Altri episodi di "David Bombal"



Non perdere nemmeno un episodio di “David Bombal”. Iscriviti all'app gratuita GetPodcast.








