Episode 302: From PyTorch to GPU MODE with Mark Saroufim

In this episode, Conor and Bryce talk with Zach Laine about his career and the career changes he has made.Link to Episode 311 on WebsiteDiscuss this episode, leave a comment, or ask a question (on GitHub)SocialsADSP: The Podcast: TwitterConor Hoekstra: LinkTree / BioBryce Adelstein Lelbach: Twitter BlueSkyAbout the Guest:Zach Laine has been using C++ in industry for 15 years, focusing on data visualization, numeric computing, games, generic programming, and good library design. He finds the process of writing bio blurbs to be a little uncomfortable.Show NotesDate Recorded: 2026-10-28 Date Released: 2026-11-06LSEGCadenceSynopsysIntro Song InfoMiss You by Sarah Jansen https://soundcloud.com/sarahjansenmusic Creative Commons — Attribution 3.0 Unported — CC BY 3.0 Free Download / Stream: http://bit.ly/l-miss-you Music promoted by Audio Library https://youtu.be/iYYxnasvfx8

In this episode, Conor and Bryce talk about Bryce's next chapter and where he is leaving NVIDIA for.Link to Episode 310 on WebsiteDiscuss this episode, leave a comment, or ask a question (on GitHub)SocialsADSP: The Podcast: TwitterConor Hoekstra: LinkTree / BioBryce Adelstein Lelbach: Twitter BlueSkyShow NotesDate Recorded: 2026-09-30 Date Released: 2026-10-30OctoAIMiniMaxModalautoresearchIntro Song InfoMiss You by Sarah Jansen https://soundcloud.com/sarahjansenmusic Creative Commons — Attribution 3.0 Unported — CC BY 3.0 Free Download / Stream: http://bit.ly/l-miss-you Music promoted by Audio Library https://youtu.be/iYYxnasvfx8

In this episode, Conor and Ben chat with Jason Turner about default construction in C++.Link to Episode 309 on WebsiteDiscuss this episode, leave a comment, or ask a question (on GitHub)SocialsADSP: The Podcast: TwitterConor Hoekstra: LinkTree / BioBen Deane: Twitter BlueSkyAbout the Guest:Jason is host of the YouTube channel C++ Weekly, co-host of the podcast CppCast, author of C++ Best Practices, and author of the first casual puzzle books designed to teach C++ fundamentals while having fun!Show NotesDate Recorded: 2026-10-07 Date Released: 2026-10-23CppCast PodcastList of All Jason's Talks[resize_and_overwrite](https://en.cppreference.com/cpp/string/basic_string/resize_and_overwrite)The worst programming language of all timeitCppCon20 - My Least Favorite Anti-Pattern (Conor Hoekstra)Specialized algorithmsEngineering Distinguished Speaker Series: Howard HinnantRefactoring Techniques and Strategies (a Tale in Three Acts) - Dave Steffen - CppCon 2026Escaping 1996: Meta-Modern C++ Techniques for Embedded SystemsExpression-based Programming for Better Code? - Jason Turner - NDC Toronto 2026Intro Song InfoMiss You by Sarah Jansen https://soundcloud.com/sarahjansenmusic Creative Commons — Attribution 3.0 Unported — CC BY 3.0 Free Download / Stream: http://bit.ly/l-miss-you Music promoted by Audio Library https://youtu.be/iYYxnasvfx8

In this episode, Conor and Ben chat with Jason Turner about his Rule of N talk.Link to Episode 308 on WebsiteDiscuss this episode, leave a comment, or ask a question (on GitHub)SocialsADSP: The Podcast: TwitterConor Hoekstra: LinkTree / BioBen Deane: Twitter BlueSkyAbout the Guest:Jason is host of the YouTube channel C++ Weekly, co-host of the podcast CppCast, author of C++ Best Practices, and author of the first casual puzzle books designed to teach C++ fundamentals while having fun!Show NotesDate Recorded: 2026-10-07 Date Released: 2026-10-16CppCast PodcastList of All Jason's TalksRules for Special Member FunctionsThe rule of three/five/zeroC++ std::ignoreSpaceship operatorwarrenreconditesesquipedalianIntro Song InfoMiss You by Sarah Jansen https://soundcloud.com/sarahjansenmusic Creative Commons — Attribution 3.0 Unported — CC BY 3.0 Free Download / Stream: http://bit.ly/l-miss-you Music promoted by Audio Library https://youtu.be/iYYxnasvfx8

In this episode, Conor and Ben chat about Jason Turner's about C++ conferences, meetups and more!Link to Episode 307 on WebsiteDiscuss this episode, leave a comment, or ask a question (on GitHub)SocialsADSP: The Podcast: TwitterConor Hoekstra: LinkTree / BioBen Deane: Twitter BlueSkyAbout the Guest:Jason is host of the YouTube channel C++ Weekly, co-host of the podcast CppCast, author of C++ Best Practices, and author of the first casual puzzle books designed to teach C++ fundamentals while having fun!Show NotesDate Recorded: 2026-10-07 Date Released: 2026-10-09CppCast Podcastcpp.chat PodcastDenver C++ MeetupStockholm C++ MeetupNDC TorontoLambda WorldC++ OnlineNDC Copenhagen C++ On SeaC++ NowCppConC++ Under the SeaList of All Jason's TalksSafety In Numbers TalkRule of N TalkKeynote: I Fixed Move Semantics - Jason Turner @cppweeklyIntro Song InfoMiss You by Sarah Jansen https://soundcloud.com/sarahjansenmusic Creative Commons — Attribution 3.0 Unported — CC BY 3.0 Free Download / Stream: http://bit.ly/l-miss-you Music promoted by Audio Library https://youtu.be/iYYxnasvfx8

In this episode, Conor and Bryce chat about Omarchy, Linux vs Windows and more!Link to Episode 306 on WebsiteDiscuss this episode, leave a comment, or ask a question (on GitHub)SocialsADSP: The Podcast: TwitterConor Hoekstra: LinkTree / BioBryce Adelstein Lelbach: Twitter BlueSkyShow NotesDate Recorded: 2026-09-30 Date Released: 2026-10-02OmarchyEnter the Matrix • Conor Hoekstra • YOW! 2025Enter the Matrix DeckJensen Huang Thinks A.I. Alarmism Has Gone Too Far The Ezra Klein ShowDHH: Future of Programming, AI, Agentic Engineering, Vibe Coding & Linux Lex Fridman PodcastRails World 2026 Opening Keynote - DHHADSP Episode 302: From PyTorch to GPU MODE with Mark SaroufimPOD GODAI-FI Book RankingsIntro Song InfoMiss You by Sarah Jansen https://soundcloud.com/sarahjansenmusic Creative Commons — Attribution 3.0 Unported — CC BY 3.0 Free Download / Stream: http://bit.ly/l-miss-you Music promoted by Audio Library https://youtu.be/iYYxnasvfx8

In this episode, Conor mentions of few podcasts that might be of interest while on paternity leave. Link to Episode 305 on WebsiteDiscuss this episode, leave a comment, or ask a question (on GitHub)SocialsADSP: The Podcast: TwitterConor Hoekstra: LinkTree / BioShow NotesDate Recorded: 2026-09-24 Date Released: 2026-09-25ADSP Episode 302: From PyTorch to GPU MODE with Mark SaroufimADSP Episode 271: Mastermind AlgorithmsPOD GODDHH: Future of Programming, AI, Agentic Engineering, Vibe Coding & Linux | Lex Fridman PodcastJensen Huang Thinks A.I. Alarmism Has Gone Too Far | The Ezra Klein ShowAI Pioneer Geoffrey Hinton: AI Is Conscious, Superintelligence is Coming, And We Should Be WorriedBig Technology PodcastHard Fork PodcastMachine Gods PodcastIntro Song InfoMiss You by Sarah Jansen https://soundcloud.com/sarahjansenmusic Creative Commons — Attribution 3.0 Unported — CC BY 3.0 Free Download / Stream: http://bit.ly/l-miss-you Music promoted by Audio Library https://youtu.be/iYYxnasvfx8

In this episode, Conor and Bryce continue their chat with Mark Saroufim about autoresearch, productionizing AI-generated GPU kernels, GPU MODE, books, video games and more!Link to Episode 304 on WebsiteDiscuss this episode, leave a comment, or ask a question (on GitHub)SocialsADSP: The Podcast: TwitterConor Hoekstra: LinkTree / BioBryce Adelstein Lelbach: Twitter | BlueSkyAbout the Guest:Mark Saroufim is a cofounder at Core Automation, PyTorch maintainer and cofounder of GPU MODE.Show NotesDate Recorded: 2026-07-20Date Released: 2026-09-18Core AutomationGPU MODEPyTorchADSP Episode 294: HistocacheCUB LibraryQR GPU MODE ProblemModalGPU MODE Lecture 108: One Layer Deeper competitiononelayerdeeper.aiThe Peterman PodBoris Cherny (Creator of Claude Code) On What Grew His Career And Building at Anthropic (Peterman Pod)Permutation City by Greg EganA Fire Upon the Deep by Vernor VingeMark's BookshelfMark's Top 10 BooksJourney to the AntsVisual Group TheoryThe Theory of FunWorking with Legacy CodeThe Structure and Interpretation of Classical MechanicsGame Theoretic Foundations for Probability and FinanceNVFP4 GPU MODE Problemlaplace-torchIntro Song InfoMiss You by Sarah Jansen https://soundcloud.com/sarahjansenmusicCreative Commons — Attribution 3.0 Unported — CC BY 3.0Free Download / Stream: http://bit.ly/l-miss-youMusic promoted by Audio Library https://youtu.be/iYYxnasvfx8

In this episode, Conor and Bryce continue their chat with Mark Saroufim about open vs closed models, numerical correctness, AI-generated GPU kernels, autoresearch and more!Link to Episode 303 on WebsiteDiscuss this episode, leave a comment, or ask a question (on GitHub)SocialsADSP: The Podcast: TwitterConor Hoekstra: LinkTree / BioBryce Adelstein Lelbach: Twitter | BlueSkyAbout the Guest:Mark Saroufim is a cofounder at Core Automation, PyTorch maintainer and cofounder of GPU MODE.Show NotesDate Recorded: 2026-07-20Date Released: 2026-09-11Core AutomationGPU MODEPyTorchQR GPU MODE ProblemNVFP4 GPU MODE Problemlaplace-torchIntro Song InfoMiss You by Sarah Jansen https://soundcloud.com/sarahjansenmusicCreative Commons — Attribution 3.0 Unported — CC BY 3.0Free Download / Stream: http://bit.ly/l-miss-youMusic promoted by Audio Library https://youtu.be/iYYxnasvfx8

In this episode, Conor and Bryce chat with Mark Saroufim about his path from AI theory and Microsoft to Graphcore and PyTorch, what he learned from open source, building the GPU MODE community, and his work automating AI systems research at Core Automation.Link to Episode 302 on WebsiteDiscuss this episode, leave a comment, or ask a question (on GitHub)SocialsADSP: The Podcast: TwitterConor Hoekstra: LinkTree / BioBryce Adelstein Lelbach: Twitter | BlueSkyAbout the Guest:Mark Saroufim is a cofounder at Core Automation, PyTorch maintainer and cofounder of GPU MODE.Show NotesDate Recorded: 2026-07-20Date Released: 2026-09-04Core AutomationGPU MODEGraphcoreThe Robot Overlord ManualMachine Learning: The Great StagnationPyTorchIntro Song InfoMiss You by Sarah Jansen https://soundcloud.com/sarahjansenmusicCreative Commons — Attribution 3.0 Unported — CC BY 3.0Free Download / Stream: http://bit.ly/l-miss-youMusic promoted by Audio Library https://youtu.be/iYYxnasvfx8