
Transformers: The Discovery That Sparked the AI Revolution
10/23/2025
0:00
9:18
Nearly every modern AI model, from ChatGPT and Claude to Gemini and Grok, is built on the same foundation: the Transformer.In this video, YC's Ankit Gupta traces how AI learned to understand language — from early RNNs and LSTMs to attention mechanisms and the breakthrough 2017 paper Attention Is All You Need — the discovery that unlocked the modern AI era.
More episodes from "Y Combinator Startup Podcast"



Don't miss an episode of “Y Combinator Startup Podcast” and subscribe to it in the GetPodcast app.








