Before AGI

Artificial intelligence is rapidly transforming the world, raising urgent questions about its impact, governance, and the future of human-machine collaboration. As AI systems become more capable, society faces challenges around safety and the balance of power. What does it mean to build and deploy technology that can reason, create, and potentially automate research itself? How do leading researchers navigate the technical and ethical frontiers of this new era?Jakub Pachocki, Chief Scientist at OpenAI, and Szymon Sidor, Technical Fellow at OpenAI, share their journeys from early programming competitions in Poland to shaping some of the most advanced AI systems in the world. They discuss the evolution of AI research, the technical and emotional challenges of building breakthrough models, and the profound societal questions that come with unprecedented progress.2:42 - Origin story: high school to OpenAI6:31 - “AI enlightenment” and AlphaGo moment17:12 - Early OpenAI culture and impostor syndrome23:30 - Power duo dynamic and collaboration27:25 - Shift to reasoning models36:23 - Possibilities of AGI42:12 - OpenAI’s pandemic efforts showed AI’s immaturity51:15 - Governance lessons from crisis55:39 - AI safety and optimism for the future

AI systems are beginning to act on our behalf — executing tasks, making decisions, and influencing daily life in ways that often escape direct human oversight. What are the consequences of delegating decision-making to systems we don’t fully understand? How do we design AI to enhance human capabilities without sidelining human judgment?In this episode, host Aleksander Mądry welcomes Jonathan Zittrain, Professor at Harvard Law School and Co-Founder of the Berkman Klein Center for Internet & Society. They explore the legal, ethical, and societal challenges of living alongside increasingly autonomous AI. Drawing on lessons from the internet’s evolution, Zittrain examines how we can structure responsibility, foster innovation, and build systems that truly serve the public good — all while navigating the profound opportunities and risks of this technological transformation.09:20 - Three eras of internet evolution14:56 - Generative tech and equilibrium challenges20:59 - Generativity vs. closed systems26:36 - The promise and pitfalls of AI assistants32:56 - Privacy, privilege, and AI user rights39:01 - Regulation, self-regulation, and global policy48:28 - Defining AI agents and their real-world impact52:26 - AI’s potential to empower the marginalized1:15:41 - Acceleration, agency, and the future

As AI becomes more integrated into daily life, it raises urgent questions about trust, accountability, and human agency. What happens when people over-rely on AI or when helpful tools are held back by perfectionism? Can we deploy imperfect systems while still earning public confidence?Reid Hoffman, Co-Author of “Superagency: What Could Possibly Go Right with Our AI Future,” joins this episode to explore how AI can enhance, not replace, human judgment. He discusses democratic leadership, global competition, and the design choices that shape user agency. Reid also shares his perspective on long-term AI investment beyond short-term hype.03:00 - Superagency and human-centered design17:27 - Risk, regulation, and collective action21:42 - Rethinking agency in the age of agents31:18 - Trust, regulation, and system design55:09 - Building trust through real-world AI benefits1:06:07 - China’s ambition and multipolar competition1:09:00 - Investing in applied AI with real impact1:14:00 - Reid’s hope for AI engagement

As AI continues to permeate various aspects of society, its impact on decision-making, bias, and future technological developments is complex. How can we navigate the challenges posed by AI, particularly when it comes to fairness and bias in algorithms? What insights can be drawn from the intersection of economics, computer science, and behavioral studies to guide the responsible development and use of AI?In this episode, Sendhil Mullainathan, a prominent economist and professor, delves into these pressing issues. He shares his journey from computer science to behavioral economics and discusses the role of AI in shaping the future of decision-making and societal structures. Sendhil provides a nuanced view of algorithmic bias, its origins, and the challenges in mitigating it. He also explores the potential and pitfalls of AI in healthcare and policymaking, offering insights into how we can harness AI for the greater good while being mindful of its limitations.0:00 - Start1:51 - Introducing Sendhil14:20 - Algorithmic bias29:20 - Handling Bias41:57 - AI and Decision Making57:01 - AI in our Future1:02:29 - Conclusion and the last question

AI technology is transforming the world, raising crucial questions about governance, regulation, and societal impact. What measures should governments adopt to regulate AI effectively? How can academic institutions contribute to this development? Luis Videgaray is a professor at MIT and the director of the MIT AI Policy for the World Project. Previously, he also served as the Minister of Finance and the Minister of Foreign Affairs in the Mexican Government. In this episode, Luis shares his journey and insights on the role of governments in regulating and utilizing AI. He also covers the evolution of AI policy, the geopolitical landscape, and the future of AI regulation.  3:47 - Luis’ time in the government 7:12 - AI in the past 20:19 - Regulation of AI 43:13 - Governments using AI 51:03 - Geopolitics of AI 1:11:31 - Luis at MIT 1:16:50 - Luis’ perspectives on AI 1:25:28 - Conclusion and the last question

Governments are playing a crucial role in ensuring the safe and ethical deployment of AI technologies, protecting citizens while fostering innovation. What steps can policymakers take to safeguard our future? How can we, as citizens, contribute to the conversation and advocate for beneficial AI practices?Anna Makanju, VP of Global Affairs at OpenAI, has extensive experience in national security and foreign policy roles across the U.S. government, UN, NATO, and Facebook. In this episode, Anna discusses her global tour with Sam Altman, her journey to her current role, and the steps governments can take to ensure a safe AI future.3:18 - Anna and OpenAI’s goals8:23 - Sam’s tour and government's role19:25 - AI and the government38:48 - AI and the military51:25 - Anna’s time in the government55:52 - Geopolitics of AI1:04:28 - AI safety and the future1:14:50 - Conclusion and the last question

The rapid advancement of AI technology presents both opportunities and challenges. As AI becomes more integrated into various aspects of life, how can companies ensure that these technologies are used innovatively and ethically? What measures can be taken to navigate potential pitfalls and enhance human connections rather than causing harm?Reid Hoffman, Co-founder of Inflection AI, Co-founder and executive chairman of LinkedIn, and Founding investor and former board member at OpenAI has recently used AI in innovative ways. In this episode, Reid talks about his experience doing an interview of his AI digital twin, his time on the board of OpenAI, and the potential to integrate AI into our own lives in interesting ways.3:11 - Digital twin9:07 - Innovative ways to engage with AI26:05 - Different perspectives on AI28:41 - Reid’s time with OpenAI36:00 - Why Inflection?47:56 - Future of AI1:01:08 Board dynamics1:10:48 - World stage for AI1:39:19 - Conclusion and the last question

Recent developments of AI offer an opportunity to transform traditional educational systems through tools that provide personalized learning and equal access to quality education. As we advance in our understanding of AI and its integration into daily life, how can we leverage these tools to dismantle educational barriers? What would a safe and beneficial AI education tool look like, and how should it be implemented to benefit everyone?Sal Khan, an advocate for educational access and the founder of Khan Academy, has dedicated significant effort to this challenge. In this episode, Sal shares his personal journey with AI and elucidates how it can revolutionize educational access, support teachers, and inspire students. He discusses Khan Academy’s new AI tool, “Khanmigo,” and its potential to transform learning for the better.2:35 - Pre-ChatGPT Khanmigo14:13 - Sal’s journey with AI21:09 - AI’s effects on our learning and thinking38:33 - AI and human relationships44:01 - Envisioning future AI use47:41 - Economics of education56:39 - Standardized testing1:02:10 - Societal impacts of AI1:09:48 - Future of AI1:13:22 - Conclusion and the last question

While the rapid development of AI technology promises unprecedented productivity gains and innovations, concerns of job displacement and increasing inequality persist. How can we ensure AI complements human labor rather than replacing it? What measures can we take to prevent a dystopian AI future?Erik Brynjolfsson is a professor at Stanford University and has pioneered research on the economics of information technology and AI. In this episode, Erik discusses the potential for AI to enhance job productivity, complement our workforce, and boost economic growth at scales comparable to the Industrial Revolution while also exploring potential negative futures and strategies to avoid them.(03:16) Imagining the future(09:41) Impacts on Productivity and Labor(21:14) GPTs are GPTs!(31:02) Workhelix(32:07) Self Driving Cars(36:25) AI Helping Innovation(38:02) Negative Impacts(38:39) Historical Context and Economic Concerns(42:56) AI's Impact on Job Markets and Productivity(48:22) Shared Benefits(49:46) Pessimism and Belief about AI(01:03:59) Strategies for a Positive AI Future(01:12:17) Last Question