Irakli Beridze - Can the UN Help with Global AGI Governance? (AGI Governance, Episode 11)

Joining us in our eleventh episode of our series AGI Governance on The Trajectory is Irakli Beridze, Director of the UNICRI Centre for Artificial Intelligence and Robotics under the United Nations mandate. In this conversation, Irakli draws a stark contrast between yesterday’s arms-control templates and tomorrow’s AI. Chemical weapons were narrow, outdated, and ultimately unwanted. By contrast, advanced AI is general-purpose, fast-accelerating, and universally desirable - which makes governance both harder and more urgent.Listen to this episode on The Trajectory Podcast: https://podcasts.apple.com/us/podcast/the-trajectory/id1739255954Watch the full episode on YouTube: https://youtu.be/ifxGca0uMFcSee the full article from this episode: https://danfaggella.com/beridze1...There are three main questions we cover here on the Trajectory:1. Who are the power players in AGI and what are their incentives?2. What kind of posthuman future are we moving towards, or should we be moving towards?3. What should we do about it?If this sounds like it's up your alley, then be sure to stick around and connect:-- Blog: danfaggella.com/trajectory-- X: x.com/danfaggella-- LinkedIn: linkedin.com/in/danfaggella-- Newsletter: bit.ly/TrajectoryTw-- YouTube: https://www.youtube.com/@trajectoryai

Joining us in our tenth episode of our AGI Governance series on The Trajectory is Dean Xue Lan, longtime scholar of public policy and global governance, whose recent work centers on AI safety and international coordination.In this episode, Xue stresses that AGI governance must evolve as an adaptive network. The UN can set frameworks among nations, but companies, safety institutes, and industry associations also play critical roles. Only through combining these overlapping layers can governance respond to the challenges of an unprecedented technology.Listen to this episode on The Trajectory Podcast: https://podcasts.apple.com/us/podcast/the-trajectory/id1739255954Watch the full episode on YouTube: https://youtu.be/-HLjD6FRjug See the full article from this episode: https://danfaggella.com/lan1...There are three main questions we cover here on the Trajectory:1. Who are the power players in AGI and what are their incentives?2. What kind of posthuman future are we moving towards, or should we be moving towards?3. What should we do about it?If this sounds like it's up your alley, then be sure to stick around and connect:-- Blog: danfaggella.com/trajectory-- X: x.com/danfaggella-- LinkedIn: linkedin.com/in/danfaggella-- Newsletter: bit.ly/TrajectoryTw-- YouTube: https://www.youtube.com/@trajectoryai

This is an interview with Joel Predd, a senior engineer at the RAND Corporation and co-author of RAND’s work on “five hard national security problems from AGI,”. In this conversation, Joel lays out a sober frame for leaders: treat AGI as technically credible but deeply uncertain; assume it will be transformational if it arrives; and recognize that the pace of progress is outstripping our capacity for governance.This is the fourth installment of our "US-China AGI Relations" series - where we explore pathways to achieving international AGI cooperation while avoiding conflicts and arms races.This episode referred to the following other essays and resources:Artificial General Intelligence's Five Hard National Security Problems: https://www.rand.org/pubs/perspectives/PEA3691-4.html?Types of AI Disasters – Uniting and Dividing: https://danfaggella.com/disaster/Listen to this episode on The Trajectory Podcast: https://podcasts.apple.com/us/podcast/the-trajectory/id1739255954Watch the full episode on YouTube: https://youtu.be/Ojg9l5q-gaoSee the full article from this episode: https://danfaggella.com/predd1…There are three main questions we cover here on the Trajectory:1. Who are the power players in AGI and what are their incentives?2. What kind of posthuman future are we moving towards, or should we be moving towards?3. What should we do about it?If this sounds like it's up your alley, then be sure to stick around and connect:-- Blog: danfaggella.com/trajectory-- X: x.com/danfaggella-- LinkedIn: linkedin.com/in/danfaggella-- Newsletter: bit.ly/TrajectoryTw-- YouTube: https://www.youtube.com/@trajectoryai

USMC Colonel Drew Cukor spent 25 years as decades in uniform and helped spearhead early Department of Defense AI efforts, eventually leading project including the Pentagon’s Project Maven. After government service, he’s led AI initiatives in the private sector, first with JP Morgan and now with TWG Global.Drew argues that when it comes to the US-China AGI race, the decisive lever isn’t what we block – it’s what we adopt. The nation that most completely fuses people and machines across daily life, industry, and government will set the tempo for everyone else.This is the third installment of our "US-China AGI Relations" series - where we explore pathways to achieving international AGI cooperation while avoiding conflicts and arms races.Listen to this episode on The Trajectory Podcast: https://podcasts.apple.com/us/podcast/the-trajectory/id1739255954Watch the full episode on YouTube: https://youtu.be/GnO4dRHBzKISee the full article from this episode: https://danfaggella.com/cukor1...There are three main questions we cover here on the Trajectory:1. Who are the power players in AGI and what are their incentives?2. What kind of posthuman future are we moving towards, or should we be moving towards?3. What should we do about it?If this sounds like it's up your alley, then be sure to stick around and connect:-- Blog: danfaggella.com/trajectory-- X: x.com/danfaggella-- LinkedIn: linkedin.com/in/danfaggella-- Newsletter: bit.ly/TrajectoryTw-- YouTube: https://www.youtube.com/@trajectoryai

Joining us in our ninth episode of our AGI Governance series on The Trajectory is Stuart Russell, Professor of Computer Science at UC Berkeley and author of Human Compatible. In this episode, Stuart explores why current AI race dynamics resemble a prisoner’s dilemma, why governments must establish enforceable red lines, and how international coordination might begin with consensus principles before tackling more difficult challenges. This episode referred to the following other resources:-- IDAIS, co-convened by Stuart: https://idais.ai/Listen to this episode on The Trajectory Podcast: https://podcasts.apple.com/us/podcast/the-trajectory/id1739255954Watch the full episode on YouTube: https://youtu.be/w0U5V86TMjoSee the full article from this episode: https://danfaggella.com/russell1...There are three main questions we cover here on the Trajectory:1. Who are the power players in AGI and what are their incentives?2. What kind of posthuman future are we moving towards, or should we be moving towards?3. What should we do about it?If this sounds like it's up your alley, then be sure to stick around and connect:-- Blog: danfaggella.com/trajectory-- X: x.com/danfaggella-- LinkedIn: linkedin.com/in/danfaggella-- Newsletter: bit.ly/TrajectoryTw-- YouTube: https://www.youtube.com/@trajectoryai

Joining us in our eighth episode of our AGI Governance series on The Trajectory is Craig Mundie, former Chief Research and Strategy Officer at Microsoft and longtime advisor on the evolution of digital infrastructure, AI, and national security. In this episode, Craig and I explore how bottom-up governance could emerge from commercial pressures and cross-national enterprise collaboration, and how this pragmatic foundation might lead us into a future of symbiotic co-evolution rather than catastrophic conflict.Listen to this episode on The Trajectory Podcast: https://podcasts.apple.com/us/podcast/the-trajectory/id1739255954Watch the full episode on YouTube: https://youtu.be/Utt-Q8hjF5cSee the full article from this episode: https://danfaggella.com/mundie1...There are three main questions we cover here on the Trajectory:1. Who are the power players in AGI and what are their incentives?2. What kind of posthuman future are we moving towards, or should we be moving towards?3. What should we do about it?If this sounds like it's up your alley, then be sure to stick around and connect:-- Blog: danfaggella.com/trajectory-- X: x.com/danfaggella-- LinkedIn: linkedin.com/in/danfaggella-- Newsletter: bit.ly/TrajectoryTw-- YouTube: https://www.youtube.com/@trajectoryai

This is an interview with Jeremie and Edouard Harris, Canadian researchers with backgrounds in AI governance and national security consulting, and co-founders of Gladstone AI.In this episode, Jeremie and Edouard explain why trusting China on AGI is dangerous, highlight ongoing espionage in Western labs, explore verification tools like tamper-proof chips, and argue that slowing China’s AI progress may be vital for safe alignment.This the second installment of our "US-China AGI Relations" series - where we explore pathways to achieving international AGI cooperation while avoiding conflicts and arms races. This episode referred to the following other essays:-- The International Governance of AI – We Unite or We Fight: https://emerj.com/international-governance-ai/-- Potentia and Potestas: Achieving The Goldilocks Zone of AGI Governance: https://danfaggella.com/potestas Listen to this episode on The Trajectory Podcast: https://podcasts.apple.com/us/podcast/the-trajectory/id1739255954Watch the full episode on YouTube: https://youtu.be/jf6Oy3C3mLASee the full article from this episode: https://danfaggella.com/harris1...There are three main questions we cover here on the Trajectory:1. Who are the power players in AGI and what are their incentives?2. What kind of posthuman future are we moving towards, or should we be moving towards?3. What should we do about it?If this sounds like it's up your alley, then be sure to stick around and connect:-- Blog: danfaggella.com/trajectory-- X: x.com/danfaggella-- LinkedIn: linkedin.com/in/danfaggella-- Newsletter: bit.ly/TrajectoryTw-- YouTube: https://www.youtube.com/@trajectoryai

This new installment of the Worthy Successor series features Ed Boyden, an American neuroscientist and entrepreneur at MIT, widely known for his work on optogenetics and brain simulation - his breakthroughs have helped shape the frontier of neurotechnology.In this episode, we explore Ed’s vision for what kinds of posthuman intelligences deserve to inherit the future. His deep commitment to “ground truth” - the idea that intelligence must be built from and validated against reality, not just simulated within it - is a theme that resonates across this interview. The interview is our thirteenth installment in The Trajectory’s second series, Worthy Successor, where we explore the kinds of posthuman intelligences that deserve to steer the future beyond humanity.This episode referred to the following other essay:-- A Worthy Successor - The Purpose of AGI: https://danfaggella.com/worthy/Listen to this episode on The Trajectory Podcast: https://podcasts.apple.com/us/podcast/the-trajectory/id1739255954Watch the full episode on YouTube: https://youtu.be/fqomhMhFQzoSee the full article from this episode: https://danfaggella.com/boyden1...There are three main questions we cover here on the Trajectory:1. Who are the power players in AGI and what are their incentives?2. What kind of posthuman future are we moving towards, or should we be moving towards?3. What should we do about it?If this sounds like it's up your alley, then be sure to stick around and connect:-- Blog: danfaggella.com/trajectory-- X: x.com/danfaggella-- LinkedIn: linkedin.com/in/danfaggella-- Newsletter: bit.ly/TrajectoryTw-- YouTube: https://www.youtube.com/@trajectoryai

This is an interview with Roman V. Yampolskiy, a computer scientist at the University of Louisville and a leading voice in AI safety. Everyone has heard Roman's p(doom) arguments, that isn't the focus of our interview. We instead talk about Roman's "untestability" hypothesis, and the fact that there maybe untold, human-incomprehensible powers already in current LLMs. He discusses how such powers might emerge, and when and how a "treacherous turn" might happen.This is the Third episode in our new “Early Experience of AGI” series - where we explore the early impacts of AGI on our work and personal lives.Listen to this episode on The Trajectory Podcast: https://podcasts.apple.com/us/podcast/the-trajectory/id1739255954Watch the full episode on YouTube: https://youtu.be/Jycmc_yIkU0See the full article from this episode: https://danfaggella.com/yampolskiy1...There are three main questions we cover here on the Trajectory:1. Who are the power players in AGI and what are their incentives?2. What kind of posthuman future are we moving towards, or should we be moving towards?3. What should we do about it?If this sounds like it's up your alley, then be sure to stick around and connect:-- Blog: danfaggella.com/trajectory-- X: x.com/danfaggella-- LinkedIn: linkedin.com/in/danfaggella-- Newsletter: bit.ly/TrajectoryTw-- YouTube: https://www.youtube.com/@trajectoryai

Joining us in our seventh episode of our series AGI Governance on The Trajectory is Toby Ord, Senior Researcher at Oxford University’s AI Governance Initiative and author of The Precipice: Existential Risk and the Future of Humanity. Toby is one of the world’s most influential thinkers on long-term risk - and one of the clearest voices on how advanced AI could shape, or shatter, the trajectory of human civilization.In this episode, Toby unpacks the evolving technical and economic landscape of AGI - particularly the implications of model deployment, imitation learning, and the limits of current training paradigms. He draws on his unique position as both a moral philosopher and a close observer of recent AI breakthroughs to highlight shifts that could alter the pace and nature of AGI progress.Listen to this episode on The Trajectory Podcast: https://podcasts.apple.com/us/podcast/the-trajectory/id1739255954Watch the full episode on YouTube: https://youtu.be/TIz9TpVCFcQSee the full article from this episode: https://danfaggella.com/ord1...There are three main questions we cover here on the Trajectory:1. Who are the power players in AGI and what are their incentives?2. What kind of posthuman future are we moving towards, or should we be moving towards?3. What should we do about it?If this sounds like it's up your alley, then be sure to stick around and connect:-- Blog: danfaggella.com/trajectory-- X: x.com/danfaggella-- LinkedIn: linkedin.com/in/danfaggella-- Newsletter: bit.ly/TrajectoryTw-- YouTube: https://www.youtube.com/@trajectoryai