Episode 143: Is AGI Possible? (State of the Debate)

Bruce returns to AGI through the lens of a critical rationalist debate about whether or not AGI is theoretically possible. Can human intelligence be replicated? Is this a physics question or a biology question? Is our universe and our minds like a compact disc or like a vinyl record?But really, Bruce is just using the AGI debate to explore an epistemological idea: that the state of a critical discussion is objective. If two people disagree about the state of a critical discussion, at least one of them must be misunderstanding that state—possibly both of them. It’s possible they are genuinely disagreeing over something factual, but more often than not they are really just disagreeing over epistemology.⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Support us on Patreon⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

Is so-called "self-deception" a real thing? How can one at once be aware that something is true and yet also be unaware of it? Is it even a coherent concept? Doesn't deception require at least two entities—the deceived and the deceiver? Can "self-deception" be explained as something much simpler, namely deception?Bruce summarizes his views on self-deception, moralizing, and dogmatism from a critical rationalist perspective, as well as it's relevance for AGI, "Super Intelligences", and human dogmatism.⁠⁠⁠⁠⁠⁠⁠⁠⁠Support us on Patreon⁠⁠⁠⁠⁠⁠⁠⁠

This week we are joined for the 4th time by physicist Sam Kuypers. From his Conjecture Institute profile: “Quantum physicist, interested in foundational questions. In his research, published in reputable scientific journals, he explores the quantum theory of time, the many-worlds interpretation, and locality.”We discuss: Is probability theory true? Is it useful? What is the connection between probability theory and physics? Does the many worlds interpretation make probability theory more true or less true?⁠⁠⁠⁠⁠⁠⁠⁠Support us on Patreon⁠⁠⁠⁠⁠⁠⁠⁠

Ad hoc saves and immunizing stratagems are phrases Karl Popper used to describe moves humans make when we try to protect our theories from refutation. We all do this every day in one way or another.But immunizing stratagems hurts theories in that this move makes our ideas overall less convincing to other people. Marxism and psychoanalysis are the classic areas where Popper saw true believers bend over backward to save these theories from refutation from the real world. This was the main topic of The Myth of the Closed Mind by Ray Scott Percival, who we interviewed a few episodes ago. So when ideas come into contact with human minds, theories or memes that move us closer to truth have a survival advantage. So as flawed as we are, humans—all humans—cannot help but seek truth, fallibly of course. Bruce reads a lot from Ray’s book on this episode, especially from chapter 4, “Ideologies as Shapeshifters.” Please consider ordering Ray’s excellent book, which is also available on Audible. ⁠⁠⁠⁠⁠⁠⁠⁠Support us on Patreon⁠⁠⁠⁠⁠⁠⁠⁠

This week we talk about doomers, specifically AI doomers. Why has it become such a popular notion, especially amongst those who consider themselves the most rational kinds of people, that this kind of apocalypse, amongst others, is imminent? What assumptions are behind this pessimistic assertion?This episode was actually entirely unplanned. We started recording another episode and got off on to this tangent and thought it was a fun topic.⁠⁠⁠⁠⁠⁠⁠⁠Support us on Patreon⁠⁠⁠⁠⁠⁠⁠⁠

Bruce has made a controversial claim on this show: today's "CritRats" (Critical Rationalists on X) have drifted from what Popper intended. And surprisingly, some of the drift traces back to David Deutsch's reinterpretation of Popper in an attempt to solve real problems with Popper's original epistemology.In this episode, Bruce unpacks exactly how — tracing the key points where Deutsch and Popper diverge: verisimilitude, demarcation, testability vs. criticism, and what "refutation" actually meant to Popper (hint: not what you think). A sympathetic but rigorous look at where "Deutschianism" improves on "Popperianism" and where it quietly smuggles in new problems.⁠⁠⁠⁠⁠⁠⁠Support us on Patreon⁠⁠⁠⁠⁠⁠⁠

This week we were honored to interview Ray Scott Percival, a significant but also woefully under-appreciated figure in critical rationalism. Percival has been active in critical rationalist forums, conferences, and academic journals since the 90s and before. He has written for Quillette. He was the editor of a book of critical responses to Steven Pinker. He created an excellent documentary film called Liberty Loves Reason. But most significantly, in 2012 he wrote a book called Myth of the Closed Mind, which is available on Amazon in all the formats, including audio. The basic idea he explores there is that humans care about truth. We are truth seekers that create and pass on both rational and irrational memes. Dawkins calls the worst of these memes “mind viruses,” but what Percival points out is that as flawed as humans are, the good kind of memes have a competitive advantage in the war of ideas. Such a simple idea, but the implications of this are profound, and Percival has spent a lifetime wresting with them.⁠⁠⁠⁠⁠⁠Support us on Patreon⁠⁠⁠⁠⁠⁠Myth of the Closed Mind: https://amzn.to/48xAoDGX: @Ray_S_Percival

This week we had the pleasure of interviewing Michael Golding, M.D, who is a psychiatric physician. He is also heavily influenced by the philosophical ideas of David Deutsch and Karl Popper. At one point he calls himself a proponent of homeschooling and Taking Children Seriously. Together we wrestle with what critical rationalism and the universal explainer hypothesis suggests about mental illness and human creativity.Steven Peck's "My Madness"⁠⁠⁠⁠⁠Support us on Patreon⁠⁠⁠⁠⁠X: @mgoldingmd

Bruce examines how effectively critical rationalism can ground the non-aggression principle (NAP)—the libertarian idea that, in some formulation, it is morally wrong to initiate violence.But does it really make sense to interpret all areas of law through this single principle? Might it be better replaced by an alternative, such as a principle of least coercion? And what, from a critical rationalist perspective, does coercion actually mean? Is it a theory with substantial moral content, or an easy-to-vary principle that ultimately collapses into “coercion is whatever I dislike”?And how might we test between these alternating views?Bonus: What did Karl Popper think of Thomas Szasz's theories?⁠⁠⁠⁠Support us on Patreon⁠⁠⁠⁠

In this video podcast, Bruce makes his boldest statement yet about probability. He dives into David Deutsch’s lecture “Physics Without Probability”—as well as our Episode 100 interview with Deutsch—to unpack the core argument.Bruce carefully works through the mathematical details of Deutsch’s claim that probability is merely a “flat-earth approximation.” As best as he can make sense of it, however, the argument just doesn’t add up. In fact, Bruce concludes that Deutsch’s own reasoning seems to imply that probability is not at all comparable to a flat-earth approximation.From there, he methodically explores whether this long-running debate about probability is really a case of word essentialism—an argument over definitions rather than a substantive difference.He closes with an impassioned plea: if someone out there truly understands Deutsch’s argument, please help him pinpoint exactly where he’s going wrong.⁠⁠⁠Support us on Patreon⁠⁠⁠