
Why Can’t AI Laugh at a Joke?
With AI on everyone’s mind, we have to ask: what does it mean to think?
When does the brain actually create predictive models and rely on mental representations — and when is it really just a matter of inputs and outputs with no simulation going on in between?
Why do we feel pain and find things funny? Not just avoid damage or understand the logic of a joke, but actually feel these things?
Agreeing on what we don’t know matters, not least because trillions of dollars are invested in the dream of artificial general intelligence — but if thinking emerges in AI, how would we even know where to look? Behavioral indicators aren’t enough. What is the internal structure that would let us say with confidence “There’s real thinking going on here?”
Because as the success of deep neural networks makes clear, most intelligence doesn’t need this extra layer. Most intelligence isn’t thinking — at least, at the level of the whole organism or AI system. And, as much as we want to believe otherwise, maybe none of it has to be.
We need to remind ourselves what we don’t know. This is why guest co-host Adam Safron and I called on neurologist and neuroscientist John W. Krakauer (Website | X | Google Scholar), Director of the Johns Hopkins Brain, Learning, Animation, and Movement Lab and External Professor at the Santa Fe Institute, who has spent decades studying the modularity of the brain and the relationship between sensorimotor functions and deliberative thought through research on stroke patients.
Our conversation with John gets at the very heart of the biggest taboo in cognitive science: that there is a difference between intelligence and thinking…that we’re conscious, and we don’t know why, and these distinctions matter to intelligence research. As AI demonstrates more and more capability to do things we thought it took conscious thought to achieve but shows no indisputable concrete evidence of being conscious, it turns out science still doesn’t understand what consciousness is.
Upcoming Events
Consider becoming a patron to participate in our upcoming salons, including:
• November 20 — Accelerando by Charles Stross (notes & recording from Part 1 here)
• December 16th — The Dimensions of Experience: A Natural History of Consciousness by Andrew P. Smith
Support Work The Newsfeed Algorithm Ignores
Thanks to the Survival and Flourishing Fund for their support of this mini-series! I do not run ads, so if you get value from this work, you might like to:
✨ Become a founding member to access unreleased episodes & online courses
✨ Hire me as an advisor or public speaker
✨ Back my research and creative projects with a tax-deductible donation
✨ Browse and buy the books we mention on the show at Bookshop.org
✨ Buy my art — paintings, prints, blankets (commissions open)
✨ Learn more about how we’re applying these ideas at Atlas Research Group, my team building commons-owned tools for collective intelligence
And if you’re asking, “IN THIS ECONOMY?” but still want to show your support, tell a friend about the show and you’ll both have something new to talk about:
Chapters
00:00 Teaser
01:46 Intro
08:28 Meet John Krakauer
10:53 Against Internal Models
13:01 Replay and RL Critique
16:37 Mental (Not Neural) Representation
20:55 What Counts as Evidence
24:03 Why Humans Deliberate
26:56 AI Mirrors the Taboo
28:42 Deliberation Taboo Framework
32:04 Chain of Thought Confabulation
34:30 Slow Science and Creativity
38:15 Cognition vs Consciousness History
43:57 Pain and Conscious Advantage
46:09 Illusionism and Dennett
49:12 Working Memory Bottleneck Debate
51:03 Bennett On Simulation Limits
53:19 Defining Real Emergence
56:38 Inside LLM Representations
57:56 NeuroAI Chick Experiments
01:04:08 Efficiency And Evolutionary Pressure
01:07:00 Laughter, Feelings, Deliberation
01:13:53 Basal, Cortical, & Conscious Intelligence
01:19:57 World Policies, Not Models
01:23:27 Language’s Role & The Meaning Gap
01:27:54 Tacit Learning & One-Shot Rules
01:30:18 Admitting The Deliberation Taboo
01:31:12 Explanatory Gaps And Coarse Graining
01:37:28 Closing
Mentioned Resources
Explore the entire open-access special issue here.
And whether you read the papers or not, be sure to check out this illuminating interactive discourse map by Van Bettauer of Ideoscopic to help you navigate where these researchers agree, disagree, and point toward future study:
(Long-time fans will also want to check out his re-imagined interface for AskFutureFossils.com, complete with simulated debates between my guests!)
Mental representation without neural representation: Understanding the evidenceJohn W. Krakauer, William Ramsey
The Deliberation TabooJake Quilty-Dunn, John W. Krakauer
Large language models and emergence: a complex systems perspectiveDavid C. Krakauer, Melanie Mitchell, John W. Krakauer
Artificial intelligence for science: The easy and hard problemsRuairidh Battleday & Sam Gershman
Empowerment gain and causal model construction: children and adults are sensitive to controllability and variability in their causal interventionsEunice Yiu, Kelsey Allen, Shiry Ginosar, Alison Gopnik
A Brief History of IntelligenceMax Bennett
From Bacteria to Bach and BackDaniel Dennett
The Rediscovery of the MindJohn Searle
Concepts at the InterfaceNicholas Shea
The cultural transmission of tacit knowledgeHelena Miton, Simon DeDeo
This conversation was recorded before Anthropic announced their claim Claude does in fact form a “global workspace” and representational models — work that suggests to some researchers that frontier LLMs are in fact now possibly doing something that looks like actual thought. But is it?
This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.humansontheloop.com/subscribe
More episodes from "Humans On The Loop: Wisdom for an Age of Magical Technologies"



Don't miss an episode of “Humans On The Loop: Wisdom for an Age of Magical Technologies” and subscribe to it in the GetPodcast app.








