0:00
1:39:08
Spol 15 sekunder tilbage
Spol 15 sekunder frem

With AI on everyone’s mind, we have to ask: what does it mean to think?

When does the brain actually create predictive models and rely on mental representations — and when is it really just a matter of inputs and outputs with no simulation going on in between?

Why do we feel pain and find things funny? Not just avoid damage or understand the logic of a joke, but actually feel these things?

Agreeing on what we don’t know matters, not least because trillions of dollars are invested in the dream of artificial general intelligence — but if thinking emerges in AI, how would we even know where to look? Behavioral indicators aren’t enough. What is the internal structure that would let us say with confidence “There’s real thinking going on here?”

Because as the success of deep neural networks makes clear, most intelligence doesn’t need this extra layer. Most intelligence isn’t thinking — at least, at the level of the whole organism or AI system. And, as much as we want to believe otherwise, maybe none of it has to be.

We need to remind ourselves what we don’t know. This is why guest co-host Adam Safron and I called on neurologist and neuroscientist John W. Krakauer (Website | X | Google Scholar), Director of the Johns Hopkins Brain, Learning, Animation, and Movement Lab and External Professor at the Santa Fe Institute, who has spent decades studying the modularity of the brain and the relationship between sensorimotor functions and deliberative thought through research on stroke patients.

Our conversation with John gets at the very heart of the biggest taboo in cognitive science: that there is a difference between intelligence and thinking…that we’re conscious, and we don’t know why, and these distinctions matter to intelligence research. As AI demonstrates more and more capability to do things we thought it took conscious thought to achieve but shows no indisputable concrete evidence of being conscious, it turns out science still doesn’t understand what consciousness is.

Upcoming Events

Consider becoming a patron to participate in our upcoming salons, including:

• November 20 — Accelerando by Charles Stross (notes & recording from Part 1 here)

• December 16th — The Dimensions of Experience: A Natural History of Consciousness by Andrew P. Smith

Support Work The Newsfeed Algorithm Ignores

Thanks to the Survival and Flourishing Fund for their support of this mini-series! I do not run ads, so if you get value from this work, you might like to:

✨ Become a founding member to access unreleased episodes & online courses

✨ Hire me as an advisor or public speaker

✨ Back my research and creative projects with a tax-deductible donation

✨ Browse and buy the books we mention on the show at Bookshop.org

✨ Buy my art — paintings, prints, blankets (commissions open)

✨ Learn more about how we’re applying these ideas at Atlas Research Group, my team building commons-owned tools for collective intelligence

And if you’re asking, “IN THIS ECONOMY?” but still want to show your support, tell a friend about the show and you’ll both have something new to talk about:

Chapters

00:00 Teaser

01:46 Intro

08:28 Meet John Krakauer

10:53 Against Internal Models

13:01 Replay and RL Critique

16:37 Mental (Not Neural) Representation

20:55 What Counts as Evidence

24:03 Why Humans Deliberate

26:56 AI Mirrors the Taboo

28:42 Deliberation Taboo Framework

32:04 Chain of Thought Confabulation

34:30 Slow Science and Creativity

38:15 Cognition vs Consciousness History

43:57 Pain and Conscious Advantage

46:09 Illusionism and Dennett

49:12 Working Memory Bottleneck Debate

51:03 Bennett On Simulation Limits

53:19 Defining Real Emergence

56:38 Inside LLM Representations

57:56 NeuroAI Chick Experiments

01:04:08 Efficiency And Evolutionary Pressure

01:07:00 Laughter, Feelings, Deliberation

01:13:53 Basal, Cortical, & Conscious Intelligence

01:19:57 World Policies, Not Models

01:23:27 Language’s Role & The Meaning Gap

01:27:54 Tacit Learning & One-Shot Rules

01:30:18 Admitting The Deliberation Taboo

01:31:12 Explanatory Gaps And Coarse Graining

01:37:28 Closing

Mentioned Resources

Explore the entire open-access special issue here.

And whether you read the papers or not, be sure to check out this illuminating interactive discourse map by Van Bettauer of Ideoscopic to help you navigate where these researchers agree, disagree, and point toward future study:

(Long-time fans will also want to check out his re-imagined interface for AskFutureFossils.com, complete with simulated debates between my guests!)

Mental representation without neural representation: Understanding the evidenceJohn W. Krakauer, William Ramsey

The Deliberation TabooJake Quilty-Dunn, John W. Krakauer

Large language models and emergence: a complex systems perspectiveDavid C. Krakauer, Melanie Mitchell, John W. Krakauer

Artificial intelligence for science: The easy and hard problemsRuairidh Battleday & Sam Gershman

Empowerment gain and causal model construction: children and adults are sensitive to controllability and variability in their causal interventionsEunice Yiu, Kelsey Allen, Shiry Ginosar, Alison Gopnik

A Brief History of IntelligenceMax Bennett

From Bacteria to Bach and BackDaniel Dennett

The Rediscovery of the MindJohn Searle

Concepts at the InterfaceNicholas Shea

The cultural transmission of tacit knowledgeHelena Miton, Simon DeDeo

This conversation was recorded before Anthropic announced their claim Claude does in fact form a “global workspace” and representational models — work that suggests to some researchers that frontier LLMs are in fact now possibly doing something that looks like actual thought. But is it?



This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.humansontheloop.com/subscribe

Flere episoder fra "Humans On The Loop: Wisdom for an Age of Magical Technologies"