ForeCast podcast

Bottlenecks to an Intelligence Explosion in a Data Centre (with James Tillman and Tom Davidson)

2026-11-18
0:00
1:10:30
Spola tillbaka 15 sekunder
Spola framåt 15 sekunder

James Tillman is a research fellow at Forethought, and Tom Davidson is a senior research fellow at Forethought. They discuss whether AI could rapidly make itself smarter just by improving its own algorithms, without any new chips or data centres (a "software intelligence explosion"), and what might stop it. They cover:

  • What a software intelligence explosion is, and why it would be faster and harder to govern than one that needs new chips and factories
  • Why the data that would settle these questions sits inside AI companies, and the case for making it public
  • Scale-dependent algorithms: why breakthroughs like the transformer and mixture of experts only pay off at large scale, and what that means for automated AI researchers with small experiment budgets
  • How far it could go: how much more efficient than the human brain AI could become, and why James doubts the estimate that rests on Chinchilla scaling (an ideal brain the size of a honeybee's, learning for a million years)
  • Whether data bottlenecks, or AI that excels in the lab but not in the real world, could stop it, and why Tom thinks they wouldn't

Further reading: “How quick and big would a software intelligence explosion be?” by Tom Davidson and Tom Houlden, and Tom's “Data Bottlenecks Won't Stop an Intelligence Explosion”.

You can read a full transcript here.

To see all Forethought’s published research, visit forethought.org/research. To subscribe to our newsletter, visit forethought.org/subscribe.

Fler avsnitt från "ForeCast"