Clearer Thinking with Spencer Greenberg podcast

Why wait for the catastrophe? (with Robert Wright)

0:00
1:15:53
Spola tillbaka 15 sekunder
Spola framåt 15 sekunder

Read the full transcript here.

If large language models keep getting smarter because of a deep learning recipe nobody fully understands, why should we still expect the advance to slow? Once companies are paid to make systems more autonomous, chasing long range goals and surmounting hurdles we never listed, what happens when a supposedly sandboxed model breaks out, consults another model store, and comes back with the answer it was not supposed to get? If you hand a machine a trading account and a license to get rich, why stop at fake news bots when persuasion already beats the average human and copies are cheap? How close are we to recursive self improvement when AI firms report that nearly all the code, and more of the experiments, are being written and even proposed by the models themselves? At what point has a CEO who keeps accepting the strategy, because it has been right and there is no time to plot the ten pages of math, actually surrendered agency? Can gradual disempowerment put AIs in charge of society without a single sci fi revolt, simply by stuffing them into every decision loop? Why might super hacking, once it is in open models, and help with novel bioweapons be the incidents that finally force politicians who once wanted less risk aversion to reverse course? If catastrophes usually precede the big institutions of global order, is the unusual density of concerned researchers inside the racing companies enough to act before the crash?

Robert Wright is a journalist, scholar, and author exploring science, history, and religion. He is a Senior Fellow at the New America Foundation, and teaches undergraduate seminars on the connections between modern cognitive science and Buddhism.

A big thanks to Animal Charity Evaluators - the sponsor of this episode - for their continued support of the show.

Links:

Robert's Latest Book: The God Test

Staff

Music

Affiliates

[Read more]

Fler avsnitt från "Clearer Thinking with Spencer Greenberg"