Can we safely automate alignment research?

4/30/2025

Joe Carlsmith Audio

0:00

1:29:38

It's really important; we've got a real shot; there are a ton of ways to fail.

Text version here: https://joecarlsmith.com/2025/04/30/can-we-safely-automate-alignment-research/.

There's also a video and transcript of a talk I gave on this topic here: https://joecarlsmith.com/2025/04/30/video-and-transcript-of-talk-on-automating-alignment-research/

More episodes from "Joe Carlsmith Audio"

On restraining AI development for the sake of safety
3/19/2026
1:22:21
My take on slowing down AI. Text version here: https://joecarlsmith.com/2026/03/19/on-restraining-ai-development-for-the-sake-of-safety/
Building AIs that do human-like philosophy
1/29/2026
33:33
AIs will face philosophical questions humans can't answer for them. Text version here: https://joecarlsmith.com/2026/01/29/building-ais-that-do-human-like-philosophy/
Don't miss an episode of “Joe Carlsmith Audio” and subscribe to it in the GetPodcast app.
How human-like do safe AI motivations need to be?
11/12/2025
1:23:32
AIs with alien motivations can still follow instructions safely on the inputs that matter. Text version here: https://joecarlsmith.com/2025/11/12/how-human-like-do-safe-ai-motivations-need-to-be/
Leaving Open Philanthropy, going to Anthropic
11/3/2025
32:09
On a career move, and on AI-safety-focused people working at AI companies. Text version here: https://joecarlsmith.com/2025/11/03/leaving-open-philanthropy-going-to-anthropic/
Controlling the options AIs can pursue
9/29/2025
55:34
On boxing AIs, and on making deals with them. Text version here: https://joecarlsmith.com/2025/09/29/controlling-the-options-ais-can-pursue
Giving AIs safe motivations
8/18/2025
1:23:25
A four-step picture. Text version here: https://joecarlsmith.com/2025/08/18/giving-ais-safe-motivations
The stakes of AI moral status
5/21/2025
37:29
On seeing and not seeing souls. Text version here: https://joecarlsmith.com/2025/05/21/the-stakes-of-ai-moral-status/
Can we safely automate alignment research?
4/30/2025
1:29:38
It's really important; we've got a real shot; there are a ton of ways to fail. Text version here: https://joecarlsmith.com/2025/04/30/can-we-safely-automate-alignment-research/. There's also a video and transcript of a talk I gave on this topic here: https://joecarlsmith.com/2025/04/30/video-and-transcript-of-talk-on-automating-alignment-research/
AI for AI safety
3/14/2025
27:51
We should try extremely hard to use AI labor to help address the alignment problem. Text version here: https://joecarlsmith.com/2025/03/14/ai-for-ai-safety
Paths and waystations in AI safety
3/11/2025
18:07
On the structure of the path to safe superintelligence, and some possible milestones along the way. Text version here: https://joecarlsmith.substack.com/p/paths-and-waystations-in-ai-safety

More Episodes

Get the whole world of podcasts with the free GetPodcast app.

Subscribe to your favorite podcasts, listen to episodes offline and get thrilling recommendations.

A company from

Can we safely automate alignment research?

Joe Carlsmith Audio

More episodes from "Joe Carlsmith Audio"

On restraining AI development for the sake of safety

Building AIs that do human-like philosophy

How human-like do safe AI motivations need to be?

Leaving Open Philanthropy, going to Anthropic

Controlling the options AIs can pursue

Giving AIs safe motivations

The stakes of AI moral status

Can we safely automate alignment research?

AI for AI safety

Paths and waystations in AI safety