
The latest bugbear is "AI successionism", the belief that AIs should succeed humans as rulers of Earth. But some critiques fail to distinguish between two different ideas.
True successionism says that AIs should take over, killing humans or steamrolling over their interests. This is very bad: a compact description of the thing that AI safety is against.
Handoverism says that humans should prioritize their own interests, but that those interests may be well-served by having aligned AIs in positions of control.
Some people in AI safety, including me, find this latter position plausible. We are being lumped in with the true successionists as fellow travelers in an anti-human direction (1, 2, 3, although thanks for commenters pointing out that these essays do at least make the distinction).
It may seem counterintuitive that human interests can be served by having AIs in positions of control. But I think the counterintuitiveness comes from a nationalist outlook where 'the State is the highest expression of the life of a people', and the role of leadership is for someone of your own ethnic group to be the leader so you can feel good about being on top.
The liberal outlook is that the state exists to help individuals fulfill their goals. At the risk of desacralizing the state a little more than I mean to, it's a service provider, dispensing coordination, public order, redistribution, and other good things. It's fine to automate service providers. If robot garbagemen are safer and cleaner than humans, we'll eventually automate trash collection; if robot legislators provide coordination, order, etc better than we do, we should automate that too. Every vision of the utopian future agrees we will have robot servants. And the president, they tell us, is merely a public servant. Why should he alone be exempt from the vision?
To help make this counterintuitive idea more concrete, I'll discuss five proposals for what this might look like, from weakest to strongest.
This whole topic is inherently speculative and science-fiction-ish. Don't read this and then complain that it's speculative and science-fiction-ish; that's the price of admission.
Mais episódios de "Astral Codex Ten Podcast"



Não percas um episódio de “Astral Codex Ten Podcast” e subscrevê-lo na aplicação GetPodcast.








