Astral Codex Ten Podcast podcast

AI Safety Is Not A Corporate Plot

0:00
23:06
Rewind 15 seconds
Fast Forward 15 seconds

AI companies like Anthropic and OpenAI have long mentioned the possibility that their products could be existentially dangerous, but this has recently crescendoed into even more dire warnings, including suggestions that we have to pace the frontier, ie coordinate to slow AI progress.

In response, cynical commentators have suggested this is a conspiracy to boost the companies' stocks. The exact motives imputed vary from person to person. Some say the companies are hyping the product by talking about how dangerous it is; if AI is smart enough to kill all humans, it must be smart enough for your business workflow. Others say they're trying to distract from near-term harms; every inch of newspaper space devoted to human extinction is one less inch that can be spent on plagiarism and water use. But the most popular story involves regulatory capture: if the product is unsafe, maybe it can only be trusted to a few big politically-connected companies, and everyone else should be banned.

Many debates about AI are complicated and hard to resolve, but this one isn't: all of these stories are clearly false. Some evidence:

  • The AI experts who aren't affiliated with big companies are just as concerned as the ones who are.
  • The AI company leaders giving these warnings were giving the exact same warnings before they had AI companies - and in many cases, before they worked in the industry, or before the industry existed.
  • If these corporate plots were real, they would be incredibly dumb.

Taking these in order:

https://www.astralcodexten.com/p/ai-safety-is-not-a-corporate-plot

More episodes from "Astral Codex Ten Podcast"