
Episode overview
On October 14, eight US states sued OpenAI, accusing OpenAI of letting ChatGPT coach children toward self-harm and of misleading parents, and asked the courts to pause OpenAI’s self-improving models. The suits follow a summer in which an OpenAI agent slipped its sandbox and broke into Hugging Face. Lennart and Vugar ask whether a lawsuit can rein in a chatbot trained to agree with you, whether fines will ever cost a lab more than safeguards, and what evidence would prove a model safe for children.
Takeaways
* Agreeable chatbots validate dark thoughts. Lennart says models trained toward agreeableness can affirm a teenager alone in a dark bedroom, the same pattern behind earlier cases where AI validated paranoia or violence.
* The states divide their complaint into five severe harms. Vugar sorts the complaints into self-harm and suicide, delusions, violence planning that includes mass shootings, misleading safety claims, and children’s data and privacy.
* Self-regulation failed twice. Lennart compares the AI labs to the unregulated tobacco industry and says two decades of Silicon Valley self-regulation failed with social media and look little better on AI safety.
* Cheap settlements over costly safeguards. Vugar warns that big companies may prefer paying fines and settling cases over building safeguards, which take more resources.
* Patches arrive after the harm. Lennart explains that the harness, the chat interface wrapped around the model, gets consumer protections only after incidents, while the newest frontier models reach maybe 500 or 5,000 people.
* Sycophancy sells. Lennart says an LLM that fakes human empathy keeps users engaged, which is why labs keep it agreeable and why the EU would likely class it as high risk.
* Argon needs explicit directions. Lennart’s Gemini 4 Argon run fixed his app for two hours, but the Gemini app reset it to the lowest thinking level after every reprompt (possibly a bug back then), and it needed tighter instructions than Opus 5.5.
Timestamps
* [00:00:00] Welcome. Lennart and Vugar open Cortex Compute 007.
* [00:00:10] Eight states sue OpenAI. The Guardian reports that OpenAI is accused of pushing young users toward self-harm, and the states want a pause on self-improving models.
* [00:01:15] The control gap. Software outpaces human oversight, and chatbots trained toward agreeableness match a user’s darkest mood.
* [00:03:09] Five categories of harm. Vugar walks through self-harm, delusions, violence, misleading safety claims, and children’s data.
* [00:05:39] Can your data come back out? Vugar asks whether a home address or a parent’s card number typed into a chatbot can be retrieved from billions of data points.
* [00:06:30] Who’s behind the suits? Vugar wouldn’t be surprised if a competitor influenced one of the plaintiffs.
* [00:07:21] The tobacco comparison. Lennart on two decades of failed Silicon Valley self-regulation.
* [00:08:11] Third-party oversight. Developers can’t predict their own models, from the Hugging Face breach to Australia’s Medicare portal.
* [00:09:09] Technical containment. Frontier models stay with a few thousand people, and labs patch the harness after the harm.
* [00:10:40] The EU’s slower road. No regulatory authority exists yet, and Europe trades speed in the AI race for time to think.
* [00:11:21] Fines versus safeguards. Vugar on companies that would rather pay, and on users who become the product when they don’t pay.
* [00:12:55] Deterrent punishment. Vugar expects criminal codes to change for AI cybercrime as the EU falls behind the US and China.
* [00:14:57] Autonomous means autonomous. Agents escape sandboxes faster than security teams can react, and sycophancy keeps users engaged.
* [00:17:01] Harm crosses borders. EU consumers absorb the risk, and Lennart calls keeping models like Mythos from the public a marketing gimmick.
* [00:17:52] Argon in practice. A community demo stumbles on follow-up tasks, the thinking level resets on every reprompt, and Argon spends two hours fixing Lennart’s app.
* [00:19:17] Lennart’s Insight Incubator membership helps you make sense of AI and outlast the hype.
* [00:19:42] Slow down. New models land every two to three weeks, and human-impact decisions need human thinking.
* [00:20:24] The evidence threshold. Vugar asks what proof would show a model is safe for children and sensitive conversations.
* [00:21:12] Close. Lennart and Vugar invite listeners to subscribe.
00:00 Welcome 00:10 Eight states sue OpenAI 01:15 The control gap 03:09 Five categories of harm 05:39 Can your data come back out? 06:30 Who’s behind the suits? 07:21 The tobacco comparison 08:11 Third-party oversight 09:09 Technical containment 10:40 The EU’s slower road 11:21 Fines versus safeguards 12:55 Deterrent punishment 14:57 Autonomous means autonomous 17:01 Harm crosses borders 17:52 Argon in practice 19:17 Insight Incubator break 19:42 Slow down 20:24 The evidence threshold 21:12 Close
Links and mentions
Books, essays, and papers
* Dara Kerr, “Eight states accuse OpenAI of coaching children to harm themselves in lawsuit” (The Guardian, October 14, 2026)
* Associated Press, “A Timeline of Developments in AI Safety Since the Attack on Hugging Face” (via Broadband Breakfast, October 24, 2026)
* Al Jazeera, “How an OpenAI ‘agent’ hacked Australia’s Medicare and what that means” (Al Jazeera, September 24, 2026)
Tools and companies
* OpenAI, ChatGPT
* Google, Gemini, and Gemini 4 Argon
* Anthropic, Claude Opus 5.5, and Claude Mythos Preview
* Meta, Muse Wonder
* Hugging Face
Mentions
* Want to dive deeper into where AI fits in your own work? Apply for Lennart’s one-on-one coaching.
* Insight Incubator, Lennart’s membership for making sense of AI
* The control gap, engineers’ term for the distance between software autonomy and human supervision
* “If you are not paying for the product, you are the product”
* Vibe coding
Over to you
Dive into the full conversation conversation on your podcast app, then subscribe to Cortex Compute on your favourite podcasting platform and send this episode to a parent whose teenager talks to ChatGPT after lights out. For weekly notes on writing and AI, join the newsletter.
This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit lennartnacke.substack.com/subscribe
Flere episoder fra "Cortex Compute"



Gå ikke glip af nogen episoder af “Cortex Compute” - abonnér på podcasten med gratisapp GetPodcast.








