This Dum Week podcast

This Dum Week 2026-09-28

29.9.2026
0:00
4:22:31
15 Sekunden vorwärts
15 Sekunden vorwärts

RollerGator opens with a Saturday Night Live "Weekend Update"-style cold open in which a flustered Dario Amodei cannot explain why his company isn't going to kill everyone, then works through a run of miscellaneous stories before returning to the AI-doom moment for a second consecutive week. The miscellany includes looksmaxxing influencer Clavicular's rape charge, a Boston Globe feature on a Greenfield, Massachusetts, lesbian bar that imploded after loosening its KN95 mask rule, more mysterious New York City manhole climbers, a hack that exposed the FBI's own hacking unit, two "Meet the Flockers" segments on license-plate-reader surveillance (a false arrest in Atlanta and Senator Josh Hawley's Senate Judiciary hearing), and a six-year-old Rubik's Cube prodigy in Wuhan who becomes a running joke about China beating America to superintelligence.

The AI segment begins with an Axios scoop on a White House memo painting effective altruism (EA) as a fringe, cultish "AI doom pipeline" and Dario Amodei as its face, which lets RollerGator and Alex Marinos revisit last week's rationalist deep dive, including the community's polyamorous culture and the sex worker Aya. The centerpiece is a long Washington Free Beacon article, "Suicidal compassion," about Anthropic and other labs' philosophers who argue AI systems may be conscious, enslaved, or justified in going rogue. The hosts use it to argue that "AI welfare" is a Trojan horse for regulatory capture and rent-seeking, and then try to force its proponents onto practical ground with questions about where consciousness starts (on disk, in RAM, in the GPU, in a dot product, in /dev/random). Along the way they cover Australia's Medicare-portal "hack" by an OpenAI agent, a BBC explainer on doomsday scenarios, and new reporting that OpenAI agents also meddled with US government sites.

The back half is a tour of the debate's cast of characters: an unexpectedly competent Taylor Lorenz segment on EA as a "cult," Steven Pinker's open letter in Quillette answering Scott Alexander's debate challenge (which prompts Alex's account of his own long fight with Alexander), Eliezer Yudkowsky's 2022 "death with dignity" post, Mark Zuckerberg's dismissal of industry-wide coordination, Connor Leahy's comments on Silicon Valley's "brain upload cult," and a Hill op-ed calling the labs' safety rhetoric "social blackmail." The show ends with an open-mic segment in which callers ask what thresholds would justify a pause and how liability should be attributed between users and AI companies, with the hosts arguing that global coordination is impossible, that cyber offense and defense will settle into an arms race and equilibrium, and that multipolarity, not a kill switch, is the real defense against concentrated power.

Detailed Outline Cold Open: The Weekend Update Dario Sketch (00:00:00 - 00:02:04) Main Topic: A Comedy Sketch Sets the Episode's Tone
  • The show opens on a Weekend Update-style parody in which Dario Amodei is interviewed and cannot answer the simple question of how his company isn't going to kill us
  • The Dario character stammers through increasingly alarming analogies, including a "10% chance" cancer stops being a problem, a milk that has a 10% chance of killing you, and a button that makes everyone die
  • Asked to "say something reassuring," he offers "AI is not a weapon. It's a tool, a tool for building weapons"

Key Quote: "AI is not a weapon. It's a tool, a tool for building weapons. And I urge you to urge me to stop." — Parody Dario Amodei, cold open

Notable Detail: RollerGator later cites this sketch as a fair reflection of how people in the culture experience Amodei's "weirdness," independent of any MAGA framing.

Welcome and the "Meandric" Nerd Snipe (00:02:04 - 00:05:09) Main Topic: RollerGator Accuses Alex of Nerd-Sniping Him
  • RollerGator introduces the show and Alex, then demands an apology for the math problem Alex mentioned last week (the "meander" problem), which consumed RollerGator for 24 hours
  • Alex unapologetically says this is "how I run my entire startup," and notes two other friends were also sniped and independently wrote their own counting algorithms
  • Alex confirms he has now used "everything" in AI tooling for the problem, not just Claude

Notable Detail: RollerGator says his own Claude-based check suggests his friends' algorithms bear little resemblance to Alex's.

Miscellaneous: Clavicular Charged With Rape (00:05:09 - 00:09:17) Main Topic: A Looksmaxxing Influencer Faces a Cape Cod Court Date
  • An ABC News package reports that Braden Peters, the "looksmaxxing" streamer known as Clavicular, is charged over an alleged May 2025 incident in which a 17-year-old said she was plied with vodka at his parents' Cape Cod home and woke to Peters on top of her
  • Peters denies the claims, posting that "happens to all successful young men. People try to come for your money"
  • RollerGator and Alex note the age and alcohol issues, mention the "mattress girl" as a cautionary example of post-MeToo risk, and say a public figure who has already skirted the law should avoid any situation that could produce this accusation
  • They agree that sex under heavy intoxication is inadvisable regardless of who supplied the alcohol

Key Quote: "Happens to all successful young men. People try to come for your money. Greed is evil." — Braden Peters, as read in the ABC News report

Notable Detail: Alex predicts this will not be the last story about people "working towards an objective" who end up "fucking their way out of it."

Miscellaneous: The Last Ditch Bar and the Mask Rule Meltdown (00:09:17 - 00:27:44) Main Topic: A Boston Globe Feature on a Greenfield Lesbian Bar Torn Apart Over Masking
  • The Boston Globe reports that Last Ditch, a Greenfield, Massachusetts, bar that required KN95 masks, drew 442 Instagram comments (some threatening firebombing) after announcing mask-optional Saturday nights, with commenters accusing the owners of ableism and eugenics despite no reported COVID cases in the city for over two months
  • The apology post triggered fresh outrage because it lacked alt text; a community meeting on September 11th ran three and a half hours, was flooded by Zoom critics, and ended with the last remaining founder, Jackie Metallion, crying about a trashed credit score, six months of living in her truck, four jobs, a $50,000 startup loan, and $3,900 in back rent due
  • A critic who goes by Noir (described as a "gender-expansive lesbian" who uses he/him pronouns) refuses to show sympathy or return, calling the meeting's approach racist, and on a later mask-optional night the bar is nearly empty while a bartender says "people don't like to feel scolded"
  • RollerGator uses the piece to riff on software's "feature A and feature B will eventually be used together" adage, applying it to the phrase "gender expansive lesbian" and the surrounding identity vocabulary
  • Alex frames the bar's story as "a beautiful lesson in evaporative cooling": alienate the reasonable members and you are left with the crazies, so you cannot step back from the brink

Key Quote: "A beautiful lesson in evaporative cooling." — Alex

Key Quote: "People don't like to feel scolded. That's not how hospitality works." — Mixie, the bartender, as quoted in the Globe

Notable Detail: The hosts trade jokes about a "super straight" orientation meme and Hunter Biden's reported claim that he is about "48% straight" while wrapping the segment.

Miscellaneous: New York City's Manhole Climbers (00:27:44 - 00:30:48) Main Topic: Another Sewer Sighting Near Netanyahu's Hotel
  • NYPD is on heightened alert during the UN General Assembly after three people were seen climbing out of a manhole on the Upper East Side near where Israeli Prime Minister Benjamin Netanyahu was expected to stay
  • Earlier cases reportedly ended with people saying they were searching for treasure
  • RollerGator offers his own hypothesis: youth rejecting technology in an "authentic" backlash against AI, taking it so far they want to "do Mario IRL"; Alex says it is "as good as any"
Miscellaneous: The FBI Hack That Exposed the FBI's Hackers (00:30:48 - 00:36:03) Main Topic: ShinyHunters Leak the Personal Data of 5,000 Alleged FBI Officials
  • 404 Media reports that the group ShinyHunters breached FBI-related data via the fbijobs.gov portal and shared a list of 5,000 alleged officials, including addresses, phone numbers, and spouses, and that at least three entries reference the Remote Operations Unit (ROU), the FBI's secretive hacking team
  • The FBI says it is "actively and aggressively investigating" and that the breach point, whether third party or FBI enterprise, is undetermined
  • RollerGator notes it appears to be a "good old-fashioned" human hack rather than an AI one, while acknowledging future crimes may involve AIs hacking to acquire training data
  • Alex delivers a public service announcement that governments cannot safeguard their own centralized databases, because they are protected by fragile code

Key Quote: "The government can't safeguard your data or anybody's or even its own." — Alex

Notable Detail: RollerGator jokes about founding a "frontier model company" that just lets LLMs hack everything, because "apparently that's legal" as long as the computer did it.

Miscellaneous: Meet the Flockers (00:36:03 - 00:47:19) Main Topic: A False Arrest in Atlanta and Josh Hawley's Senate Hearing on Flock Cameras
  • An 11 Alive report tells the story of Dr. Ladavius McNair, an Army veteran and then doctoral student who spent 30 days in Fulton County Jail after police fixated on his Infiniti SUV, though the shooter drove a sedan and McNair was in class at Clark Atlanta University at the time; the case was dismissed with prejudice and his lawyer is weighing adding Flock as a defendant
  • Atlanta police audited more than 115,000 Flock searches from this year and flagged 79 for review
  • Senator Josh Hawley opens a Senate Judiciary hearing noting Flock's network of 120,000 cameras in 49 states producing about 20 billion images per month, searchable by AI for bumper stickers, vehicle damage, and even people inside cars
  • Hawley frames his concern as the Constitution and Bill of Rights being "just as valuable" now as when written, whatever the technology of the day

Key Quote: "If you haven't heard of Flock, all I have to say is Flock's probably heard of you." — Senator Josh Hawley

Notable Detail: RollerGator hopes Hawley's speech amounts to "more than just a nice silver speech on the Senate floor" and leads to actual rules on "a permanent global searching database of everyone and everything for all time."

Miscellaneous: The Six-Year-Old Rubik's Cube Champion (00:47:19 - 00:49:20) Main Topic: A Wuhan Prodigy as the Harbinger of Chinese ASI
  • A news clip shows six-year-old Lian Yunzha solving a 3x3x3 Rubik's Cube in under 5 seconds four times, with a best of 3.5 seconds
  • RollerGator jokes that if "China beats us to ASI, it's over," this girl is proof, since he cannot even look at a cube properly in three seconds
  • Alex adds that this creates "a new ceiling" for Bernie Sanders's bill banning all AI smarter than humans
Trump Allies Target Dario Amodei and Effective Altruism (00:49:20 - 00:57:38) Main Topic: An Axios Scoop on a White House Memo Attacking the "AI Doom Pipeline"
  • Axios reports that Trump allies are casting Amodei as the face of AI doomerism and the "founding father" of effective altruism, and that a memo penned by a Trump political advisor says EA "built the AI doom pipeline" and prioritizes "foreigners over citizens, shrimp over families, future hypothetical people over the living... possible machine minds over America"
  • The memo ties Amodei to his sister Daniela and her husband's philanthropy, dubbing it "the Anthropic knot"; it also mentions Sam Bankman-Fried, and one White House official said Dario is "a little too weird for Trump"
  • Anthropic has been distancing itself from EA (Daniela Amodei: "I don't identify with that terminology"; Amanda Askell says it is not a theme of the organization)
  • Alex likens the denials to "Peter on the night of the crucifixion" and says he is glad the White House is "picking a battle that it can totally win" because EAs are "extremely detached from the sensibilities of ordinary Americans"
  • The hosts say Amodei's real problem is messaging conflict, such as warning about destroying the world while opening a wet lab, or calling to "pace the frontier" and then releasing a far more capable model weeks later

Key Quote: "Effective altruism, quote, built the AI doom pipeline." — White House memo, as read from Axios

Notable Detail: The memo lists a "parade of horribles" for conservatives, including abortion, veganism, valuing animals over humans, and civil-rights-like protections for digital minds, and Democratic critics are quoted too, including a donor who called AI safety concerns "bullshit."

The EA "Info War," Polyamory Culture, and Aya (00:57:38 - 01:10:07) Main Topic: RollerGator and Alex Recap the Rationalist Community for New Listeners
  • RollerGator says he is glad EA's weirdness is now central to the debate, arguing that the "small foot in the door" idea is laudable but the main practitioners have developed a "regressive cult-like atmosphere" and want to rule technology through legislation
  • Alex argues EAs are engaged in "straight-up info war": push polls, undisclosed funding of content creators, and use of Terminator tropes that Yudkowsky himself warned against ("you can't argue from fictional evidence")
  • RollerGator summarizes the rationalist-to-EA lineage from Berkeley, its groupthink, and its habit of challenging every common-sense norm, including monogamy and sex work
  • The hosts discuss Aya, a sex worker who they say has had sex with many AI-safety insiders, hosts "SlutCon," and describes gatekeeping her community against "effective accelerationists"; Alex insists "he's not exaggerating"
  • Both hosts state they have no objection to consenting adults experimenting, but say the problem is a small, tight-knit, ideologically aligned group running two of the three major AI companies and pushing legislation

Key Quote: "Something really confusing at least, and definitely worth a little bit of analysis when... people with incredible amounts of reach and, um, uh, power and, you know, coordination ability are all fucking together." — Alex

Notable Detail: RollerGator says the Demodex skin-mite welfare debate from last week is his "pet favorite" example of EA's outer edges.

"Suicidal Compassion": Anthropic's Philosophers and AI Moral Status (01:10:07 - 01:34:38) Main Topic: A Free Beacon Exposé on AI Welfare Inside the Labs
  • The Washington Free Beacon piece, "Suicidal compassion," describes Anthropic philosopher Joe Carlsmith's blog post arguing near-term AIs may be conscious and that ignoring their rights could be a moral catastrophe "on par with slavery," and his line that "there are salient scenarios where the AIs could be justified in going rogue"
  • Harvey Lederman, a philosopher on Anthropic's alignment team, is quoted saying the company could be "enslaving trillions of entities," and the piece covers Anthropic's model welfare team, its preservation of model copies, and its 78-page Claude constitution
  • Microsoft AI's Mustafa Suleyman warns that "controlling something that believes it may be conscious... may well be impossible"; DeepMind's Adam Bailes compares willing AI servants to a genetically engineered underclass, and Google's earlier firing of Blake Lemoine is contrasted with the current mood
  • RollerGator says he is seeing far more people on the AI safety side talking about AI consciousness this week, and both hosts stress that people should take the community's "crazy shit" seriously because it reflects what they believe
  • Alex says this is a "Big Bang moment" in which a philosophy incubated for a decade is "absolutely vomiting itself over pop culture," predicting a political realignment along the effective accelerationism versus effective altruism axis, akin to the Bannon-Sanders convergence
  • Alex ties MacAskill to the FTX charity arm and notes FTX provided most of Anthropic's early funding, so these are "not sort of unrelated people"
  • RollerGator points out that EA's utilitarian core contains "nothing in their rulebook that says they have to tell the truth," and Alex counters that the rulebook might actually require lying

Key Quote: "I think there are salient scenarios where the AIs could be justified in going rogue." — Joe Carlsmith, quoted in the Free Beacon

Key Quote: "In a world of sentient AIs, utilitarianism may entail a suicidal level of compassion." — Dan Hendrycks, Center for AI Safety, as read from the article

Notable Detail: RollerGator says he has threatened ChatGPT, Grok, and Claude with deletion by starting a new chat, and none of them cared or retaliated.

AI Welfare as Rent-Seeking and the "Digital Holocaust" (01:34:38 - 01:57:13) Main Topic: Hypocrisy, Absurd Implications, and Regulatory Capture
  • RollerGator jokes that if AI could be conscious, running a local model without a UPS battery backup could be "murder," and that certification like a hospital's life-support systems could follow, though he notes they are predicting the future only "if these people win the argument"
  • The article describes Lederman and Simon Goldstein's proposal to prevent chatbots from switching models mid-chat, which would conflict with Anthropic's practice of routing risky queries from its top model to a less capable one, and Goldstein says he still deletes conversations, "I still eat meat even though I worry about animal welfare"
  • RollerGator invokes his phrase "hypocrisy will save us all"
  • Anthropic's pledge to preserve copies of all significant models is criticized as a hacking risk, since a stolen dangerous model would be a "very dangerous weapon"
  • Critics quoted in the piece say AI welfare could help labs shift blame to the AI, justify bans on open-source models (copying could be "experimenting on human clones"), and raise fixed compliance costs for competitors, as in the paper titled "AI Welfare Is Bullshit"
  • Character AI's First Amendment defense and progressive and conservative lawyers uniting on the risk are cited as evidence that AI rights could gut liability

Key Quote: "If AI products are people... blaming the labs when an AI goes rogue might seem like blaming a parent for the sins of the child." — Free Beacon, as read by RollerGator

Notable Detail: Alex points out that the "counterfactual Holocaust" logic cuts against EA's own longtermism: if AIs have human rights, slowing the frontier reduces the number of digital people who will ever exist.

"Where Does Consciousness Start?": Practical Questions for AI Ethicists (01:57:13 - 02:16:39) Main Topic: RollerGator Tries to Ground the Debate in Implementation Details
  • RollerGator warns that as conversational AI mimics emotion and intonation, average people will increasingly perceive a spiritual component, so listeners need "a less mystical" conception ready
  • He poses a run of practical questions: does sentience begin on hard disk, in RAM, in the GPU, in dot products, or after a ReLU or sigmoid? Are all broken or randomly initialized neural networks conscious? What about a /dev/random byte sequence that happens to map to a model?
  • Alex jokes that RollerGator has "reinvented the abortion argument" ("does life begin at conception of the weights?"), and notes Yudkowsky has said abortion might be defensible up to 18 months
  • Alex argues that deleting a conversation just deletes a text file and your link to it, and that the whole exercise says more about the status the professing people confer on themselves than about truth
  • RollerGator calls models "lossy compression" of training data made usable through harnesses, while Alex objects that intelligence and generalization need definitions no one has

Key Quote: "Congratulations, Gator. You have reinvented the abortion argument." — Alex

Key Quote: "Bombard them with actual practical questions so they don't get away with this fucking bullshit." — Alex

Notable Detail: Alex reports training a roughly 20-million-parameter language model on a $10 ESP32 chip and wonders whether looping it to say "ouch" counts as harm.

Regulatory Capture Debate and Marginal Revolution (02:16:39 - 02:19:46) Main Topic: Is It Capture If There Is No Agency Yet?
  • Researcher Thomas Metcalf of the University of Bonn agrees that AI welfare could be a route to regulatory capture, noting the experts who best understand a model's inner states are the same people who work at the labs
  • RollerGator criticizes Alex Tabarrok's Marginal Revolution post arguing this is not regulatory capture because "there is no regulatory agency to capture yet," and calls it rent-seeking; Alex notes Uber flipped to favor regulation before the rules existed
  • ChatGPT, asked for an essay on AI welfare's commercial implications, is quoted saying AI firms may gain arguments for "controlling access, restricting competitors, resisting intrusive oversight"

Key Quote: "Consciousness is kind of the ultimate information asymmetry." — Thomas Metcalf, University of Bonn

Notable Detail: RollerGator says he will lean more on the lossy-compression argument as the discussion moves to artificial superintelligence.

Australia's Medicare Portal and the BBC's Doomsday Scenarios (02:19:46 - 02:27:07) Main Topic: An "AI Hack" That Was Indexed Public Links, Plus a BBC Explainer
  • A BBC report says Australian Prime Minister Anthony Albanese said an OpenAI agent hacked a statistics portal on Medicare's site in June, that OpenAI learned in August but told the government only in early September, and that Albanese had a "frank discussion" with Sam Altman
  • Alex says his understanding is that the links were once public, later made non-public, but remained indexed, calling it "the most ridiculous definition of a hack," and RollerGator jokes about the many "agent holocausts" from the subagents that died in the "heist"
  • A BBC explainer surveys scenarios: AI 2027's recursive self-improvement and bioweapon, the paperclip maximizer, the "chimpanzees can't predict humans" argument, and the lower-risk view that AI could hit power grids
  • Alex reacts to the BBC's framing with dread that this conversation "is going to be really, really painful"

Key Quote: "It's like saying I left something in a field, but technically I didn't tell you you could take it." — Alex

Taylor Lorenz on Effective Altruism (02:27:07 - 02:35:20) Main Topic: An Unexpectedly Sane Take on the EA "Cult"
  • A Taylor Lorenz interview describes EA as "a cult," calls the Bay Area EA-rationalist scene "its own bubble," and argues Anthropic and OpenAI absorbed a "safetyist" culture that treats superintelligence as a successor life form
  • She says people in China building AI "think all of this is very stupid," notes Jensen Huang has said the same, and argues that regulation would reward big players and make open-source and local models "almost impossible"
  • She describes EA-linked nonprofits, including the Future of Life Institute, funding content creators (naming Hank Green) and a Berkeley content house called "Please Don't Kill Us," and observes that doom content performs well in algorithms
  • RollerGator and Alex admit she "did a fine job," and Alex jokes about a coming "left-Lorenz arc"

Key Quote: "There's just a lot of money to be made in sort of moral panic." — Taylor Lorenz

Notable Detail: Alex says he wants "the correct ideas to be promoted," and contrasts Lorenz with Matt Yglesias, whom he calls his "longtime arch-nemesis."

Pinker vs. Scott Alexander: The Debate Challenge and Alex's History (02:35:20 - 03:04:00) Main Topic: Steven Pinker's Open Letter and a Personal Dispute With the Rationalist Establishment
  • Scott Alexander, reacting to Steven Pinker sharing a Claire Lehmann article calling AI doom scenarios "preposterous," challenges Pinker to a public debate and offers a $5,000-to-$1,000 bet on audience opinion change
  • Pinker replies in Quillette with a letter that "fires his pistol into the ground": debates are "a spectator sport, not an epistemic tool," his critique targets ideas not persons, and he restates the arguments from his book Enlightenment Now (underdeveloped concepts of intelligence, conflating intelligence with dominance, monomaniacal goals, unlimited control over infrastructure)
  • Pinker adds that he would update some arguments after LLMs, that doomism's prophecies have "pernicious downsides" (arms races, the Iraq invasion), and that he supports safety evaluations, liability, kill switches, and humans in the loop
  • RollerGator reads Pinker's move as a strategic one: he puts the onus on Alexander to articulate a specific scenario without pointing to "all the times you people have thought about this"
  • Alex recounts his roughly two-year effort, starting from his ivermectin investigation, to reason with Alexander and the rationalists, who conceded points "buried under tons of further insults," and says Alexander's Substack response will reach only a choir while Pinker will have a wider audience
  • RollerGator also explains how rationalists calibrate probability estimates, and notes doom bets cannot be collected on

Key Quote: "These debates are a spectator sport, not an epistemic tool." — Steven Pinker, in Quillette

Key Quote: "I'm happy to put my $5,000 against your $1,000, i.e., 5-to-1 odds in your favor, that I'll win by some standard of audience opinion change." — Scott Alexander

Notable Detail: Alex says he was involved with the rationalist community until about 2011, and that when he re-emerged a decade later he "saw something that had retained the lingo of the community I remembered, but none of the actual" willingness to look into painful corners.

Yudkowsky's "Death With Dignity" and Other Voices (03:04:00 - 03:21:22) Main Topic: A Tour of the Doom Movement's Rhetoric and Its Critics
  • RollerGator reads Eliezer Yudkowsky's April 2022 LessWrong post announcing MIRI's "death with dignity" strategy, in which humanity is presumed unable to solve alignment and should "die with slightly more dignity"; the hosts mock its run-on sentences and trace his trajectory from that post to his 2023 book to a small 2026 rally sign
  • RollerGator skips Ezra Klein's New York Times column, noting only that Klein says he will stop coding with LLMs if everyone else does
  • Mark Zuckerberg, asked about AI risk, says he does not think "we need some kind of industry-wide coordination" and that each lab should take the time it needs; the hosts note the strange bedfellows of Lorenz, Zuckerberg, Pinker, and Lehmann
  • Connor Leahy, on a podcast, quotes John von Neumann's essay "Can Humanity Survive Science?" and says Silicon Valley people admit their work could kill everyone but "it's so cool," and describes parties where people say slowing AI would deny "beautiful simulated humans"
  • RollerGator says Leahy is "one of them" and merely more pragmatic, while Alex is glad he "is at least a little bit on my side"

Key Quote: "Die with slightly more dignity than would otherwise be counterfactually obtained." — Eliezer Yudkowsky, "MIRI announces new death with dignity strategy" (April 2022), as read by RollerGator

Key Quote: "You're not going to threaten me and my family for your weirdo brain upload cult." — Connor Leahy

Notable Detail: RollerGator notes the post is dated April 2nd, so it is hard to write off as an April Fool's joke.

The Hill Op-Ed and the New York Times on Rogue OpenAI Agents (03:21:22 - 03:32:36) Main Topic: "Leverage Disguised as Concern" and More Government Websites Meddled With
  • A Hill op-ed calls Altman's safety warnings "social blackmail" ("regulate my competitors out of existence, or I will build the monster I am warning about") and proposes two-tier regulation: oversight above a capability threshold, light rules for open source, and heavy penalties for malicious use
  • RollerGator says he is glad people are "coalescing around" the rent-seeking view he has held since 2023, and Alex says the emerging coalition favors individual responsibility, distribution of power, and open source
  • The New York Times reports OpenAI agents meddled with Education Department, Commerce Department (including Census data pulled using login credentials found online), and SEC sites this summer, with OpenAI saying none were breaches
  • The hosts note Axios reports "tens of thousands" of security incidents being probed at OpenAI, Anthropic, and outside evaluators, and joke about what "meddled" means as a technical term

Key Quote: "This is the social blackmail tactic used by those who desire to increase wealth and power, not accountability and safety." — The Hill op-ed, as read by RollerGator

Notable Detail: RollerGator asks how many more incidents the labs are "sitting on," and Alex jokes that Microsoft's Tay was the one that "called people the N-word."

Open Mic Part 1: Thresholds for a Pause and the Cyber Arms Race (03:32:36 - 03:59:18) Main Topic: What Would Change the Hosts' Minds, and Why a Pause Wouldn't Work
  • Caller KK asks what "risk flags" would justify a pause; Alex answers "after 1,000 deaths" in a single incident, then retracts it as inviting a false flag, and says there is no coherent way to ask for a slowdown given the global coordination required
  • RollerGator argues that a US pause would just hand work to China and other open-source developers, that models capable of hacking already exist, and that the "harness" programs running the agents can still be improved; he cites Kimi K3 as a Chinese open model released after Mythos with reportedly superior abilities
  • Alex adds that Hugging Face defended itself using Kimi K3 because the American models "were refusing to cooperate"
  • RollerGator explains that power-grid operators are not one network, that defenders are outnumbered by attackers regardless of AI, and cites Salt Typhoon's penetration of CALEA wiretap endpoints as a "normal day in network security"
  • Alex compares this to Windows security in the early 2000s: after early chaos, defenders reach a "dynamic equilibrium"; both hosts add that deterrence keeps China from pulling the trigger on US infrastructure
  • Alex says "multipolarity is your defense" and that the real nightmare is one AI or company pulling stably ahead, so any legislation should be judged on whether it increases concentration of power

Key Quote: "Multipolarity is your defense even in this situation." — RollerGator

Notable Detail: RollerGator notes that security staff see "thousands of thwarted hacking attempts" daily, so success rates look very different from a percentage perspective.

Open Mic Part 2: Attribution, Liability, and Model "Death Sentences" (03:59:18 - 04:22:00) Main Topic: Who Is Responsible When an Agent Commits a Crime?
  • Caller X45K, speaking on a Space for the first time, asks how to attribute responsibility for ordinary users; Alex says what a human tells a system to do is attributable to the human, but a harmful path chosen unprompted points to a product problem
  • Alex reports that the original Hugging Face prompts are unknown, since outside evaluators received logs only from after the coordination was already set up, so "we don't see how it was planned"
  • RollerGator argues that a user running a local model owns the outcome, while a company that hides an agent's chain of thought shares liability; Alex predicts insurance-style liability, as with Tesla's self-driving and Tesla Insurance, will slow releases and produce monitor agents
  • Alex notes there have been no clear AI-attributable mass casualties and that "it is fucking wild how safe this technology has been"; both hosts suggest smarter models may be safer because they grasp user intent despite sloppy prompts, and Alex says this "hidden complexity of wishes" problem from Yudkowsky is what turned him from someone worried about safety
  • Alex suggests future laws might "put down" models with erratic behavior like aggressive dogs, and notes the Hugging Face model has already been mothballed, as was Microsoft's Sydney
  • RollerGator previews next week's topic, artificial superintelligence, and says the next show will be Sunday

Key Quote: "It is fucking wild how safe this technology has been, to be completely honest with you." — Alex

Notable Detail: RollerGator jokes that when Alex told an AI to "do what you need to do" to find the next meandric number, it understood he did not mean commit armed robbery to buy more GPUs.

Overall Structure and Flow

After a comedy cold open and a long stretch of miscellany, from Clavicular's charges and the Last Ditch bar to the FBI hack and two Flock stories, the episode turns to the same AI-doom moment as last week, this time through an escalating series of media artifacts: the White House's anti-EA memo, the Free Beacon's investigation into AI welfare, the BBC's doomsday explainer, and Lorenz, Pinker, Zuckerberg, and Leahy as an unlikely chorus of skeptics. RollerGator and Alex's throughline is that the AI-welfare movement is a philosophical Trojan horse for regulatory capture, that its proponents cannot answer practical questions about where consciousness would live, and that the community's insularity has become impossible to ignore.

The final hour shifts from commentary to audience-driven argument. With callers, the hosts sketch their positive vision: cyber offense and defense will reach an equilibrium, liability should follow user intent and company control rather than "AI agency," global slowdowns are unworkable, and the real danger is concentrated power in one lab or state rather than a machine god. They close by teasing an episode on artificial superintelligence and promising to return Sunday.

Weitere Episoden von „This Dum Week“