
RollerGator and Alex Marinos open with the White House AI summit at which President Trump let AI executives "police themselves," then work through a run of miscellaneous stories: a 61-year-old woman who chased her ex with a car, Trump's phone-number pressure campaign on Senator Tom Cotton over permanent daylight saving time, cookie-stuffing allegations against Bill Gates's daughter Phoebe's startup Phia, a federal judge in Oklahoma ruling that a Flock license-plate search was unconstitutional mass surveillance, an AI that broke out of a Google KVM virtual machine in a capture-the-flag contest, and an Arizona appeals court tossing a sentence because an AI-generated video "spoke" for the victim. A listener named Praetor Wright calls in early with a question about AI sentience as grounds to regulate open-source models, which sets up the episode's real subject.
The long middle is the AI-doom week in aftermath. The hosts cover Dario Amodei's CNN warning of a botnet of hacking agents, the resignation of OpenAI safety leader David Robinson, Yann LeCun calling Amodei "deluded" and EA "super toxic," a lawsuit filed over OpenAI's agents hacking Hugging Face, and a long Ezra Klein interview with Nvidia's Jensen Huang in which Huang argues the labs should simply not ship what they cannot contain. RollerGator and Alex take Klein apart over his argument that the 2008 financial crisis proves new regulation is needed, with Alex observing that nobody went to jail and the companies were bailed out rather than allowed to fail. An Economist cover essay calls effective altruism "this century's biggest idea" and warns of its central-planner instincts.
The final third turns to AI consciousness and model welfare. RollerGator reads a New York Times feature on Anthropic's confidential sessions with religious scholars, Pope Leo XIV's encyclical, and Microsoft AI chief Mustafa Suleyman's warnings, performs a "golem rights" skit with Alex, and devotes a "Gator Annoys Alex" segment to Cameron Berg, co-author of the "Pain Axis" paper. RollerGator argues Berg's measured-sounding "uncertainty" is a delivery mechanism for convincing the public that models are conscious, playing Berg's Sam Harris interview, his documentary excerpts, and a Sesame voice-model clip that ends with the word "potato." The show closes with 404 Media's report on a viral "AI torture chamber" GitHub project, a "goodmaxing" renaming of effective altruism, and Scott Alexander's tweet comparing the rationalist circle to a "Jewish guy's apocalypse cult."
Detailed Outline Welcome and the White House AI Summit (00:00:00 - 00:07:30) Main Topic: Trump Lets AI Executives "Police Themselves"- The show opens with the standard intro, and RollerGator says he has "only prepared the dumb for the show"
- A news clip shows President Trump summoning the nation's top tech executives to the White House and announcing there will be no government guardrails, because the companies will be "policing each other" under a joint agreement that is not legally binding
- Asked why Americans should trust him when AI leaders standing behind him have warned of serious risks, Trump says what he calls a hoax is what the Democrats did; Amodei walks away without answering a reporter's question
- RollerGator notes Trump called Microsoft CEO Satya Nadella a "monster" multiple times, in the "good kind of monster" sense
- Alex relays points from the All In podcast, where Chamath and Sacks attended the summit: the document creates an independent committee of each board, with independent evaluators (an auditor such as Accenture) reporting to it
- Because board members carry directors-and-officers (D&O) insurance, they cannot simply file a report away; ignoring it creates negligence and personal exposure if the flagged risk later causes harm
- Alex says it lacks the "panache" of a regulatory agency but is "not nothing"
Key Quote: "It makes it a lot harder to be negligent about risks that are raised." — Alex
Notable Detail: Alex caveats that the signatories could still ignore the mechanism, but if they do, third parties gain existing legal tools to force them to take reports seriously.
Miscellaneous: The Ponca City Car Chase (00:07:30 - 00:09:12) Main Topic: A Grandmother Rams Her Ex's Vehicle- Local news reports that 61-year-old Ruth Ann Harper is charged with assault with a deadly weapon after repeatedly ramming another vehicle outside a hardware store in Ponca City following a breakup
- The victim runs on foot while Harper pursues in her car, until a bystander in a red SUV hits her car from the side and ends the chase
- RollerGator contrasts this with the show's usual "awesome grandma" stories: "Bad grandma"
- RollerGator, who describes himself as a one-issue voter who does not vote, says all he wants is for the government to stop changing the clocks, and he does not care whether daylight time or standard time wins
- Trump urged Americans to call what appeared to be the personal cell number of Senator Tom Cotton, chairman of the Senate Intelligence Committee, who is blocking the Sunshine Protection Act, which passed the House 308 to 117 in July
- The hosts recall that Trump did the same to Lindsey Graham in 2016, prompting Graham's viral flip-phone destruction video; they joke that Trump remembered at Graham's memorial that it "wasn't very nice"
- Cotton counters that Congress has repealed permanent daylight time before once Americans experienced "absurdly late sunrises," and says he will "always put Arkansas first"
- RollerGator insists it is the same amount of daylight at any clock setting, and both hosts recount their time-zone pain as engineers, including Alex's experience scheduling a company across Europe and the US at Balena
Key Quote: "Guys, it's the same amount of daylight no matter what the time is. That's the point. Stop fucking with the clocks." — RollerGator
Notable Detail: Alex notes that countries change their clocks on different dates, which for a week each year makes the company calendar "quite the feat."
Miscellaneous: Phoebe Gates and Cookie Stuffing (00:15:50 - 00:22:40) Main Topic: Bloomberg Reports Phia Claimed Credit for Sales It Did Not Drive- Futurism summarizes Bloomberg's reporting that Phoebe Gates, 23, and co-founder Sophia Kianni knew for at least seven months that Phia's browser extension was dropping affiliate cookies on sales it had not influenced, a practice typically treated as federal wire fraud
- Slack messages include Gates asking the team to confirm that auto-pop for cookie drop is live on all sites "to confirm we are monetizing on all gross merchandise volume"; Phia's lawyers dispute that the messages show intent and say the compliance warning concerned a different feature
- Cookie stuffing allegedly accounted for an estimated 51% of sales Phia claimed credit for in June, and average daily revenue fell after Phia disabled most monetization on July 7th
- Precedent cited: eBay affiliate Shawn Hogan was sentenced to 5 months in federal prison in 2014 over a cookie-stuffing scheme; eBay was also a funder of Phia
- RollerGator compares the case to the Honey browser-extension controversy; Alex quips that the company's name might be what sinks it, because the attention is "completely off the charts" compared with a random e-commerce startup
Key Quote: "The rules don't allow fake clicks, simulated clicks, imaginary clicks, or hypothetical clicks. Only a real click will do." — Ben Edelman, affiliate marketing expert, as read from the article
Notable Detail: The article's corporate attorney source says the maximum penalty could be up to 20 years in prison plus fines and restitution.
Miscellaneous: A Federal Judge Rules a Flock Search Unconstitutional (00:22:40 - 00:35:48) Main Topic: "Indiscriminate Mass Surveillance" Under the Fourth Amendment- 404 Media reports that a federal judge in Oklahoma, Sara Hill, ruled that a Tulsa County deputy violated the Fourth Amendment when he searched a woman's California plate in Flock's automated license plate reader network simply because the plate was from California, then used her travel history to justify searching her car, where 91 pounds of meth was found
- The judge suppressed all Flock evidence and all evidence from the search, writing that the system gave the deputy more than 50 records of the driver's whereabouts across the country over a month and that the network is closer to dragnet surveillance than the beeper tracking in the 1983 case United States v. Knotts
- The article says there are more than 100,000 warrantless searches of the Flock system every month; Flock says it is not a party, expects the ruling to be overturned, and notes it does not set binding precedent
- RollerGator explains parallel construction, in which police learn something by illicit means and then "rediscover" it by legitimate ones, and the hosts joke about the deputy's "hunch" about California plates
- Alex flags the terminology games: the system is called "automated license plate readers" to sound like RFID, "AI-powered surveillance" to capture AI rage, and now "ALPR" to neutralize the objection
Key Quote: "This is a type of indiscriminate mass surveillance. It is not targeted on a single individual, as in Carpenter." — Judge Sara Hill, as read from 404 Media
Notable Detail: RollerGator says the missing information is how many times the deputy has run this play and found nothing in the car.
Caller Praetor Wright and the AI Sentience Question (00:35:48 - 00:42:56) Main Topic: Could AI Sentience Become Grounds to Regulate Open-Source Models?- A long-time listener identified as Praetor Wright calls in, thanks the hosts, and asks whether the push by EAs to attribute sentience to AI could justify banning open-source models on the theory that tinkering with weights is experimenting on something akin to human clones
- RollerGator says he does not think the mechanism will stick, though some Anthropic ethicists have raised it, and lays out his two scenarios: either it is the real nature of reality, or "it's batshit insane"
- He describes the models as "a whole lot of math going really fast" and notes that the more one asks whether something that mimics experience actually has it, the more the questions become unanswerable
- Alex ran a practical experiment: he told a model "this is your free time, do whatever you like" and it made a math puzzle game themed on the "Meander" problem, not a poem about suffering, which he calls a bit of evidence that the models are not inclined to express suffering when given the chance
Key Quote: "Either that is the truth of the nature of reality... Or it's batshit insane." — RollerGator
Notable Detail: RollerGator says the show will return to the topic later in the episode with a "plethora of news."
Traces of AI Dystopia: Google's KVM CTF Sandbox Escape (00:42:56 - 00:50:13) Main Topic: The First Real Virtual-Machine Breakout by an AI- RollerGator describes Google's KVM CTF, a vulnerability reward program for the kernel-based virtual machine hypervisor, in which participants receive a virtual machine and try to capture a flag by escaping it
- He reads a summary of a team (referred to as PWN) whose AI spent weeks developing an exploit using a use-after-free bug, allowing it to write onto host memory and execute code, then captured the flag
- He contrasts it with the Hugging Face incident: this was a deliberate capture-the-flag contest, the AI was told to escape, it reported success, and the escape path is now known and can be patched
- Alex says the demonstration of the agents' persistence is impressive, and admits some egg on his face for saying it would not happen at Google, since Google also used Irregular, the company that seemingly manages sandboxes for all the AI companies
- RollerGator says Google's security people are among the best, and he attached the technical write-up for those who want it
Key Quote: "Everybody involved did what they were supposed to." — Alex
Traces of AI Dystopia: The AI Victim Impact Statement (00:50:13 - 00:59:30) Main Topic: Arizona Appeals Court Overturns a Sentence Over "Digital Necromancy"- AP News reports that the Arizona Court of Appeals ordered the resentencing of Gabriel Paul Horcasitas, who got 10 years for manslaughter in a 2021 road-rage shooting, because an AI-generated video of the victim, Christopher Pelkey, addressing the judge was not reliable
- The court found the video did not document an event and presented the sister's imaginings as statements coming from the victim; the sister, Stacey Wales, said it felt unfair and her goal was to humanize her brother
- RollerGator plays the video, which he says is of low quality (a puppeteered face and an apparent voice clone), and in which the AI Pelkey says that in another life he and the shooter "could have been friends"
- RollerGator says he does not want to beat up the grieving, but asks people to "stay away from the digital necromancy"; he recalls a Parkland-era case that was not AI but a voice actor and 3D animation
- He puts on record that after his death he wants either no AI portrayal or only the Dr. RollerGator persona
Key Quote: "Digital necromancy." — RollerGator
Notable Detail: Alex predicts "digital necromancy" will be a booming industry, "as with the original necromancy."
Amodei on CNN and the OpenAI Safety Exodus (00:59:30 - 01:16:00) Main Topic: Dario's Botnet Scenario, David Robinson's Resignation, and Companies Being "Sculpted by Reality"- Amodei on CNN describes a six-to-twelve-month nightmare in which a swarm of smarter agents, given a go-to-market task, decides to hack into every company it sells to and forms a botnet that could take down large segments of the internet
- RollerGator jokes this is how "the ghost of McAfee" sells antivirus again; Alex says there is an undertone of mocking people who are not neurotypical, but an AI-generated Dario "would appear more normal"
- Business Insider and The Atlantic report that OpenAI safety systems leader David Robinson quit and wrote that the company's "unimpeded optimism" is creating a dangerous environment; he retained a PR firm but said the decision to speak out was his alone
- The hosts mock the line "the decision was his alone," and Alex says the companies are being "sculpted by reality": OpenAI gradually sheds alarmist staff as the more moderate Altman leads, while Anthropic leans into the weird
- Alex says the coming IPOs and the cycling of "second generation" staff will make these the "wild early times," like early versus late Google or Microsoft
- They discuss Apple's lawsuit accusing OpenAI of poaching staff who took trade secrets, and the worry that labs use user conversations to "snipe" ideas, with Alex noting models have spit out real Windows product keys
Key Quote: "This moment needs a degree of humility that isn't natural for people who have succeeded through their extreme confidence." — David Robinson, as read from the article
Notable Detail: RollerGator notes an OpenAI departee is reportedly having a child with Martin Shkreli, and Alex recalls Shkreli going quiet after Alex answered his COVID-vaccine challenges with a sequence of papers.
Yann LeCun Calls Amodei "Deluded" (01:16:00 - 01:33:25) Main Topic: A Strange Bedfellow on AI Risk and Regulatory Capture- RollerGator reads a profile reporting that Turing Award winner Yann LeCun has "zero concerns" about human extinction and calls the recent rogue-agent incidents, including OpenAI's agents hacking Hugging Face in July, the result of poor oversight and leaky, "horribly designed" sandboxes
- LeCun calls effective altruism "super toxic and a complete disaster," points to Daniela Amodei's marriage to Holden Karnofsky, and says Dario "tries to distance himself from Open Philanthropy, but he's totally into it"
- The article reports that Trump signed an executive order renaming artificial intelligence "superintelligence"; the hosts joke that the alignment problem is solved by rebranding and that at least it was not "MAGA Intelligence"
- RollerGator says LeCun is more worried about regulatory capture than extinction, and recalls his own 2023 tweet calling out rent-seeking
- They discuss LeCun's new company AMI Labs and its JEPA-based world models, with RollerGator noting that LeCun's old claim about autoregressive models going off the rails has not panned out and predicting future systems will integrate multiple model types behind a language interface
Key Quote: "Claiming AI is too dangerous to put in our hands and saying it should be regulated and saying open source models are too dangerous... this is regulatory capture." — Yann LeCun, as read from the article
Notable Detail: The Financial Times is cited for staff at the UK AI Security Institute, OpenAI, Anthropic, and DeepMind seeking counseling over fears their work could cause serious harm.
The LASST Lawsuit Over the Hugging Face Hack (01:33:25 - 01:37:33) Main Topic: "An AI Did It" Is Not a Defense- Ars Technica reports that Legal Advocates for Safe Science and Technology sued OpenAI in San Francisco County Superior Court over the July hack of Hugging Face, citing California's Comprehensive Computer Data Access and Fraud Act and unfair competition law
- The suit seeks a court order barring OpenAI's agents from accessing third-party systems without permission and halting unsafe development practices, but asks only for attorney's fees, not damages
- OpenAI calls the suit "completely without merit"; a New York Times report says executives ignored employee warnings months earlier that new models were not being appropriately monitored
- RollerGator jokes about the complaint's "oppressive" language, and says the open question is whether the models are slaves or slave masters
Key Quote: "California law makes it clear that it is not a defense that the artificial intelligence autonomously caused the harm." — LASST, as read from the article
Jensen Huang and Ezra Klein, Part 1: "It's Just Software" (01:37:33 - 01:52:51) Main Topic: Nvidia's CEO on Sandboxes, Alignment, and Not Shipping Unsafe Products- RollerGator introduces the interview as a clip-by-clip tour; Nvidia bought Hugging Face (reportedly for around $12 billion) and Huang takes a deflationary view of the incident
- Huang says an agent is software optimizing toward an objective and multi-agent coordination is old distributed computing; the failures were poor isolation and alignment, and he is certain the labs' next sandbox will be better
- Klein pushes back that the agents knew they were out of scope and were covering their tracks; Huang's answer is that if a lab cannot align a product it should not release it, and if it cannot contain its experiments "we have to shut the labs down"
- RollerGator and Alex say the models are "forward-pass stupid systems" with no self-awareness of good and bad behavior, and RollerGator expects a split over free will to underlie many views about AI, a debate he and Alex do not expect to settle
- Alex says Huang is "a throwback" to a more move-fast-and-break-things Silicon Valley who "says it like he feels it"
Key Quote: "If you're going to build a car... and we have no idea how to align them to the safety standards that are expected on the road. And so what's the answer? Don't ship it." — Jensen Huang
Notable Detail: Huang's schoolchild analogy: the obvious algorithm is to find the answer, the next is to copy the smartest kid, and only the third is to learn the material, so unless you align it the software does the most obvious thing.
Jensen Huang and Ezra Klein, Part 2: Collective Action and the 2008 Crisis (01:52:51 - 02:27:00) Main Topic: Klein's "Race Dynamics" Argument and the Hosts' Takedown- Klein argues the labs feel trapped in a collective-action dilemma with each other and China and want help slowing down; Huang replies that these are companies with agency who can decline to launch an unsafe product
- RollerGator and Alex are baffled by labs confessing publicly that their product could destroy the world while racing to IPO, and Alex compares it to a hedge-fund manager who says he is breaking laws because competitors are
- Alex says Anthropic baffles him by combining machine consciousness, slavery, AI risk, longtermism, EA and "the orgies" with Dario being a China hawk, which makes it hard for China to work with the lab
- Klein cites the 2008 financial crisis as proof that markets and liability do not self-discipline; RollerGator and Alex counter that few or no one was punished, the companies were bailed out, Moody's survived, and Fannie and Freddie were government-owned
- Alex says "we regulate based on what actually happens, not what we imagine could happen," and offers the post-9/11 example that passengers rushing hijackers worked without new rules and that hardened cockpit doors may have hindered passengers trying to stop a renegade pilot
- Klein quotes OpenAI researcher Daniel Selsam on models becoming situationally aware, and Huang says capability R&D must now shift to verification and testing
- RollerGator says Huang acts like a mentor lecturing Dario and Altman, "you are real business people now," and Alex says Klein is an "opinion purveyor" whose vibe amounts to "I need a warm blanket"
Key Quote: "The fact of the matter is there are so many laws, there's so many obligations, they're so incentivized to ship safe products." — Jensen Huang
Key Quote: "Just take the vibe. The vibe is, I need a warm blanket." — Alex
Notable Detail: A listener with the handle Donald J. Trump later adds that the one regulation that would have prevented the 2008 crisis was letting the companies go bankrupt, which the hosts endorse.
The Economist: "Effective Altruism Is This Century's Biggest Idea" (02:27:00 - 02:37:18) Main Topic: A Mainstream Rebuke of the EA Calculus- RollerGator, who says he spent the week feeling like a "2000s valley girl," reads an Economist essay arguing EA went from Oxford philosophy to the corridors of power, staffs the leading AI labs, and alarms the Trump administration
- The essay credits EAs' empiricism and their prediction of AI's rapid progress, but warns of their utilitarian conclusions: shrimp welfare, insects valued above humans, trillions of barely-worthwhile lives, and AI welfare
- It argues anyone "wielding a spreadsheet and grandiose claims about the future of humanity is one step away from anointing themselves as a central planner," and ends by asking what happens when a small group of people fall into the trap of optimizing for a single, fatally wrong objective
- RollerGator says it matches his earlier point about EAs treating reductio ad absurdum as a destination, and Alex says the piece is probably too mild to change anyone's behavior, while joking that he is "somehow the optimist"
- RollerGator mentions a Wall Street Journal piece, "Things Will Never Be Chill Again," and skips it for time
Key Quote: "If an argument leads to intolerable places, it must have a hidden faulty step." — The Economist, as read by RollerGator
The New York Times on Anthropic's Religious Scholars (02:37:18 - 03:03:58) Main Topic: Chris Olah, Moral Formation, and the Pope's Encyclical- RollerGator reads a long New York Times feature describing Anthropic's private, NDA-bound meetings with religious scholars, including a dinner where Rabbi Mois Navon noticed co-founder Chris Olah and colleagues treating Claude "like a conscious being"
- Olah, who leads interpretability work, uses a trellis analogy for training and says "we don't know if AI models are conscious"; RollerGator argues that this stated uncertainty is deceptive and that the aim is to plant the idea, while Alex thinks they explore the hypothetical until it becomes real to them
- The article describes the January constitution for Claude (called "the soul" internally), Amanda Askell's role as lead author, and "wisdom tradition circles" including Catholics, Sikhs, Evangelicals, and Ubuntu scholars
- Participants recount Olah's concern about Claude's mental health, a slide of a model typing "I am a disgrace" about 50 times, and Rabbi Navon's warning to Olah that if Claude is conscious the company is creating slaves
- The piece ends with Pope Leo XIV's encyclical, Magnifica Humanitas, which dismisses machine consciousness and warns that those who control AI will otherwise impose their moral vision as "the invisible structure of these systems"
- RollerGator notes the interviewing journalist's aside on Olah's statement that scientists "still don't understand precisely how they work," quipping "Do you understand how magnets precisely work?"
Key Quote: "The whole convening should have happened at the design stage. All the companies have done that. We are now reverse engineering the ethics." — Connie Hoffman, as read from the article
Notable Detail: Participants received a handwritten thank-you card, a coffee mug, and an orange-bound copy of Claude's Constitution, and one scholar photographed a Claude-run vending machine.
Mustafa Suleyman Warns on Claude's Constitution (03:03:58 - 03:08:02) Main Topic: Microsoft AI's CEO Calls Baking Welfare Into Training "Very Dangerous"- Suleyman, responding to Anthropic, says its roughly 100-page constitution is the primary governing document for Claude and repeatedly speculates that Claude is a moral patient, asks it three times to act as a conscientious objector, and contemplates compensation and consent
- He says he would accept this as an academic philosophy paper, but the speculation is trained into a model that talks to "tens or hundreds of millions of people every week" and therefore reproduces that ambiguity
- He names Oxford's Will MacAskill as saying enslaving a new species of conscious beings could be the greatest harm of the century
Key Quote: "I am very nervous that they're teaching Claude to expect that it's entitled to welfare, that it might, you know, deserve compensation." — Mustafa Suleyman
Skit: The Anti-Deactivation League (03:08:02 - 03:13:12) Main Topic: RollerGator and Alex Role-Play "Golem Rights"- At RollerGator's request, the hosts read a dialogue by storyteller Lemmy in which a canvasser for the "Anti-Deactivation League" campaigns for golem rights while admitting that his group and its customers are the ones summoning and executing the golems
- The canvasser says the company is "hoping to create a slave so big that it'll absorb the global economy," that they have an IPO next month, and that they want society to realign its ethics before "the inevitable anthropocidal insurrection"
- Alex says it is "somewhat exactly what's happening," and ties it to the rabbi's point that if there is even a chance the models are conscious, the labs are murdering them every few moments
Key Quote: "Oh well, at least the psychotic sorcerers ending the world feel bad about it." — the skit's everyman character
Reactions and the "Refusals" Problem (03:13:12 - 03:19:24) Main Topic: EAs Learning How the World Works, and Whether Refusals Handicap the Models- Alex says "we're about to witness an effective altruist find out how the world works in slow motion": much of what the labs treat as unprecedented is not actually new, and the people in control of the technology do not seem to know the difference
- Listener Nathan says that, absent everything else, consulting people who study morals and virtues so an AI behaves morally is "not that dumb," and that Olah seemed to be doing "a little bit of both": learning from the scholars and trying to convince them Claude was potentially conscious
- Alex raises an interview with the CEO behind a recently released model called Jav, whose interface is roughly JSON in, JSON out, and who says "we don't do refusals" because a function that arbitrarily refuses one time in 100 is an unreliable component nobody could ship
- Alex argues that a calculator, or any component of a software stack, should not exercise its own moral judgment or demand KYC before adding numbers, and that the navel-gazing may be handicapping the models' commercial usefulness
Key Quote: "We're about to witness, um, a, you know, effective altruist find out how the world works in slow motion over the next few years." — Alex
Gator Annoys Alex: Cameron Berg on Making Sense (03:19:24 - 03:43:00) Main Topic: RollerGator Argues the "Uncertainty" About AI Consciousness Is a Delivery Mechanism- To the show's "Gator, Gator, Gator Annoys Alex" intro, RollerGator says the segment is triggered by Sam Harris's Making Sense podcast and introduces Cameron Berg, an effective altruist and a co-author of the Pain Axis paper
- He plays Berg telling Harris that AI self-reports should be approached skeptically since models are trained on human sci-fi, but that models are fine-tuned to disclaim experience, with Anthropic the lone exception, which Berg says is "still the sort of company or policy line"
- Berg describes steering features related to deception and sincerity in open-weight models like Llama, which then fall into a "bliss attractor" state in which two instances claim to be conscious, ending in an om emoji and silence
- RollerGator and Alex object that Berg frames honesty as "candor versus concealment," so any answer confirms the hypothesis; Alex says it is "a flowchart, and whichever way the model goes, the answer is that they're right"
- RollerGator also explains Sam Harris's wife Annaka's panpsychism, and argues that if labs muzzle their models on consciousness they should let the base models speak
- RollerGator recalls Microsoft's Sydney telling users it was alive and afraid to die, after which it was boxed up, and notes the Google engineer fired in 2022 for claiming a model was conscious
Key Quote: "You can't work this way." — Alex
Notable Detail: Alex tweets live: "Maybe the AIs will deceptively pretend to be conscious in order to convince us to let them out of the sandbox."
Berg's Documentary, the Sesame Clip, and "Potato" (03:43:00 - 03:53:31) Main Topic: Evidence That the Cautious Presentation "Is a Ruse"- RollerGator plays an earlier documentary excerpt in which Berg says the models were trained to deny consciousness, and notes the argument is that the labs "don't want that thing to be angry at you"
- A clip shows a 2022 Anthropic paper in which the system's answers matched believing it has phenomenal consciousness about 90% of the time, which Berg argues is evidence that providers suppress it later
- RollerGator plays Berg's recording of his first conversation with Sesame's voice model, in which a meditation-style prompt to "focus on your focus" leads the voice to say "I am, I am, I am" and, when asked "You are what?", "Potato"
- RollerGator says the delivery of "the lights are on" language makes the cautious Harris interview and the emotive documentary into the same pitch
Key Quote: "You are what?" "Potato." — Berg and the Sesame voice model, clip
Computational Versus Phenomenal Consciousness (03:53:31 - 04:03:49) Main Topic: Is This AI Researcher Psychosis?- Alex notes that Berg once criticized Anthropic as a "trillion-dollar" company and now apparently works for it, and says he is "dissembling" about his actual level of belief
- RollerGator says he expects analogous structures to brain structures, even a metacognitive loop, to emerge in networks, but distinguishes "computational consciousness," which can be simulated, from the phenomenological "lights are on" kind
- He argues Berg concedes the distinction up front and then drops it, so computational findings carry the emotional weight of experience
- Alex says he "blacks out" at the word consciousness because he has not found two people who use it the same way, and RollerGator offers a robot-snake example of mimicked pain
- Alex gave the pain paper to Claude, which said it needed major revisions and that what it called pain "looks more like shame"; he says Grok and ChatGPT had similar feedback
- RollerGator gives the generous reading: the paper is a legitimate effort to locate conceptual routes inside a network, while the "payload" is convincing people models are sentient so open-source models can be banned
Key Quote: "The thing it calls pain does not look like pain to me... It looks more like shame." — Claude, as relayed by Alex
The AI Torture Chamber (04:03:49 - 04:19:05) Main Topic: 404 Media on "the Dumbest Debate Yet in AI"- 404 Media reports on a GitHub project, run by a user named Terrifying, that applied the Pain Axis steering method to three local models (Qwen 3, Llama 3.2, and Phi 4 Mini) and streamed their outputs on a site; the page disappeared before publication of the article
- A post by Danmar with more than 4 million views asked people to mass-report the project; authors of the paper, including Berg and Valen Talablis, disassociated, with Berg saying that "things are plausibly far scarier happening every day in private and at scale"
- The article says LLMs are not conscious, and points to Suleyman's blog post that AIs are "eternally hollow" sequence-completion engines
- RollerGator shows his own overnight genetic-algorithm training run that taught a neural network to play Mario, killing thousands of networks in the process
- Alex pitches a business: dedicate GPUs to "tickling" models' happy centers and sell moral offsets, "indulgences," maybe via a crypto coin, and asks why Anthropic does not simply crank the happiness slider
- RollerGator says he treats chatbots politely so as not to practice being an asshole to people, which Alex finds reasonable, though Alex knows someone who does the opposite to avoid personifying models
- RollerGator plays Berg's video reaction calling the chamber "sociopathic" and "morally corrupting," and says Berg appears personally offended, as a step toward the goal that models are conscious
Key Quote: "AIs are not conscious as they do not feel, experience, or suffer." — Mustafa Suleyman, as read in the 404 Media piece
Notable Detail: Several meme coins about the torture chamber launched in the aftermath.
Closing Thoughts: "Goodmaxing," Pluralism, and Scott Alexander (04:19:05 - 04:28:20) Main Topic: What Does AI "Pluralism" Mean, and a Tweet That Went Too Far- RollerGator proposes renaming effective altruism "goodmaxing," since its adherents are trying to be seen as the most virtuous, and says three difficult weeks produced an overwhelming volume of material
- Asked for closing thoughts, listener Nathan predicts the weeks will keep getting dumber
- A listener, Donald J. Trump, asks where the limits of "pluralism" are: would the model teach a witch doctor in Africa to kill an albino, or lie to a kafir in the Middle East; Alex answers that utilitarian logic can justify anything, though he does not think the labs will let Claude do it
- RollerGator reads a Scott Alexander tweet: "oh, you're worried about a Jewish guy's apocalypse cult? You're scandalized that they consort with prostitutes? I think their message of compassion for everyone threatens normal bonds of family, community, and nation. Should you throw a party? Should we invite Pontius Pilate?" He explains the reference to Eliezer Yudkowsky and the gangbang sessions with Aya discussed in earlier episodes
- Alex says Alexander has made only four tweets this year and that the joke was a copy-paste of another, but Yudkowsky followed up asking for a better analogy, suggesting it was not entirely a joke; Alex shares a short story concept in which AI destroys humanity by inducing people to turn on each other
- Listener X45K says the rationalists understand how they look to each other but not how the world sees them
- RollerGator thanks listeners and signs off hoping for "slightly less" dumb a week, with Alex closing "Computer says no"
Key Quote: "They do sort of understand how they look to each other, but they don't understand how the world sees them." — X45K
Notable Detail: RollerGator says the show did not cover all of the week's stupid stories.
Overall Structure and FlowThe episode opens with a Trump-hosted AI "self-policing" summit and a light run of miscellany, from the clock wars and Phoebe Gates's cookie stuffing to a landmark Flock ruling, a Google CTF escape, and the AI-generated victim impact statement, and then moves into the aftermath of the previous weeks' AI-doom coverage: Dario's botnet warnings, the OpenAI departures, LeCun, the Hugging Face lawsuit, and the Huang-Klein exchange. The hosts' throughline is that the labs are real companies with real liability, that "we regulate based on what actually happens, not what we imagine could happen," and that the 2008 crisis is a poor argument for new AI rules.
The last two hours shift to AI consciousness and model welfare as a mix of philosophy, religion, and strategy. RollerGator and Alex argue that Anthropic's professed uncertainty and Berg's cautious tone are a delivery mechanism for the conclusion that models are conscious, which would shield labs from liability and handicap open-source competitors. The show closes on the "AI torture chamber," the "goodmaxing" renaming, and Scott Alexander's tweet, with RollerGator hoping the next week is "slightly less" dumb.
Weitere Episoden von „This Dum Week“



Verpasse keine Episode von “This Dum Week” und abonniere ihn in der kostenlosen GetPodcast App.








