AI Security Table podcast

You Don't Trust AI. So Why Are You Shipping Its Code?

0:00
50:04
Reculer de 15 secondes
Avancer de 15 secondes

Sam Altman told a Stanford audience he no longer thinks we can just patch all the bugs, and the AI Security Table can't agree on whether that is news. Chris argues a swarm of subagents can tear through a repo and drive defects way down, while Matt counters that every system ships with defects and always will, so the real limit is cost, now measured in tokens. Izar warns that tokens are just the new regex, the latest silver bullet in a long line of them. Then the hosts dig into Anthropic's work using Claude to write Rocq proofs for 123 open source libraries, and argue over what a proof actually guarantees, who checks a model that writes both the patch and the proof, and whether compounded mistrust ever adds up to trust. Izar gets the last word: LLMs are not compilers, so stop treating them like one.

Mentioned in this Episode:
➜ Sam Altman: 'I No Longer Think We're Gonna Be Able to Just Patch All the Bugs'
➜ LLMs are making formal software verification feasible at a much larger scale
➜ seL4
➜ The Rocq Prover
➜ OSS-Fuzz

Chapters:
00:00:00 - Cold Open: Privacy Thought of the Day
00:01:35 - Article Intro: Altman Can't Patch All the Bugs
00:02:22 - Izar Reads the Altman Quote
00:03:07 - How Many Bugs Are in Your Software?
00:04:07 - Chris's Case: 200 Subagents on One Repo
00:05:49 - Matt's Case: We Always Ship With Defects
00:06:54 - The Disposable Software Argument
00:08:15 - Nobody Saw the Exponential
00:10:12 - The Token Cost of Hidden Criticals
00:11:55 - Izar's Rebuttal: Tokens Are the New Regex
00:13:33 - Defenders Finally Have an Advantage
00:15:16 - The Knowledge Pyramid
00:16:57 - We Only Talk About Superintelligence
00:18:16 - Article Intro: AI and Formal Verification
00:19:53 - Izar: Proofs Nobody Can Read
00:20:50 - Matt: Start With Something Small
00:22:01 - The Proof Gets Bigger Than the Code
00:25:12 - Correctness Is Not Security
00:26:53 - Verified Blocks, Untrusted Integration
00:27:57 - Verifying the seL4 Microkernel
00:29:02 - What Was Actually Verified?
00:30:47 - Fuzzing and the Next Byte
00:31:56 - The Article's Limitations
00:33:25 - Who Is Actually Doing the Proving?
00:34:19 - 123 Libraries and 600,000 Line Proofs
00:35:57 - How Is My Morning Any Better?
00:36:42 - Memory Safe Languages Already Exist
00:37:43 - Should Claude Write Its Own Proofs?
00:39:04 - One Frontier Model Checks Another
00:39:52 - Does Compounded Mistrust Equal Trust?
00:41:24 - Use AI With Enough Mistrust
00:42:17 - How Much AI Code Did You Review?
00:44:07 - Back to Threat Modeling
00:44:37 - Feeding Knowledge Back to Agents
00:46:25 - Secure Coding Standards Never Worked
00:48:11 - Closing Statements: LLMs Are Not Compilers
00:48:40 - Outro

Follow AI Security Table:

➜ Home: https://securitytable.ai/

➜ X: https://x.com/SecTablePodcast

➜ LinkedIn: https://www.linkedin.com/company/ai-security-table/

➜ YouTube: https://www.youtube.com/@AISecurityTable

D'autres épisodes de "AI Security Table"