The Software Factory: Don’t Review the Code, Verify It with Justin McCarthy & James Cham
Why the future of software development means stopping reading code and spending 100x more effort verifying it than generating it.In this episode of AI Radicals, host Satyen Sangani talks with Justin McCarthy, Diffusion, and James Cham, Bloomberg Beta, about the concept of the "software factory": using LLMs in fully autonomous loops to produce reliable software at a scale and speed that makes human code review obsolete.Justin and James unpack the core mechanics of a software factory—why the factory metaphor matters (reliable outputs, low variance), why the key engine is the loop, and why the radical goal isn't putting a human in the loop but taking the human out entirely. They explain why verification should consume 100x more tokens than generation, why developers need to stop reading AI-generated code the way they never read compiler output, and why the PR interface should show diffs of NPS scores and P&L impact, not lines of code. They also dig into where this approach works best versus where it doesn't, how small teams are already achieving 100 to 1,000x productivity gains, and why the developers who thrive in this new world may not be who you'd expect."The moment you actually automated an entire loop, you can suddenly get a level of productivity and reliability that, to be honest, we in software development just don't really think about."Listen to this episode to learn:Why fully autonomous loops—not human-in-the-loop systems—are the key to reliable, high-scale AI software generationHow to build verification pipelines that use screenshots, voice synthesis, formal methods, and synthetic data to validate code before a human ever sees itWhy some developers become 1,000x more productive while others "open a bakery"—and how organizations should structure themselves for the power-law future--------“ There are folks that ask to get off the bus when faced with the reality that you really do need to work differently, and your level of intensity, the models do demand a higher level of intensity. You still have to get eight hours of sleep. You have to restore your decision-making budget every night. You have to take care of yourself. You can't be in AI psychosis. You can't be in the mania phase. But once you get through that phase, every minute of your day matters.” – Justin McCarthy “ These tools are jagged in the sense that they're very good at some things and then very bad at things that seem very similar to the thing that they're very good at. And so that feeling and that nuance, there's things that can only be understood if people spend a bunch of time playing with it. And so the desire for easy answers or for frameworks or whatever, I just keep on trying to tell people, "No, no, no. There aren't easy answers yet." The only easy answer is to just keep on playing with it, which I have to admit sometimes goes against, I think, the current zeitgeist for most of corporate America, where they're trying very hard to tame it and to make it seem like it makes sense. But the way they want it to make sense is thinking from Q3 of 2025. And to me, that's the biggest danger. And if I imagine a way that all this would go badly is if we were stuck in software development methodologies from Q3 of 2025, which I have to admit many organizations are stuck at.” – James Cham--------Time Stamps[00:08] What is a software factory?[10:08] Who decides how AI-generated software gets verified?[14:58] How do you start building a software factory?[19:39] What kinds of problems can a software factory handle, and where does it fail?[26:09] How do engineering leaders react to the idea of never reading code?[30:36] Should you cap AI token spending per developer?[36:27] Will today's 10x engineers be the ones who thrive with AI?[38:58] How do you get past AI "haze" and decide where your attention goes?[42:35] What are the different ways to verify AI-built software?[46:10] What role does data play in verifying AI systems?--------SponsorThis podcast is presented by Alation.Learn more:* Subscribe to the newsletter: https://caspianstudios71626.activehosted.com/f/73* Alation’s LinkedIn Profile: https://www.linkedin.com/company/alation/* Satyen’s LinkedIn Profile: https://www.linkedin.com/in/ssangani/--------LinksConnect with Justin McCarthy on LinkedIn: https://www.linkedin.com/in/justinmccarthy/Connect with James Cham on LinkedIn: https://www.linkedin.com/in/jcham/Learn more about Diffusion: https://diffusion.io/Learn more about Bloomberg Beta: https://www.bloombergbeta.com/ Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.