
Tuhin Srivastava is the co-founder and CEO of Baseten, a company building infrastructure for training and inference. When an AI model runs in production (responding to a user, powering an app, making a decision), Baseten is one of the companies that makes that happen reliably, quickly, and at scale. The company counts Abridge, Cursor, and OpenEvidence among its customers, spans 20 clouds and 90 regions, and was most recently valued at $13 billion following a $1.5 billion funding round.
Tuhin sees inference as AI’s “final market”: as AI spreads through the economy, the cost of running intelligence grows with it. Baseten’s breakout began when it discarded three years of other product work in roughly six weeks to focus on an inference engine it had been giving away.
In this conversation, we explore why inference has become one of the most consequential and least understood markets in AI, what it actually takes to run a model in production at scale, and why the compute squeeze may be the single largest constraint on AI growth right now. We also examine the customer journey from closed models to custom fine-tuned deployments, the concept of owned intelligence, and why Tuhin believes luck accounts for roughly 90% of startup success, while insisting that the 10% skill is still indispensable.
—
Tuhin’s bookshelf
When I asked Tuhin what book he’d assign to everyone, he named Breakneck. He also pointed to Danny Meyer’s book about Union Square Cafe, Setting the Table.
—
Every timestamp
(00:00) Intro
(02:06) What Baseten is building and how it began
(04:47) Finding balance in a fast-growing startup
(06:45) Why inference is the “final market”
(08:34) Tuhin’s path to founding Baseten
(12:06) What Australia gets right
(13:43) The opportunity Baseten found in inference
(20:34) How customers use Baseten
(29:00) Managing compute across clouds
(30:40) The compute crunch
(32:11) Financing inference at scale
(35:40) Why inference is hard to build in-house
(36:41) Who Baseten wants to hire
(39:46) Hard work and skill vs. luck
(42:20) Final meditations
—
Resources
- Baseten: https://www.baseten.co
- Sierra: https://sierra.ai
- Coinbase: https://www.coinbase.com
- No Priors Ep 56 | With Baseten CEO and Co-Founder Tuhin Srivastava: https://www.youtube.com/watch?v=oe3OSlsf4YA
- Etched: https://www.etched.com
- Cerebras: https://www.cerebras.ai
- NVIDIA Groq 3 LPX: https://www.nvidia.com/en-us/data-center/lpx
- Unreasonable Hospitality: The Remarkable Power of Giving People More Than They Expect: https://www.amazon.com/Unreasonable-Hospitality-Remarkable-Giving-People/dp/0593418573
- Blackbird VC: https://www.blackbird.vc
- Greylock: https://greylock.com
- Conviction: https://www.conviction.com
—
Where to find Tuhin
LinkedIn: https://www.linkedin.com/in/tuhin-srivastava
—
Production and marketing by penname.co. For inquiries about sponsoring the podcast, email [email protected].
Flere episoder fra "The Generalist"



Gå ikke glip af nogen episoder af “The Generalist” - abonnér på podcasten med gratisapp GetPodcast.








