
0:00
21:06
Model routing sounded solved: cheap stuff to the small model, hard stuff to the big one. Turns out that's how you blow your budget. Tomás Hernando Kofman, founder of Not Diamond, on why naive routing breaks your KV cache, why routing at scale is really a reinforcement learning problem, and why cheaper models mean you spend more, not less.
More episodes from "YAAP (Yet Another AI Podcast)"



Don't miss an episode of “YAAP (Yet Another AI Podcast)” and subscribe to it in the GetPodcast app.








