YAAP (Yet Another AI Podcast) podcast

The Model Routing Paradigm That Changed My Mind

0:00
21:06
Rewind 15 seconds
Fast Forward 15 seconds

Model routing sounded solved: cheap stuff to the small model, hard stuff to the big one. Turns out that's how you blow your budget. Tomás Hernando Kofman, founder of Not Diamond, on why naive routing breaks your KV cache, why routing at scale is really a reinforcement learning problem, and why cheaper models mean you spend more, not less.

More episodes from "YAAP (Yet Another AI Podcast)"