YAAP (Yet Another AI Podcast) podcast

The Model Routing Paradigm That Changed My Mind

0:00
21:06
Recuar 15 segundos
Avançar 15 segundos

Model routing sounded solved: cheap stuff to the small model, hard stuff to the big one. Turns out that's how you blow your budget. Tomás Hernando Kofman, founder of Not Diamond, on why naive routing breaks your KV cache, why routing at scale is really a reinforcement learning problem, and why cheaper models mean you spend more, not less.

Mais episódios de "YAAP (Yet Another AI Podcast)"