
Small Models, Specific Jobs: ScaleDown on Building Efficient Voice AI
20/10/2026
0:00
1:15:14
In this episode of the Convo AI World Podcast, Hermes Frangoudis speaks with Neal Patel, co-founder of ScaleDown, about choosing models for the specific jobs inside an AI application. Neal explains how his work forecasting data center demand led him to focus on token efficiency. At ScaleDown, that means building small language models for tasks such as classification, extraction, and summarization. He describes how the team combines existing model components with task-specific neural heads, and where these specialists can work alongside a larger model that handles planning and conversation. For voice AI builders, the discussion covers routing, parallel subagents, conversation history, and post-call analysis. Neal explains the difference between query-aware compression and a generic summary, and why preserving the information needed for an answer matters more than simply shrinking a prompt. He also explores using classifiers for evaluation, where consistency can matter as much as speed. The conversation closes with ScaleDown's integration tools and roadmap, plus Neal's view of how model selection could become more automated. Throughout, he makes a useful distinction: specialized models may reduce variability on a defined task, but they are not fully deterministic.
Check out video episodes and subscribe to the Convo AI Newsletter at podcast.convoai.world
Mais episódios de "Convo AI World"



Não percas um episódio de “Convo AI World” e subscrevê-lo na aplicação GetPodcast.








