
Ep 228: Ten open MoE models expose routing choices that swing sparsity from 4x to 128x and change…
8.11.2026
0:00
9:26
Models & Agents
Ten open MoE models expose routing choices that swing sparsity from 4x to 128x and change which hardware setups actually fit.
What You Need to Know: A verified table from model configs shows DeepSeek-V4-Pro using 384 experts with sqrtsoftplus gating and hash routing in three layers, while Llama 4 Maverick keeps its gating method undisclosed. ...
Sources: marktechpost.com · reddit.com · towardsdatascience.com · the-decoder.com · nytimes.com · thechenabtimes.com · karpathy.ai · casrai.org
Chapters:
0:00 Introduction
0:19 Top Story
1:30 GRFNet, PyTorch model for multichannel time-series classification [P]
2:12 Timestral, t0, Tabby, and Morpheus-2.0 Compared on GIFT-Eval
2:36 Locally trained VLA model with minimal attention based vision encoder. [p]
3:46 Law Firms Have Malpractice Insurance. Should Their A.I. Agents?
4:03 Agent & Tool Developments
4:47 TristanTube: YouTube viewer from Tristan's top channels
5:20 Also Today
6:32 Things to Try
7:03 On the Horizon
8:05 Closing
AI Disclosure: This podcast is curated by Patrick but uses AI-generated voice synthesis for audio production.
🎬 Watch on YouTube (public from 8:15 AM ET): https://www.youtube.com/watch?v=sSe-P7Qr27E
If this episode was useful, a rating or a short review on Apple Podcasts or Spotify is how the next listener finds the show — and following it in your app means the next episode is there when you are.
📝 Full show notes, transcript & sources: read the episode page
📬 Get the sources and notes by email, free: join the newsletter
🌐 Part of the Nerra Network — explore every show at nerranetwork.com.
Więcej odcinków z kanału "Models & Agents"



Nie przegap odcinka z kanału “Models & Agents”! Subskrybuj bezpłatnie w aplikacji GetPodcast.








