Models & Agents podkast

Ep 228: Ten open MoE models expose routing choices that swing sparsity from 4x to 128x and change…

0:00
9:26
Do tyłu o 15 sekund
Do przodu o 15 sekund
Models & Agents Ten open MoE models expose routing choices that swing sparsity from 4x to 128x and change which hardware setups actually fit. What You Need to Know: A verified table from model configs shows DeepSeek-V4-Pro using 384 experts with sqrtsoftplus gating and hash routing in three layers, while Llama 4 Maverick keeps its gating method undisclosed. ... Sources: marktechpost.com · reddit.com · towardsdatascience.com · the-decoder.com · nytimes.com · thechenabtimes.com · karpathy.ai · casrai.org Chapters: 0:00 Introduction 0:19 Top Story 1:30 GRFNet, PyTorch model for multichannel time-series classification [P] 2:12 Timestral, t0, Tabby, and Morpheus-2.0 Compared on GIFT-Eval 2:36 Locally trained VLA model with minimal attention based vision encoder. [p] 3:46 Law Firms Have Malpractice Insurance. Should Their A.I. Agents? 4:03 Agent & Tool Developments 4:47 TristanTube: YouTube viewer from Tristan's top channels 5:20 Also Today 6:32 Things to Try 7:03 On the Horizon 8:05 Closing AI Disclosure: This podcast is curated by Patrick but uses AI-generated voice synthesis for audio production. 🎬 Watch on YouTube (public from 8:15 AM ET): https://www.youtube.com/watch?v=sSe-P7Qr27E If this episode was useful, a rating or a short review on Apple Podcasts or Spotify is how the next listener finds the show — and following it in your app means the next episode is there when you are. 📝 Full show notes, transcript & sources: read the episode page 📬 Get the sources and notes by email, free: join the newsletter 🌐 Part of the Nerra Network — explore every show at nerranetwork.com.

Więcej odcinków z kanału "Models & Agents"