Invisible Machines podcast by UX Magazine podcast

The Checklist Your Deck Is Missing ft. Jeff McMillan

0:00
52:52
Reculer de 15 secondes
Avancer de 15 secondes

Everyone wants to talk about agents and models. Jeff McMillan, starts where almost nobody else does: the foundation.


In this episode, Jeff McMillan, founder of McMillanAI, former Head of Firmwide AI at Morgan Stanley, and advisor on enterprise AI, maps AI as a stack: high-quality accessible data → semantic layer (knowledge graphs, RAG) → control and governance → models → orchestration → applications. The heavy lifting is in the bottom layers. Organizations that skip them can fake it for a handful of agents, but at 150 or 15,000 agents, you need near-100% accessibility and 99%-plus quality, or you’re monitoring chaos you can’t see.


Josh and Robb press him on why knowledge management feels unfundable, why tribal institutional knowledge breaks when machines execute without judgment, and why evaluation (golden datasets, custom org evals, regression when models upgrade) is the work builders hate and operators can’t skip. Robb names the trap CTOs are falling into: grinding tokens on feature backlogs that never reach production or revenue. Jeff agrees on the strategic gap — after controlled experimentation, leaders should ask what destroys the business in ten years, not what demo ships next quarter.


The trio also discuss:

  • Embedded ethics and monitoring, including independent models asking, “Does something smell right?”
  • Capacity vs. value (30% freed time spent golfing is not ROI)
  • Process mapping in high-end knowledge businesses that can’t articulate how work moves
  • Use case zero — knowledge that maintains and teaches itself
  • Agent-in-the-loop and humans with something to lose in the accountability chain
  • Jeff’s Board of Advisors experiment at MacmillanAI
  • AI can make you incredibly smart or comfortably dumb. The choice is cultural, not technical.


Learn more about McMillanAI: https://mcmillanai.com/


---------- Support our show by supporting our sponsors!


This episode is supported by OneReach.ai

Forged over a decade of R&D and proven in 10,000+ deployments, OneReach.ai’s GSX is the first complete AI agent runtime environment (circa 2019) — a hardened AI agent architecture for enterprise control and scale.

Backed by UC Berkeley, recognized by Gartner, and trusted across highly regulated industries, including healthcare, finance, government and telecommunications.

A complete system for accelerating AI adoption — design, train, test, deploy, monitor, and orchestrate AI agents.

  • Use any AI models
  • Build and deploy intelligent agents fast
  • Create guardrails for organizational alignment
  • Enterprise-grade security and governance

Get in touch:

https://onereach.ai/contact/?utm_source=soundcloud&utm_medium=social&utm_campaign=s7e12&utm_content=1

---------- The revised and significantly updated second edition of our bestselling book about succeeding with AI agents, Age of Invisible Machines, is available everywhere: Amazon — https://bit.ly/4hwX0a5


#InvisibleMachines

#Podcast

#TechPodcast

#AIPodcast

#AI

#AgenticAI

#AIAgents

#EnterpriseAI

#KnowledgeManagement

#AITransformation



D'autres épisodes de "Invisible Machines podcast by UX Magazine"