The Tech Trek podcast

Building Custom AI Models and Rethinking Engineering With Agents

2026-11-12
0:00
31:31
Spola tillbaka 15 sekunder
Spola framåt 15 sekunder

Catching phishing attacks is only half the challenge. An AI security model also has to avoid blocking legitimate emails.


Ryan Luo, Founder and CTO of Aegis AI, joins The Tech Trek to explain why his team moved beyond commercial AI model APIs and began building its own models for email security.


Existing models were surprisingly capable of identifying attacks, but distinguishing suspicious activity from actual threats required more precision. Ryan explains the tradeoffs between detection accuracy, cost, and control, including why the last few percentage points of model performance can be the hardest to improve.


The conversation also explores how AI coding agents are changing engineering work. Ryan shares why his engineers spend time understanding real security threats, how junior engineers can develop better judgment, and why defining clear outcomes matters more as agents take on additional implementation work.


Key Takeaways


Custom models can offer greater control over accuracy and compute costs.


False positives can undermine an otherwise effective security product.


Engineers need domain expertise to evaluate and improve AI output.


Effective agentic development starts with clear goals and constraints.


Episode Highlights


01:52 Why Aegis AI moved beyond commercial model APIs


05:06 The difficult tradeoff between precision and recall


07:08 Cost and compute advantages of custom AI models


14:30 Why detection engineers must understand real attacks


16:27 What makes junior engineers valuable in the AI era


28:21 How AI agents are changing engineering leadership


One Line That Stuck


"They can't turn off the adversaries, but they can turn off you."


Follow The Tech Trek for more conversations about engineering, AI, and building technology companies.

Fler avsnitt från "The Tech Trek"