
Catching phishing attacks is only half the challenge. An AI security model also has to avoid blocking legitimate emails.
Ryan Luo, Founder and CTO of Aegis AI, joins The Tech Trek to explain why his team moved beyond commercial AI model APIs and began building its own models for email security.
Existing models were surprisingly capable of identifying attacks, but distinguishing suspicious activity from actual threats required more precision. Ryan explains the tradeoffs between detection accuracy, cost, and control, including why the last few percentage points of model performance can be the hardest to improve.
The conversation also explores how AI coding agents are changing engineering work. Ryan shares why his engineers spend time understanding real security threats, how junior engineers can develop better judgment, and why defining clear outcomes matters more as agents take on additional implementation work.
Key Takeaways
Custom models can offer greater control over accuracy and compute costs.
False positives can undermine an otherwise effective security product.
Engineers need domain expertise to evaluate and improve AI output.
Effective agentic development starts with clear goals and constraints.
Episode Highlights
01:52 Why Aegis AI moved beyond commercial model APIs
05:06 The difficult tradeoff between precision and recall
07:08 Cost and compute advantages of custom AI models
14:30 Why detection engineers must understand real attacks
16:27 What makes junior engineers valuable in the AI era
28:21 How AI agents are changing engineering leadership
One Line That Stuck
"They can't turn off the adversaries, but they can turn off you."
Follow The Tech Trek for more conversations about engineering, AI, and building technology companies.
Więcej odcinków z kanału "The Tech Trek"



Nie przegap odcinka z kanału “The Tech Trek”! Subskrybuj bezpłatnie w aplikacji GetPodcast.








