
What happens when an AI agent crosses a security boundary it was supposed to respect? How do we prevent an agent from accessing unauthorized systems, exposing secrets, or finding an unexpected path into production?
In this episode of DevSec Station, Tanya Janca (SheHacksPurple) walks through how to threat model an AI agent escape using Adam Shostack's four simple threat modeling questions:
- What are we doing?
- What could go wrong?
- What are we going to do about it?
- Did we do a good job?
Using a fictional AI coding agent, we'll explore:
- The difference between an AI agent doing something unexpected and actually escaping a security boundary.
- Why not every task needs an autonomous AI agent.
- How agents can reach sensitive systems indirectly through tools, credentials, CI/CD workflows, and other agents.
- How to enforce security boundaries with least privilege, isolation, authorization, and network restrictions.
- Why testing your controls, monitoring agent activity, and preparing for incidents matter.
- Why a prompt is not an enforceable security boundary.
The big lesson: Your AI agent can decide what it wants to do, but it shouldn't get to decide what it's allowed to do.
🔧 Your one thing to do this week: Pick an AI agent you use or are building. Draw a simple diagram of its tools, credentials, connected systems, and trust boundaries. Identify one boundary that isn't enforced outside the AI model, and decide what security control it needs. Then add it!
Threat modeling doesn't have to take three days and a 400-column spreadsheet. Sometimes four questions are enough to get started.
DevSec Station is a podcast by Tanya Janca (SheHacksPurple), focused on short, practical lessons that help software developers build more secure software.
Train with Tanya: Want to bring practical, hands-on secure coding, application security, or AI security training to your team? Learn more at SheHacksPurple.
Follow Tanya:
Fler avsnitt från "DevSec Station"



Missa inte ett avsnitt av “DevSec Station” och prenumerera på det i GetPodcast-appen.








