
0:00
19:13
Jenny Riemer and Rhen Hoehn explore what happens when an AI is given too much information by explaining “context windows,” how they function like a limited desk of working memory measured in tokens, and why models can forget earlier details as conversations grow.
They discuss trade-offs of larger context windows and offer practical workflows to avoid issues.00:00 Intro
02:31 Too Much Information Question
04:21 Why AI Forgets Context
05:39 Context Window Explained
07:53 Model Sizes and Tradeoffs
09:55 Reset with Summaries
11:18 Work in Smaller Chunks
14:09 RAG Filing Cabinet Analogy
17:11 Wrap Up and Next Episode
More episodes from "Catholic Tech Table"



Don't miss an episode of “Catholic Tech Table” and subscribe to it in the GetPodcast app.








