Catholic Tech Table podcast

AI Fundraising Build Pt. 18: Working with AI Context Windows

0:00
19:13
Rewind 15 seconds
Fast Forward 15 seconds

Jenny Riemer and Rhen Hoehn explore what happens when an AI is given too much information by explaining “context windows,” how they function like a limited desk of working memory measured in tokens, and why models can forget earlier details as conversations grow.


They discuss trade-offs of larger context windows and offer practical workflows to avoid issues.00:00 Intro

02:31 Too Much Information Question

04:21 Why AI Forgets Context

05:39 Context Window Explained

07:53 Model Sizes and Tradeoffs

09:55 Reset with Summaries

11:18 Work in Smaller Chunks

14:09 RAG Filing Cabinet Analogy

17:11 Wrap Up and Next Episode

More episodes from "Catholic Tech Table"