Foundational Impact podcast

Can AI Check AI? How Oak Evaluates Its Own Lesson Planner

0:00
32:22
Rewind 15 seconds
Fast Forward 15 seconds

In this episode of Foundational Impact, host Daniel Emmerson speaks with Hannah-Beth Clark, Director of Product and former AI Quality and Safety Principal at Oak National Academy. Hannah-Beth shares insights into building AI tools designed specifically for teachers, including Aila, Oak's AI lesson planning assistant. She explores the mechanics of Retrieval-Augmented Generation (RAG) using curriculum-aligned content, the necessity of intentional friction in tool design, and how robust safety and auto-evaluation systems maintain high pedagogical standards while keeping human expertise at the centre.

Key Topics & Timestamps

00:00 Open Curriculum Access

00:24 Show Introduction

01:25 Oak Origins and Mission

04:21 How Teachers Use Oak

07:00 Designing Productive Friction

08:48 How Aila Plans Lessons

11:30 RAG and Safety Guardrails

14:26 Hannah Beth Role

17:53 Evaluating AI Quality

22:19 When Experiments Fail

24:05 Trust and Human Oversight

26:00 Content Store and Open API

28:40 Advice for AI Skeptics

31:55 Closing Thanks

Key Takeaways & Highlights

  • Productive Friction in Design: Tools should intentionally require input and critical thought from teachers rather than offering a one-click output, ensuring lessons remain tailored to individual classroom contexts.
  • Retrieval-Augmented Generation (RAG): Grounding AI generation in a curated, high-quality corpus of national curriculum-aligned content ensures outputs meet strict pedagogical standards compared to general models.
  • Nuanced Safety Guardrails: Automated content moderation must distinguish between genuinely toxic content and sensitive, age-appropriate educational topics (such as classic literature) that require specific guidance rather than outright blocking.
  • Human Ground Truth in Evaluation: Automated evaluation tools can effectively flag technical issues like regionalisms or poor multiple-choice distractors, but expert human review remains essential to maintain output quality.
  • Purpose-Led Integration: Schools should approach technology by identifying clear classroom challenges first, avoiding adoption merely for the sake of using AI.

Resources Mentioned


Guest: Hannah-Beth Clark (Director of Product, Oak National Academy)

Hannah-Beth Clark is the Director of Product at Oak National Academy, having previously served as its AI Quality and Safety Principal. Prior to joining Oak, she was part of the founding team at Oasis Academy South Bank, where she served as a senior leader for ten years before becoming Headteacher in Enfield. She also serves as a governor for two primary schools in Cambridge.

More episodes from "Foundational Impact"