Code & Cure podcast

#60 - We Can Teach Medical AI To Look Like Experts

3.9.2026
0:00
22:24
15 Sekunden vorwärts
15 Sekunden vorwärts

If you’ve ever wondered why an AI model can sound confident while still being wrong, radiology is the perfect lens. We’re looking at a new approach to medical imaging AI that tries to close the gap between raw pattern matching and real clinical thinking: training models using radiologists’ eye gaze while they interpret chest X-rays.

We talk through how clinicians read a chest X-ray systematically, why that “checklist” behavior matters, and how it changes depending on the question being asked (shortness of breath, line placement, suspected pneumonia). Then we connect that to explainable AI: if we can record where experts look, the order they scan, and where they pause, we can fine-tune a vision transformer or vision language model to produce reports in a way that’s easier to audit and trust. Along the way, we revisit the notorious “cat diagnosed as COVID” story to show how out-of-distribution failures happen when a model learns correlations without domain grounding.

We also keep it real about limitations. A gaze-informed model may be better, but it’s still a neural network, and it still might not be “reasoning” the way a human does. Laura brings the clinical workflow reality check: comparing to prior films, using two-view chest X-rays, and integrating symptoms, exam, and anatomy in a way that a single image cannot fully capture.

Reference:

Seeing through experts' eyes: a foundational vision-language model trained on radiologists' gaze and reasoning
Lee et al.
Nature NPJ Artificial Intelligence (2026)

Credits:

Theme music: Nowhere Land, Kevin MacLeod (incompetech.com)
 Licensed under Creative Commons: By Attribution 4.0
 https://creativecommons.org/licenses/by/4.0/

Weitere Episoden von „Code & Cure“