Data Driven podcast

Self-Healing Pipelines and the Evolving Role of Data Engineers in the AI Era

18/11/2026
0:00
39:08
Recuar 15 segundos
Avançar 15 segundos

Welcome back to Data Driven, the podcast exploring the dynamic intersection of artificial intelligence, data science, and the foundational world of data engineering. In this episode, we dive into the realm of data pipelines, enterprise analytics, and the ever-evolving tools that power our most advanced AI models. Our guest is a seasoned data engineering and analytics professional from the College of Southern Nevada, sharing over five years of expertise spanning pharmaceutical supply chain analytics, business intelligence, and leading-edge platforms like Azure Data Factory, Databricks, and Power BI.


The conversation focused on the often under-appreciated work of data engineers, the challenges of maintaining data quality, and the art of making data truly AI-ready. One concept discussed was reporting drift and its impact on business decision-making. A key theme that emerged was the transformative influence of AI integration within analytics platforms such as Power BI, as well as the arrival of AI agents and self-healing data pipelines. The discussion explored the universal lessons from industries like pharma and higher education, the advancing role of dashboards, and just how quickly science fiction is becoming reality in the data space. Get ready for a thought-provoking look at how organizations can future-proof their data infrastructure in the age of AI.

Links


Time Stamps

00:00 Intro and guest introduction

05:47 Copyright challenges in AI training

07:38 Early doubts about LLM effectiveness

13:08 Evolving impact of new technology

16:48 AI simplifying data analysis

18:41 Frustrations with Stack Overflow

22:45 AI agents in data engineering

26:48 AI conversation evolving rapidly

31:26 Talking about kids and technology

34:40 Building RAG for file classification

36:26 Exploring AI in Data Visualization

Mais episódios de "Data Driven"