Kirkpatrick +AI: Myra Roldan on Innovation, Ethics, and Impact

In this episode of the Kirkpatrick Podcast, hosts Vanessa and Jordan break down the complexities of Level 4 evaluation—often considered the most challenging aspect of training impact measurement. But what if Level 4 is actually the easiest to measure? Join us as we explore: ✅ Why Level 4 impact isn't just about ROI ✅ How leading indicators help you prove value faster ✅ The biggest misconception that holds organizations back ✅ How to partner with other teams to track real organizational impact ✅ The hidden fears that stop organizations from measuring Level 4 Whether you’re a CEO, VP, or L&D leader looking to prove the value of your initiatives, this episode is packed with insights you won’t want to miss.   Watch the Show on YouTube!   Submit your Questions/Stories: Do you have a question you would like us to answer on the Kirkpatrick Podcast? Have a story about how the Kirkpatrick Podcast or other Kirkpatrick events/programs have positively impacted your career? We would love to hear from you! Follow this link to submit your questions and/or stories, and we may just share them on the next episode of the Kirkpatrick Podcast.   Events and Resources:   Join us for the 2025 Kirkpatrick Summit!    Apply to be a speaker at the 2025 Kirkpatrick Summit: FREE Webinar: Are You Doing Kirkpatrick® Right?     FREE Webinar: Kirkpatrick + AI - https://kirkpatrick.getlearnworlds.com/aiwebinar   NEW - Join the Kirkpatrick Community    Learn more about the Kirkpatrick Evaluation Toolkit   Learn More About our Certification Programs   Stay Connected:   Sign Up for our Free Resources and Weekly Newsletter   Subscribe to our Podcast Newsletter   Follow us on LinkedIn    Connect with Vanessa   Visit our website     #TrainingEvaluation #CorporateTraining #LearningAndDevelopment #TrainingImpact #LearningAndPerformance #CultureOfEvaluation #KirkpatrickModel #Kirkpatrick

In training and learning and development, the Kirkpatrick Model is one of the best known models up there with Bloom's Taxonomy and ADDIE.   Yet, evaluation is one of the pieces of the ADDIE model that is still not done right.   Join Vanessa Alzate and Jordan Rawlinson as they kick off the March Madness series, focusing on simplifying evaluation and getting back to the core principles of measuring impact. In this episode, they discuss: ✅ Why overcomplicating evaluation is a common mistake ✅ The biggest barriers organizations face when evaluating impact ✅ How to use existing data and habits to drive performance improvement ✅ The power of the Kirkpatrick Model and why it remains the gold standard If you're a CEO, VP, or learning leader looking to demonstrate the real impact of your programs, this is a must-listen! 🎧 Tune in now and start measuring what truly matters.   Watch the Show on YouTube!   Submit your Questions/Stories: Do you have a question you would like us to answer on the Kirkpatrick Podcast? Have a story about how the Kirkpatrick Podcast or other Kirkpatrick events/programs have positively impacted your career? We would love to hear from you! Follow this link to submit your questions and/or stories, and we may just share them on the next episode of the Kirkpatrick Podcast.   Events and Resources:   Join us for the 2025 Kirkpatrick Summit!    Apply to be a speaker at the 2025 Kirkpatrick Summit: FREE Webinar: Are You Doing Kirkpatrick® Right?     FREE Webinar: Kirkpatrick + AI - https://kirkpatrick.getlearnworlds.com/aiwebinar   NEW - Join the Kirkpatrick Community    Learn more about the Kirkpatrick Evaluation Toolkit   Learn More About our Certification Programs   Stay Connected:   Sign Up for our Free Resources and Weekly Newsletter   Subscribe to our Podcast Newsletter   Follow us on LinkedIn    Connect with Vanessa   Visit our website     #TrainingEvaluation #CorporateTraining #LearningAndDevelopment #TrainingImpact #LearningAndPerformance #CultureOfEvaluation #KirkpatrickModel #Kirkpatrick

In this aspirational episode of The Kirkpatrick Podcast, Vanessa Alzate and Dr. Jim Kirkpatrick welcome Jian Liu, a Training Specialist at a federal agency within the Department of Homeland Security and a Gold-Certified Kirkpatrick Professional. Jian shares his journey of applying the Kirkpatrick Model to create a Culture of Evaluation™ in his organization and the transformative impact it’s had on his training programs. From building a compelling evaluation plan to leveraging insights for program improvements, Jian provides actionable advice and highlights the importance of empathy and storytelling in learning and development. What You’ll Learn in This Episode: How Jian leveraged the Kirkpatrick Model to improve training for federal contracting professionals. The role of storytelling in presenting evaluation results and creating buy-in. Practical tips for embedding evaluation into organizational culture. The importance of collaboration and continuous learning for L&D professionals.

In this moving episode of The Kirkpatrick Podcast, Vanessa sits down with Pamela Heisler and Cassy Miller from Oregon Child Abuse Solutions, winners of a Blended Evaluation Plan of Excellence at the 2024 Kirkpatrick Summit. Together, they explore how a comprehensive, data-driven evaluation transformed their forensic interview training program, OC FIT, into a powerful tool for protecting children and achieving justice. Learn how their work demonstrates the life-changing potential of applying the Kirkpatrick Model to critical training programs. What You’ll Learn in This Episode: The role of forensic interviewers in safeguarding children. How Oregon Child Abuse Solutions used the Kirkpatrick Model to evaluate training impact. Key findings and improvements stemming from their evaluation. The importance of clear communication and stakeholder engagement. How systemic improvements create statewide consistency in child advocacy. Resources and Tools Mentioned: The Oregon Child Forensic Interview Training (OC FIT) program. The Kirkpatrick Four Levels® of Evaluation Community of Practice for forensic interviewers. How to measure training impact at the organizational and societal level.

In this episode of the Kirkpatrick Podcast, we’re diving into the dynamics of Learning & Development (L&D) and evaluation teams. Host Vanessa Alzate sits down with Jordan Rawlinson, Learning and Performance Strategist at Kirkpatrick Partners, to explore the key skills and roles needed to build an effective evaluation team. With the upcoming “Defining the Relationship” webinar on February 13th, we discuss why internal collaboration is just as critical as stakeholder buy-in, how to balance strengths within a team, and why evaluation shouldn't be a solo effort. Topics Covered: ✅ The power of team collaboration in evaluation ✅ Key roles needed for a high-functioning evaluation team ✅ How to structure responsibilities for maximum impact ✅ Addressing common barriers like math anxiety and overcomplication ✅ The importance of centralizing evaluation efforts ✅ How to make evaluation more effective and efficient Special Offer: 📅 Register for the "Defining the Relationship" Webinar on February 13th at 12 PM ET to explore these insights further! Can't make it live? Register anyway to receive the replay. Resources & Links: 🔗 Register for the webinar: Defining the Relationship Webinar 🔗 Connect with Jordan Rawlinson on LinkedIn 🔗 Learn more about Kirkpatrick Partners 🎧 Enjoyed this episode? Don’t forget to subscribe and leave us a review

In this insightful episode of The Kirkpatrick Podcast, Vanessa sits down with Dr. Amy Heaton to explore the intersection of human-centered design and the Kirkpatrick Model. They dive into the complexities of creating sustainable change in organizations, tackling challenges like retaining institutional knowledge, supporting learners post-training, and building systems that drive transformation. Discover how empathetic design, stakeholder engagement, and effective evaluation can create environments where learning thrives and behaviors change. Dr. Heaton shares her experiences working with government agencies, nonprofits, and private sector clients to revolutionize learning and performance strategies.   What You’ll Learn in This Episode: Why changing human systems is key to sustaining learning outcomes. The role of stakeholder engagement in driving organizational change. How human-centered design complements the Kirkpatrick Model. Strategies for creating systemic support for learners post-training. Resources and Tools Mentioned: Human-Centered Design principles from Stanford’s d.school Empathetic interviewing and its impact on learning strategies The concept of "change leadership" vs. "change management"

Many L&D professionals strive to build trust and credibility within their organizations, but the journey to becoming a trusted advisor can feel elusive. In this episode, we sit down with Dr. Keith Keating, Chief Learning Officer at BDO and author of The Trusted Learning Advisor, to explore what it truly means to be a trusted partner in learning and development. Dr. Keating shares actionable strategies from his book, including how to align L&D initiatives with business goals, build credibility with stakeholders, and measure the value of learning programs. Tune in to gain practical insights that will help you elevate your role as an L&D professional and drive meaningful business impact.

What if the Kirkpatrick Model could transform not just learning, but entire public programs? In this episode, hosts Vanessa Alzate and Jim Kirkpatrick sit down with Ted Kniker, co-founder of IMPACT Paradigm Associates and a pioneer in using the Kirkpatrick Model to drive high-stakes impact. From shaping the U.S. State Department’s evaluation capacity to breaking new ground in areas like natural resource management, Ted reveals how the Kirkpatrick Model has become his go-to tool for tackling “fuzzy” program evaluations. Join us as Ted shares his inspiring journey, actionable strategies, and expert tips for applying the model to influence meaningful change in any sector. Don’t miss this episode packed with insights you can start using today! Watch the Show on YouTube!   Submit your Questions/Stories: Do you have a question you would like us to answer on the Kirkpatrick Podcast? Have a story about how the Kirkpatrick Podcast or other Kirkpatrick events/programs have positively impacted your career? We would love to hear from you! Follow this link to submit your questions and/or stories, and we may just share them on the next episode of the Kirkpatrick Podcast.     Learn more about the Kirkpatrick Evaluation Toolkit Events and Resources: Kirkpatrick Virtual Open House  Join us for the 2025 Kirkpatrick Summit!  Apply to be a speaker at the 2025 Kirkpatrick Summit  FREE Webinar:  Are You Doing Kirkpatrick® Right?   FREE Webinar: Kirkpatrick + AI   NEW - Join the Kirkpatrick Community Learn More About our Certification Programs   Stay Connected: Sign Up for our Free Resources and Weekly Newsletter  Subscribe to our Podcast Newsletter Follow us on LinkedIn  Connect with Vanessa  Connect with Ted   Visit our website 

Artificial Intelligence is rapidly changing the landscape of learning and development, offering unprecedented opportunities for innovation and efficiency. But how can organizations harness the power of AI while maintaining ethical standards and a human-centered approach? In this episode, Vanessa Alzate sits down with Myra Roldan, a leading AI expert and LinkedIn Top Artificial Intelligence Voice, to explore how AI can be leveraged to enhance learning and performance evaluation. Together, they unpack the insights from the Kirkpatrick + AI webinar, discussing practical applications of AI, its role in automating evaluation processes, and the ethical considerations that must guide its adoption. Whether you’re looking to integrate AI into your evaluation strategies or curious about the future of AI in learning, this episode will provide key takeaways and actionable tips for driving impact with AI—without losing the human touch.   Learn more about the Kirkpatrick Evaluation Toolkit   Events and Resources:   Kirkpatrick Virtual Open House   Join us for the 2025 Kirkpatrick Summit!    Apply to be a speaker at the 2025 Kirkpatrick Summit   FREE Webinar: Are You Doing Kirkpatrick® Right?   FREE Webinar: Kirkpatrick + AI    FREE Virtual Event: Kirkpatrick Open House   NEW - Join the Kirkpatrick Community     Learn More About our Certification Programs    Stay Connected:    Sign Up for our Free Resources and Weekly Newsletter    Subscribe to our Podcast Newsletter   Follow us on LinkedIn   Connect with Vanessa    Connect with Myra   Visit Myra's Website   Connect with Jim   Visit our website 

Public service training plays a vital role in building a resilient, skilled workforce equipped to meet the evolving needs of the 21st century. But how can we ensure these programs are truly impactful? In this episode, Vanessa Alzate and Dr. Jim Kirkpatrick sit down with Dr. Sydney Heimbrock, a transformative leader in public sector training, to discuss how the Kirkpatrick Model is revolutionizing training evaluation in government. Dr. Heimbrock shares invaluable insights from her global experiences and her work with Qualtrics, emphasizing the importance of continuous feedback, human-centered approaches, and real-time data in creating adaptable and effective training programs. If you're seeking strategies to enhance public service training or better align evaluation with workforce demands, this episode is packed with practical takeaways to help you drive meaningful change.   Watch the Show on YouTube!   Submit your Questions/Stories: Do you have a question you would like us to answer on the Kirkpatrick Podcast? Have a story about how the Kirkpatrick Podcast or other Kirkpatrick events/programs have positively impacted your career? We would love to hear from you! Follow this link to submit your questions and/or stories, and we may just share them on the next episode of the Kirkpatrick Podcast.   Learn more about the Kirkpatrick Evaluation Toolkit   Events and Resources:   Kirkpatrick Virtual Open House   Join us for the 2025 Kirkpatrick Summit!    Apply to be a speaker at the 2025 Kirkpatrick Summit   FREE Webinar: Are You Doing Kirkpatrick® Right?   FREE Webinar: Kirkpatrick + AI    FREE Virtual Event: Kirkpatrick Open House   NEW - Join the Kirkpatrick Community     Learn more about the Kirkpatrick Evaluation Toolkit - https://kirkpatrick.getlearnworlds.com/course/kirkpatrick-model-toolkit   Learn More About our Certification Programs - https://www.kirkpatrickpartners.com/training-events/   Stay Connected:    Sign Up for our Free Resources and Weekly Newsletter    Subscribe to our Podcast Newsletter   Follow us on LinkedIn   Connect with Vanessa    Connect with Dr. Sydney   Connect with Jim   Visit our website