Assessment Reform for the Age of Artificial Intelligence

Dan Levy and Angela Pérez share about Teaching Effectively with ChatGPT on episode 538 of the Teaching in Higher Ed podcast. Quotes from the episode It's very easy to be overwhelmed right now with AI. -Dan Levy AI has infinite patience. -Dan Levy ChatGPT is amazing for generating 10 topic ideas to get inspired. -Angela Pérez If you know how to prompt Chat GPT, you know how to create a customized bot. -Dan Levy You can think of the teacher being the designer of the feedback rather than the giver of the feedback. -Dan Levy I can ask the bot questions that I would be embarrassed to ask my instructor. -Dan Levy Resources Teaching Effectively with ChatGPT Teaching Effectively with Zoom Teddy Svoronos Building Customized Chatbots Chapter How to use Speaker Progress in Microsoft Teams for Education Flighty Pro The Anxious Generation* Becoming Great Universities: Small Steps for Sustained Excellence, by Richard J. Light and Allison Jegla Streamdeck

John Warner explores stressing pedagogical principles over AI promises on episode 536 of the Teaching in Higher Ed podcast. Quotes from the episode Once they've done the writing or as even as they're doing the writing, they're reflecting on their own metacognitive understanding of their own practices. -John Warner While you are in the act of writing, you are processing your own idea. -John Warner Resources Engaged Education, John Warner’s Newsletter Structure + Freedom = Engagement: A Frankenstories case study, by John Warner Just Say No to Historical Figure Chatbots: Against digital necromancy, by John Warner The Science of...Writing? Teaching requires lots of experimenting, but that doesn't make it a "science" By John Warner On Becoming: Bonni and Alexis’ MYFest24 Session Frankenstories Joy Comes Back A reminder to myself to never take for granted how wonderful life can be. Unashamed, by Harry Baker

Andrew Cross and Alyshahn Kara-Virani share about creating interactive experiences and shaping the future of teaching on episode 535 of the Teaching in Higher Ed podcast. Quotes from the episode A lot of play science comes down to being a safe space to learn from each other, to see how people respond to what you put out there in the world without it being this critical life or death situation. -Andrew Cross People disproportionately remember experiences based on both the peaks and the valleys, and then also the ending experience. -Andrew Cross Encourage students to freely explore the content on their own. Sometimes that's content, sometimes it's a physical space. Turn them loose to go off and find something that they find interesting, a little bit of free choice learning. -Andrew Cross Status quo is our enemy too often. -Andrew Cross Resources Play: How it Shapes the Brain, Opens the Imagination, and Invigorates the Soul by Dr. Stuart Brown The Play Conference by US Play Coalition The Power of Moments: Why Certain Experiences Have Extraordinary Impact by Chip & Dan Heath Peak–end rule Episode 530 : Lessons from the Road: Share Your Teaching Stories with Dave Stachowiak Episode 527 : Beyond Dichotomous Thinking: Strategies to Enhance Teaching and Learning with Alexis Peirce Caudell The Museum Experience Revisited by John H Falk, Lynn D Dierking Activity-Based Teaching in the Art Museum: Movement, Embodiment, Emotion by Getty Museum The 5 “E”s

Josh Eyler helps us cultivate hope and action beyond grades on episode 534 of the Teaching in Higher Ed podcast. Quotes from the episode Teachers, instructors, educators at all levels can really work with students to find elements of what we are teaching that those students find individually interesting. -Josh Eyler We can help them learn how to ask questions that are meaningful to them, how to really dig in and find ways that the content becomes meaningful to who they are as people. -Josh Eyler We're in another period of significant grading reform right now, fueled, I believe, by mass communication and social media. People are now able to connect in ways that in previous eras of grading reform, they were not able to. -Josh Eyler Resources Failing Our Future: How Grades Harm Students, and What We Can Do about It, by Josh Eyler How Humans Learn: The Science and Stories Behind Effective College Teaching, by Josh Eyler Kariann Fuqua Range: Why Generalists Triumph in a Specialized World, by David Epstein Moonwalking with Einstein : The Art and Science of Remembering Everything, by Joshua Foer Self determination theory Reconceptualizing Participation Grading as Skill Building, by Alanna Gillis University of Virginia: Michael Palmer Bird by Bird: Some Instructions on Writing and Life, by Anne Lamott Premortums Radical Hope: A Teaching Manifesto, by Kevin Gannon How to Podcast: How to help a Loved One with Dementia Failing Our Future: How Grades Harm Students, and What We Can Do about It, by Josh Eyler Punished for Dreaming: How School Reform Harms Black Children and How We Heal, Bettina L. Love Fugitive Pedagogy: Carter G. Woodson and the Art of Black Teaching, by Jarvis R. Givens Indigenous Educational Practices Matt Townsley

Josh Eyler shares even more problems with grades on episode 533 of the Teaching in Higher Ed podcast. Quotes from the episode Being a dad who is an educator takes things from the academic and intellectual and brings them immediately to the surface, to the real world and to the real consequences for students and families. -Josh Eyler The conflict between what we think and what we value and what we want for our kids and what the world and our school systems say are important can sometimes be almost irreconcilable. -Josh Eyler We need to create environments that will cultivate intrinsic motivation. -Josh Eyler In situations where grades are given, students tend to be more fearful of making mistakes. They produce more behaviors of trying to get the grade rather than learning. -Josh Eyler Grades are not objective accurate measurements of learning according to this research. -Josh Eyler If grades don't measure what they're supposed to measure, why are we using them, and why are we putting so much pressure on them? -Josh Eyler Resources Failing Our Future: How Grades Harm Students, and What We Can Do about It, by Josh Eyler How Humans Learn: The Science and Stories Behind Effective College Teaching, by Josh Eyler Kariann Fuqua Mind Over Monsters: Supporting Youth Mental Health with Compassionate Challenge, by Sara Rose Cavanaugh Coaching for Leaders Episode 310: How to Reduce Drama With Kids, with Tina Payne Bryson Difficult Conversations: How to Discuss What Matters Most (Revised), by Douglas Stone & Sheila Heen* The Scarlet Letter, by Nathaniel Hawthorne* Punished by Rewards: The Trouble with Gold Stars, Incentive Plans, A'S, Praise, and Other Bribes, by Alfie Kohn* A meta-analysis on the impact of grades and comments on academic motivation and achievement: A case for written feedback, by Alison Koenka, et al. A Century of Grading Research: Meaning and Value in the Most Common Educational Measure, by Susan M. Brookhart, Thomas R. Guskey, et al. The Math Wars: Timed Tests, Math Anxiety, and the Battle Over How We Teach Our Kids, by Joshua Eyler for The Saturday Evening Post Off the Mark: How Grades, Ratings, and Rankings Undermine Learning (But Don't Have To) , by Jack Schneider & Ethan L. Hutt * The Test , by Anya Kamenetz  Lower Ed, by Tressie McMillan Cottom*

Mylien Duong discusses strategies for facilitating contentious conversations in your classroom on episode 532 of the Teaching in Higher Ed podcast. Quotes from the episode We were never really trained to have these difficult conversations. We were not really trained as instructors to facilitate these conversations. -Mylien Duong It is not realistic to not prepare our students to be civically engaged and be able to engage and work with people who are different from them who don't share the same beliefs that they do. -Mylien Duong My goal is to help students to fully understand students, to help them clarify their own thinking, and to ensure and to help them communicate that to the rest of the class. -Mylien Duong Resources Constructive Dialog Institute Foundations in Facilitating Dialog Course Maintaining Campus Community During the 2024 Election: A Guide for Leaders, Faculty, and Staff, by Mary Aviles & Mylien Duong, PhD Successful classroom discussions begin long before anyone speaks for Times Higher Education, by Mylien Duong and Jacob Fay Becoming a Critically Reflective Teacher, by Stephen D. Brookfield Use Perplexity AI to Evaluate Health Information Cyclic sighing

Christopher Gilman and Adelmar Ramirez describe how to use IIIF in your teaching to bring the world’s image collections to students on episode 531 of the Teaching in Higher Ed podcast. Quotes from the episode I think that our responsibility as professors in the 21st century is to engage students more. -Adelmar Ramirez Think with your hands. Every step that you make, every button that you click is an operation. -Christopher Gilman Resources Gain Richer Access to the World's Image and Audio/Visual Files with IIIF Get Started: Access IIIF End-User Resources Guides to Finding IIIF Collections and Resources Get Started Guide: University of Cambridge University of Cambridge Digital Collection Get Started Guide: Harvard University Digital Collections Harvard University Digital Collections Get Started Guide: UCLA Digital Collection UCLA Library Digital Collections 30,000 Getty Museum Images Published Online as IIIF Digital Florentine Codex Awesome International Image Interoperability Framework (IIIF) Sample IIIF Content (e.g. Stanford and Harvard) IIIF Experiments and Fun An ‘Alles is Muziek | ‘Music is Everything’ IIIF Website Bonni Found While Compiling the Show Notes

Dave Stachowiak and Bonni invite you to share your teaching stories and they tell of a few lessons from the road on episode 530 of the Teaching in Higher Ed podcast. Quotes from the episode It's interesting how much comes back to a caravan and a road trip, because that's where it all started. -Dave Stachowiak There's a lot of people who want to help you. You need to teach them how. -Dave Stachowiak The more folks we can take along on the trip and share stories, the better. -Dave Stachowiak Resources The Teaching in Higher Ed Story Caravan Coaching for Leaders Podcast 661: How to Tell a Story About Yourself, with David Hutchens Coaching for Leaders Podcast 691: Bringing Your Strengths to a Big Job, with General CQ Brown, Jr. Permission Slip, by Bryan Mathers Join the Story Caravan Tell someone else about the Story Caravan Donate a prize Open Working The Visual Thinker Bonnie Powers Free Hexagonal Thinking Digital Toolkit from NowSparkCreativity 5 Creative Ways to Use Hexagonal Thinking Cult of Pedagogy episode on hexagonal thinking - where you can also hear the correct way to pronounce hexagonal, unlike how Bonni said the word throughout the entire episode 🤦‍♀️ Just Mercy: A Story of Justice and Redemption, by Bryan Stevenson The Legacy Sites

James Lang reads his piece, Working the Gardens of Our Classrooms, on episode 529 of the Teaching in Higher Ed podcast. Quotes from the episode He quits worrying about whether Pangloss or Martin are correct, decides that he and his companions should turn their attention to the immediate work demanded by their current circumstances. -James Lang Writing is, number 1, a form of thinking, number 2, that produces learning, and 3, generates new ideas. That was true in 2000, and it's true in 2024. -James Lang In the meantime, the gardens need tending. If you continue to believe in the value of the plants that have always flourished in your garden, keep growing them. -James Lang Resources Voltaire on Working the Gardens of Our Classrooms: Are you a Pangloss, Martin, or Candide?, by James Lang  Episode 19: Cheating Lessons with James Lang Episode 374: Small teaching Reprised with James Lang The Healing Power of Learning: After a health crisis, an academic finds that learning is not just joyful but restorative, by James M. Lang Notre Dame Hub of Learning Excellence Desirable difficulties Kristi Rudenga is Director of the Notre Dame Learning | Kaneb Center as well as Associate Teaching Professor, with a concurrent appointment in Psychology

Jason Lodge discusses assessment reform for the age of artificial intelligence on episode 528 of the Teaching in Higher Ed podcast. Quotes from the episode Where does the capability of AI end and where does the impact of the teacher start? -Jason Lodge Our tendencies as teachers and the way that we wanted to teach was clashing with the way that the lesson plan had been structured by Chat GPT. -Jason Lodge We don't know where we're headed, but at least we can have a sense of what the direction might be. -Jason Lodge We have to get to the point where we stop looking for evidence that students are using these tools to cheat and shift our emphasis to looking for evidence that learning has occurred. -Jason Lodge It's less about the technology and more about the human, how we learn and how we understand ourselves. -Jason Lodge Small things can add up to make a huge difference. -Jason Lodge Resources Tertiary Education Quality and Standards Agency (TEQSA) TEQSA Assessment reform for the age of artificial intelligence International College of Management, Sydney (ICMS) Academic Integrity in the Context of Artificial Intelligence Assistant, Parrot, or Colonizing Loudspeaker? ChatGPT Metaphors for Developing Critical AI Literacies, by Anuj Gupta, Yasser Atef, Anna Mills, & Maha Bali James Lang Small Teaching, by James Lang Jon Ippolito MYFest Episode 524: Toward a More Critical Framework for AI Use with Jon Ippolito Assessment 2020: Seven propositions for assessment reform in higher education, by Boud and Associates Higher Education Standards Framework (Threshold Standards) National Artificial Intelligence Taskforce (2023)