#144 - The Craft of Sample Sizes with Lauren Stern of WHOOP

Change is an important and inevitable part of developing as a user experience professional. But what does change look like when it happens at the organizational level? That is the focus of this episode, featuring Graham Gardner, VP of UX Design Research Operations at U.S. Bank. He joins Erin and Carol to talk about change management, which is the practice and process of evolving and adapting a company's approach to something.Graham takes us inside his strategy for this, including how team structures can affect change (and their impact on research tooling). He also unpacks just how important Research Operations (ReOps) is to planning, executing, and managing change at an organizational level. Finally, Graham looks ahead to the impacts of AI and how he believes it might help teams like CX, analytics, and marketing work together better.If you've ever wondered about how companies grow and develop, and how these developments can impact user insights, check it out. Highlights08:16 Enhancing Collaboration through Transparent Tool Mapping14:37 Harmonizing AI and Human Roles for Success20:44 From Projects to Service Design: A Strategic Shift23:46 Research Insights: Steering Through Complexity for Success28:40 Integrating Research into Client Relationship Strategies31:37 Insights from Backgrounds: Decoding Environmental CuesAbout GrahamGraham Gardner, VP of UX Design Research Operations at U.S. Bank, is a researcher, designer, strategist, and maker. He brings a human-centered design lens to research ops (thanks to a long stint at IDEO and a background in inclusive education research). He works to collaboratively and iteratively understand and design research and design ecosystems that grow and evolve with the changing contexts of our beautifully messy world and the people that live in it. Conversations with Graham usually involve dad jokes, dog cameos, and snack breaks.More ResourcesGuide to UX Research StrategyAI in UX Research ReportThe Importance of Research Operations

The consulting firm IDEO helped pioneer "design thinking" as a way to create products that better solve customer wants and needs, creating fans. Over 30 years later, the interplay between design and research has never been more important.Will Notini joins to dig into that interplay—how research is at the heart of design and vice versa. In particular, he thinks the best companies are using design research principles to explore new opportunities, both what they create and how those experiences function.Will also shares a framework for researching "fast and slow," the importance of participant recruitment, and how building trust with colleagues creates more impactful, lasting user insights.Highlights04:11 Uncovering Unbiased Insights Through Exploratory Design12:20 Finding Participants Who Truly Care and Invest19:43 Building Trust for Collaborative Design Discussions24:54 Interdisciplinary Collaboration and Expertise-Sharing at IDEO30:37 Simulated Research: Addressing Urgency and Resource Challenges34:10 Iterative Learning: Updating Assumptions and ApproachesAbout WillWill Notini is a Senior Design Research Lead at IDEO, where he is a generalist —drawing on his training in social science research to execute design and innovation work for clients in a range of industries. In his role, he manages multi-disciplinary teams and leads the research.His background is in anthropology and did mixed methods market research in the restaurant industry before transitioning to design research and has been at IDEO since. He has also recently picked up an MBA and a potentially unhealthy (unrelated) obsession with tennis.More ResourcesThe Designer's Guide to User ResearchHow to Recruit Participants for ResearchStorytelling Basics for UX Researchers

The craft of UX research is at an all-time high. How research leaders structure, staff, and scale their teams is more important than ever. Erin and Carol are joined by Brad Orego, Head of Research at Webflow, to talk all about the ways we can build better research teams.Brad shares their three-step process for creating a research practice that's ready to deliver for the business, including the questions you must ask stakeholders. Using examples from Webflow, Brad also talks about tactical considerations such as managing cross-team research requests, the importance of Operations, and how they think AI will help with democratization.This is must-listen for anyone building a research team, looking for ways to expand their influence or impact, and even early career folks who want a look inside an innovate team. Highlights03:14 Building Relationships and Networks for Long-Term Success16:18 Monitoring Customer Trends for Strategic Insights22:26 Optimizing Best Practices and Research Insights Activation29:37 Enhancing Efficiency and Reducing Risk Through Automation36:22 Four Key Questions to Guide Your Research40:41 Strategic Evolution and Research Maturity at WebflowAbout BradBrad (they/them) is a UX Leader, User Researcher, Coach, and Dancer who's been helping companies from early-stage startup to Fortune 500 develop engaging, fulfilling experiences and build top-tier Research & Design practices since 2009. They have helped launch dozens of products, touched hundreds of millions of users, managed budgets ranging from $0 to $10M+, and coached hundreds of Researchers.More ResourcesBuilding a UX Research Team From ScratchCreate Lasting UX Impact With StakeholdersThe Three Facets of High-Impact Research

In our Season 3 finale, Erin and Carol are joined by Caroline Morchio, Head of UX at Dashlane, a credential management platform. Their conversation explores UX research best practices at a security-minded organization like Dashlane, highlighting other what teams can bring to their own work. Caroline shares the ways she structures the UX team to support the product landscape at Dashlane, their processes for empowering colleagues to contribute to research, and why she prefers a "decentralized" model. The conversation also unpacks the core skills that Caroline emphasizes no matter the company: storytelling, actionable insights, and templates. Together, these help her team maintain rigor while scaling to meet new user experiences opportunities.Finally, Caroline discusses how to balance the security and usability when conducting UX research, and forecasts what the future of data privacy and security might have in store, like passwordless authentication. Episode Highlights04:27 Implementing research in stages07:22 The strategic impact of UX on a business11:23 Focusing on ICP segmentation and user sophistication18:06 The importance of privacy and data security23:01 Decentralizing research processes30:17 The importance of research in complex technologyAbout Our GuestCaroline is a Design leader with experience in innovative companies transforming their industries. She has led design teams through all phases of product development and fostered a culture of open collaboration and feedback. Caroline was previously VP of Design at Handshake, Neuralink, and is now an AWS Design ambassador and Head of UX at Dashlane.More Resources on Security in UXRA Researcher's Guide to Data Privacy RegulationsNDAs and Consent Forms for UX ResearchExamining Ethical Design and Respectful UX

Erin and Carol are joined by Jo Widawski, founder and CEO of Maze, to discuss the major findings from their "Future of User Research" report, which unearthed three trends animating researchers, PMs, and founders alike: 1) the demand for research is growing, 2) research democratization empowers stronger decision making, and 3) new technology—like generative AI—allows teams to scale their research.Erin, Carol, and Jo unpack each of these trends, flagging what they mean for both the work of researchers and the value of research more broadly. For example, these trends signal a rise in importance of the research generalist, the critical value of stakeholder influence, and the skills tomorrow's successful researcher must build today. Together, these trends and skills help create a roadmap for how researcher's can grow from a tactical resource to a strategic partner.Episode Highlights03:57 The nature of research in organizations11:01 Transitioning researcher roles: from operational to educational18:01 The importance of democratization in design22:43 Overcoming resistance to research in design30:25 AI's impact on user research trust37:59 Understanding competitive landscape in building productsAbout Our GuestJo Widawksi is the Founder and CEO at Maze. He’s a veteran Product Designer & former UX teacher. As a UX lead working with clients like McKinsey, Rocket Internet & PSG, he saw first-hand how hard it is for product teams to get the data, insights, and feedback they need to make confident design decisions. Now he’s co-founded Maze, the continuous product discovery platform for user-centric teams.More ResourcesRead the 2024 State of User Research Report (from UI)Read the Future of User Research Report (from Maze)Learn how to create stronger stakeholder relationships

Erin is joined by Auzita Irani, a research manager at AirBnB to discuss being a more efficient user experience researcher. In today's work world, resources—time, budget, headcount—always seem to be in limited supply. How can we balance these things along with other important elements of our research practices? Auzita has been thinking about "doing more with less" for a long time and shares practical strategies.After discussing the challenges facing today's UX researcher, the conversation shifts to what Auzita has seen work for researchers, both those working in large and small companies. Erin and Auzita touch on tools (like AI), tactics (like prioritization frameworks), and collaboration approaches to work more productively with stakeholders and teammates. They also discuss burnout's effects and the ways of combatting it.Finally, Erin and Auzita make some predictions on where UX is headed in the months and year ahead, and what these trends might mean for our work.Episode Highlights03:53: Challenges and strategies of "doing more with less"11:23: Addressing time and deadline constraints21:38: Failure modes and avoiding burnout32:05: Balancing tactical and strategic work38:21: Emphasizing your research's impact44:57: Adapting to blurred work boundariesAbout Our GuestAuzita has a background in computer engineering and Human Computer Interaction. She currently leads teams dedicated to optimizing customer support experiences and developing cutting edge AI tooling solutions at Airbnb. Prior to this she led the research and annotation teams at Sprig working on streamlining the process of obtaining real-time insights for product teams.More Resources on Research EfficiencyScaling yourself while combatting burnoutDoing user research on any budgetA blueprint for scaling UX research

It's our 150th episode! To celebrate, we brought together three thought leaders for a discussion about UX research's future. Erin and Carol are joined by Judd Antin, Dave Hora, and Christiana Lackner, who bring over 40 years of combined experience in UX research, both as practitioners and leaders. This wide-ranging conversation combines our guests' reflections on the trends that brought UX to its current moment with an analysis of what the future holds—and how we can prepare ourselves (and our teams) for it. From strategies on creating more business value for our work to tips for creating stronger cross-functional partnerships, this conversation will equip you with practical steps to future-proof your research practice.Episode Highlights09:28 - The evolution of the UX research industry15:48 - Adapting UX methods for team dynamics21:56 - Balancing our focus between the business and the user30:45 - The role of UX research in fostering shared understanding 41:18 - Planning strategically and anticipating team needs47:27 - The promise of AI for user experience professionalsAbout Our GuestsJudd Antin is an executive coach, consultant, advisor, writer, and teacher, leveraging his 15 years of experience as a research, design, and product executive at top companies (Meta, Airbnb) and his PhD in Social Psychology & Information Systems from UC Berkeley to help individuals and organizations achieve their goals and overcome their challenges.Dave Hora is the founder of Dave's Research Co. where he helps product teams drive critical initiatives with the right mix of data, insight, and common sense. He began professional research work in 2011, eventually starting the practice as the first research hire at six companies, including PlanGrid and Instacart.Christiana Lackner is a UX research leader and dot connector. She's building research maturity within organizations so that teams involve the right people, ask the right questions, and act on the answers.More Resources on the Future of UX ResearchThe role AI will play in the future of UXRConnecting UX research to business revenueThe 2023 State of User Research Report

In this episode, Erin and Carol sit down with Tyler Wanlass, lead product designer at CommandBar, to explore practical strategies for conducting user research without a dedicated research team. They dig into techniques that designers and product managers can use to gather valuable insights efficiently, especially in resource-constrained environments. Tyler's approach is scrappy, flexible, and creative. Tyler shares some of the tools that create his research toolkit, including efficient note-taking, creative approaches to participant recruitment, and mixed-methods continuous discovery methods. He explains how session recordings and account impersonation can offer deeper insights when primary research isn't possible. Tyler reinforces the value of proactive research, such as social listening and competitive analysis.This is a useful conversation for anyone without "researcher" in their title, but who wants to increase their customer engagement, build more thoughtful products, and do so in a way that respects both budgets and timelines.Episode Highlights03:16 - The scrappy mindset: learning from real-life experiences10:21 - Broadening perspective through cross-industry inspiration16:12 - Proactive user research for connecting and learning24:17 - Streamlining customer feedback with TL;DR summaries36:51 - Tools and tactics for customer insights44:09 - The importance of pricing and packagingAbout Our GuestTyler design interfaces for software products, builds internet businesses, and occasionally writes books. In his off time he's renovating a 100 year old Victorian house in the Pacific Northwest. In a past life he designed video games.More Resources on UX Research for Designers and PMsThe Product Manager's Guide to UX ResearchThe UX Designer's Guide to ResearchUncomplicated Recruitment for Non-Researchers"People Who Do Research," a Discovery Study

In this episode, Erin and Carol tackle one form of research impact growing in importance and necessity: revenue. Their guest is Claudia Natasia, co-founder and CEO of Riley AI. Before starting Riley, Claudia grew product teams at early-stage companies and worked in the financial industry. These experiences showed her the importance of linking user research outputs to the bottom line of a business.During their conversation, Claudia breaks down what revenue typically looks like for a company and where you can find the specific revenue goals for your company. Then she digs into the important processes of weaving those revenue goals into a research strategy from the start, offering examples from her time on product teams.The discussion also explores the importance of triangulation, or combining multiple data types to form a more complete whole. Claudia explains that user researchers should balance conducting primary research with existing information to help clarify how UX is linked with wider business goals. She offers suggestions for teams big and small looking to make impact with the highest level decision makers and company executives.Episode Highlights06:07 - Strategic frameworks for company growth and revenue12:05 - Leveraging competitive analysis for market success22:06 - Creating meaningful insights for your business30:05 - Tracking research impact: Setting expectations and routine updates37:13 - Elevating projects: Moving from junior to senior stakeholders44:39 - Triangulating data: Connecting research to company successAbout Our GuestClaudia is a leader with 10+ years experience leading product, strategy, and data teams across the enterprise and financial technology space. Her work has directly influenced companywide strategies, leading to a $5B total valuation, a successful international acquisition, and multi-million dollar growth fundraising rounds.  She advises and angel invests in early stage startups, in North America and Southeast Asia. Her areas of focus are enterprise, finance, and consumer AI-generated content.Resources on Research Impact and RevenueA guide to showing the value of user researchClaudia's textbook of choice for learning about revenueThe three aspects of high-impact UX researchThe Business of Research Slack Community

Erin and Carol explore the complexities of healthcare research with Nadyne Richmond, a healthcare design advisor with a background in big tech who pivoted to healthcare research a decade ago to tackle the pressing issues she saw in the system.Nadyne underscores the nuances of conducting user experience (UX) research within healthcare settings, unpacking the intersections of patients' lives, their health, financial well-being, and spiritual factors that can come with many diagnoses. She emphasizes the importance of being well-prepared to manage deep conversations, maintain objectivity while being viewed as human, and handle the delicacy of information with privacy and sensitivity.Nadyne shares practical advice on approaching sensitive research topics, providing control to participants, giving space for the research team, and even using diary studies for a more comprehensive understanding of patient experiences. Additionally, she talks about the intricacies involved when working with healthcare players, from insurance providers to medical staff, and how their differing incentives shape patient care.Episode Highlights03:56 - Transitioning from tech to healthcare research13:56 - Challenges when researching with medical professionals21:32 - Navigating Sensitive Topics when recruiting patients28:45 - Planning for legal requirements in user testing35:24 - Data protection in healthcare research41:11 - The unique rewards of healthcare researchAbout Our GuestNadyne Richmond is a user researcher and experience design leader with a track record spanning two decades. She has worked and led teams at places like IBM, Microsoft, Included Health, and Babylon. She started her career as an engineer, giving her a unique window in the challenges of creating products and services that are excel technically and meet the demands of customers and the business alike. Resources From NadyneCrucial Conversations bookAn Arm and a Leg PodcastInterviewing Users bookMore Healthcare Research ResourcesA researcher's guide to data privacy guidelinesDesigning experiences for healthcare companiesUX research strategies for building healthcare apps