AI Meets Cucumber: A New Testing Approach Using Prompt Engineering with Guy Arieli and Tal Barmeir

Welcome to the TestGuild Automation Podcast! I'm your host, Joe Colantonio, and Jon Robinson, chief storyteller at Nekst IT, ready to delve deep into the automation testing world. In today's episode, "The Four Phases of Automation Testing Mastery," we'll debunk the myth that automation is a cure-all solution and explore the intricacies and careful planning needed to succeed in test automation. Join us as we discuss practical strategic approaches including the 4-phase model—Discovery, Design, Develop, Deliver—and the importance of a maturity model to ensure your automation aligns with CI/CD integration. We'll highlight how automation serves as the backbone for regression testing, providing substantial long-term benefits and how pushing it later in the development process can minimize rework and costs. We'll tackle the challenges of test management in an agile world, and Jon will share his insights on the importance of storytelling in QA and how it can revolutionize how we test and communicate the value of our work. Expect actionable tips on avoiding common pitfalls and why focusing on real-world impacts and user perspectives can significantly improve your automation efforts. Prepare to elevate your testing strategy and learn why quality should be the focus rather than just hitting metrics. Tune in as we explore practical insights and real-life experiences that will empower you to enhance the success of your automation testing projects!

In today's episode, we are excited to feature the incredible insights of Bas Dijkstra, an independent test automation consultant and trainer with a wealth of experience spanning 17 years in the field. Bas joins us to share his journey in developing restassured.net, a much-needed library for HTTP API testing in C#, inspired by his fondness for RestAssured and its absence in the C# arena. We'll explore not just Bas's innovations but his comprehensive take on the evolution of API testing, spotlighting the persistent issue of superficial testing due to various industry pressures and the triumphs of more accessible tooling. We'll explore why Bas favors code-based solutions like RestAssured.Net for scaling and integration over tools like Postman regarding API testing. Furthermore, Bas will shed light on the rising interest in Playwright – a modern automation tool he believes overcomes many of the limitations of Selenium through features like auto-waiting and synchronization. We'll delve into the importance of context when selecting testing tools and why Bas advocates for workshop-based learning as a practical and empowering approach to introduce teams to Playwright. So, whether you're a seasoned professional or new to the field, join us to delve into the ever-evolving landscape of testing automation. Discover practical skills and mindsets to elevate your testing strategies. This is the TestGuild Automation Podcast, and today's episode is a must-listen for all testing professionals!

Today, we're diving into the future of user story optimization and the art of turning those stories into actionable tests. Today, we have the privilege of being joined by Scott Aziz, the visionary founder of AgileAI Labs and a renowned BDD expert. We are also accompanied by John Smart, the creator of the Serenity framework, whose expertise in BDD is unparalleled. Together, we will delve into the powerful capabilities of the new AI tool Spec2test. Imagine a tool so refined that it not only assesses your user stories for ambiguities using an intricate 7-point framework but also offers AI-generated suggestions to enhance them. That's not all; Scott Aziz and BDD expert John Smart join us to discuss how Spec2test fosters essential iterative collaboration, paving the way for crisp, clear requirements and generating corresponding test cases right from the get-go. This is not just about meeting the standards of behavior-driven development; it's about exceeding them. With the tool's dual-edged sword of user story analysis and sophisticated testing capabilities—spanning functional test cases to security testing advice—you're getting a comprehensive suite that breathes life into automation. Surprised by AI's prowess in reshaping agile teams' productivity, our guests reveal how Spec2test is a co-pilot in requirements discovery. For enthusiasts who want a taste of its power, a visual demonstration or free trial could be your gateway to appreciating its full potential. So, gear up for an illuminating session on bringing precision and collaboration to the forefront of your testing strategies -- listen up!

I'm thrilled to have two titans in software testing, Matt Heusser and Michael Larsen, with us today. These veterans, with their wealth of experience and knowledge, are here to discuss their latest contribution to the testing community, their new book, "Software Testing Strategies." In today's episode, we will unpack the inspiration behind "Software Testing Strategies," exploring the trio of testing essentials: skills, strategy, and the nuances of day-to-day operations, including the politics that intertwine with the testing process. The authors will discuss their approach to addressing the complexities of software testing, finding the most effective tests among endless possibilities, and how their book aims to guide you through these challenges. Matt and Michael will also share critical insights into organizational dynamics, the value of adaptability in the testing realm, and the ethical considerations professionals face in their careers. Plus, we'll touch on the difficult journey of updating outdated systems, navigating the minefield of communication, and why terms like "QA" may need a rethink. Listeners, you're in for a treat, with real-world stories, practical advice, and invaluable expertise that's just a discount code away – so stay tuned as we dive into the world of "Software Testing Strategies" on the TestGuild Automation Podcast.

Today's special episode, "Robocon Recapp," is about the insights and highlights from Robocon 2024. We are privileged to have Tatu Aalto, a renowned maintainer of the browser library; Frank Van der Kuur, a distinguished Robot Framework trainer from BQA; and Mark Moberts, a well-known figure in the Robot Framework community, with us. In this episode, our guests will explore the enriching experiences of the conference—from the unveiling of the Market Square to the engaging sessions that sparked valuable discussions. We will explore the myriad contributions beyond programming, including documentation, testing, and being an active voice in the community through forums like the RobotFramework Slack channel. Throughout the Robocon, the spirit of collaboration and knowledge exchange was not just evident. Still, it was the driving force - whether it was addressing pitfalls in the framework, swapping tips on finding the right testing library, or even discussing Frank's and Tatu's interactive sessions that went beyond expectations with engaging questions and the impact they left on the audience. Get ready to be immersed in a conversation that not only recaps the energy and learning from Robocon but also showcases how the Robot Framework community is driving the future of test automation. So plug in as we dive into everything Robot Framework with insights from the experts at the forefront of the automation world. Listen up!

Today, we're diving deep into the world of automation testing, with a special focus on Netflix's innovative tool, SafeTest. Joining us is Moshe Kolodny, the senior full-stack engineer at Netflix who is behind this exciting new tool, which is bridging the gap between end-to-end and unit testing. SafeTest, a tool that's been making significant strides in the industry, has garnered widespread community support and impressive traction in a remarkably short time. As we delve into its capabilities, we'll discover how SafeTest seamlessly integrates with popular libraries like Playwright and Jest, offering robust testing capabilities without imposing intrusive dependencies. Moshe will delve into the philosophy behind SafeTest, underlining the importance of practical, iterative test writing and the pitfalls of over-engineering. We'll explore SafeTest's adaptability, which ensures test consistency across environments with Docker mode, and the bidirectional communication it enables between browser and Node.js, enhancing the overall testing experience. Our conversation will shed light on the exciting future of SafeTest, from potential additions to the test runner to the introduction of custom reporting features. Moshe will also underscore the tool's commitment to developer experience, exemplified by SafeTest's debugging aids like videos and trace viewers. It's no secret that SafeTest reflects Netflix's robust approach to quality assurance. It aligns closely with the day-to-day experiences of UI engineers and addresses the intricate challenges of complex user interactions and service integrations. Stay tuned as we unpack the story of SafeTest's inception, core features, practical applications, and why Moshe believes it's a versatile choice for most testing scenarios.

In this episode, we're diving deep into the world of performance engineering with our esteemed guest, Dylan van Iersel, an experienced IT consultant and co-founder of Perfana. We'll explore the intricate relationship between software performance and business outcomes and how tools like Perfana can democratize and simplify the process of performance testing. Performance is more than just a technical concern; it has direct implications for customer satisfaction and the bottom line. Dylan illuminates the importance of integrating performance testing within the CI/CD pipeline, using Perfana to serve as a quality gate and provide actionable insights through automated analysis and dashboard visualizations. We'll also discuss the evolution of performance engineering in a cloud-native, containerized landscape, the challenges of scaling performance testing across agile teams, and why the "shift left" approach in identifying issues early is crucial for today's development processes. For teams looking to embrace performance testing, Dylan introduces Perfana's starter package and emphasizes the ease of getting up and running, even on a local laptop, as a foundation for more extensive integration into test environments and CI/CD pipelines. For our listeners interested in cutting-edge developments, we dive into how Perfana innovates with data science and machine learning to enhance anomaly detection and root cause analysis. Plus, we'll get into the nitty-gritty of why observability, while important, shouldn't be your sole resource for performance testing. Listen to discover actionable advice and insights on improving your team's performance engineering efforts if you want to learn more about Perfana to try their free trial now!

In this episode, Dave Piacente, a senior community manager in developer relations and community expert at Applitools, joins us to talk about redefining test automation. There are a common set of techniques seasoned test automation practitioners know to be the pillars of any successful automated testing practice that can fit into most (if not all) team contexts. But some things have either been left out or are described in ways that are disadvantageous for the industry simply because we need to talk about it from the perspective of the fundamentals used to craft them. By reasoning from first principles, we can unearth a more impactful definition of test automation that can act as a compass and help supercharge everyone's test automation practice - while also understanding how to navigate the uncharted waters of new technologies that challenge existing paradigms.

In this episode of the TestGuild Automation Podcast, host Joe Colantonio speaks with Shubham Jain, the maintainer of Keploy, an API testing platform. Shubham shares insights into creating testing magic with zero code using Keploy, a tool that captures live traffic and generates test cases and data mocks for efficient API testing. Shubham shares features of Keploy's integration with the software development life cycle and its potential use cases. Shubham also delves into the open-source community for Keploy, providing tips for contributors and sharing information about upcoming events for those interested in learning more. Listen in to discover valuable advice for improving your mocking and automation testing efforts, emphasizing the importance of realistic mocks that capture real behavior.

Today's topic dives deep into the innovative world of AI in software testing with our distinguished guests, Guy Arieli and Tal Barmeir. With years of experience in the testing domain, they've pioneered a groundbreaking automation solution using AI to bolster the efficiency and effectiveness of testers around the globe. We'll unpack the power of Blinqio, a cutting-edge SaaS offering that revolutionizes the way testers work. Also, learn how Blinqio's virtual testers translate scenarios into test automation code, supporting a high-speed software release process across multiple languages and platforms. Guy and Tal will shed light on the remarkable capabilities of their AI system, which not only adapts to changes but also pinpoints and fixes minor issues, saving testers from tedious tasks and last-minute hassles. Listen in to discover how generative AI can generate tests for API and UI, enhance documentation, and even test as humans would – pushing the boundaries of automated testing. We'll delve into the intricate process, from test data generation to the AI's unique ability to operate with or without prior product knowledge, catering to diverse testing expertise levels. Check it out for yourself now: https://links.testguild.com/blinq