Erik Darling: Database Technical Debt - Episode 315

David Fowler is a Distinguished Engineer and has been at Microsoft for over 16 years working on developer frameworks and tools in the .NET space. He’s one of the creators of several popular OSS frameworks and tools such as .NET Aspire, NuGet, SignalR, and ASP.NET Core. He also architected the Azure SignalR Service, a service for doing real-time WebSocket-based communication at scale. He’s an avid open-source advocate and developer currently focused on simplifying developer experiences in the microservice space. David is also passionate about mentoring, supporting individual contributors in their careers, and helping underrepresented folks get interested in technology.   Topics of Discussion: [3:14] David’s career journey. [4:28] Development of.NET Aspire. [6:47] Evolution of front-end and back-end architectures. [13:27] Challenges and Improvements in.NET Aspire. [19:08] The set of resources they chose to start with. [21:48] The Infrastructure Library. [25:23] The potential for creating templates to streamline the bootstrapping process for teams and projects. [28:58] Does Azure API include networking in the firewall rules? [31:52] What are the things David is most excited about with DevStory? [32:3] The “wait for” feature. [38:03] The complexity of implementing health checks. [44:53] What is Dapper? [44:01] Future Vision for.NET Aspire.   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at [email protected]. Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! David Fowler GitHub David on LinkedIn David Fowler Microsoft David Fowler, Author at .NET Blog Azure Provisioning 3.0 GitHub NET Aspire Overview .NET Conf2024   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

Bob Ward is a Principal Architect for the Microsoft Azure Data team, which owns the development for Microsoft SQL Edge to Cloud. Bob has worked for Microsoft for 30-plus years on every version of SQL Server shipped from OS/2 1.1 to SQL Server 2022, including Azure SQL. Bob is a well-known speaker on SQL Server, Azure SQL, AI, and Microsoft Fabric, often presenting talks on new releases, internals, and specialized topics at events such as SQLBits, Microsoft Build, Microsoft Ignite, PASS Summit, DevIntersection, and VS Live. You can also learn Azure SQL from him on the popular series aka.ms/azuresql4beginners. You can follow him at @bobwardms or linkedin.com/in/bobwardms. Bob is the author of the books Pro SQL Server on Linux, SQL Server 2019 Revealed, Azure SQL Revealed, and SQL Server 2022 Revealed, available from Apress Media.   Topics of Discussion: [4:22] Bob’s long history with Microsoft and the evolution of SQL Server. [6:41] What are the big use cases that SQL Server can now do? [7:38] Beyond RDBMS framework. [9:34] Building innovation off an already trusted brand. [9:50] What’s the vision of AI on SQL Server? [10:51] It’s all about smarter searching. [14:26] AI assistance features in SQL Server, such as the SQL Copilot and natural language to SQL query generation. [16:02] Hybrid searching. [19:41] Challenges and opportunities in AI Integration. [20:43] Content moderation is now being added to the loop. [22:39] The categories of different models. [23:16] The potential for industry-specific models to enhance AI capabilities in fields like insurance underwriting. [28:19] Knowing which model to use. [33:17] The trend towards industry-specific training of AI models to better suit specific business needs. [34:07] The current vision for SQL Server. [35:22] Innovating in the cloud. [38:30] The potential for SQL Server to handle AI workloads on small form factors, such as edge devices and standalone boards.   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at [email protected]. Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Ep 162 with Bob Ward Bob on LinkedIn Azure SQL Revealed: The Next-Generation Cloud Database with AI and Microsoft Fabric SQL-AI-Samples Samples Intelligent Applications with Azure SQL Database LangChain   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

Jeff was born and raised in The Netherlands and is an IT geek with a passion for automation. At the young age of 6, he had his very first computer and started developing his own Pacman to learn Batch programming. Looking back, the performance was terrible, but it worked. Over the years, he has always kept in touch with some sort of scripting or programming languages, such as Batch, (Turbo) Pascal, PHP, Delphi, Kixtart, Visual Basic Scripting (VBS), VB .NET, PowerShell, and C# .NET (Core). He is the owner of Methos, a consultancy and managed services company from The Netherlands focused on Microsoft Modern Workplace (Windows + Intune + Office365) and Azure through automation and Infrastructure-as-Code.   Topics of Discussion: [4:19] Jeff’s passion and the three turning points in his career. [8:47] The architecture and intention behind PowerShell being built on .NET. [12:33] What are the biggest mistakes Jeff sees people making when it comes to PowerShell? [11:50] Best practices for using PowerShell in DevOps environments, and common mistakes to avoid. [16:04] Differences between binary and PowerShell-based modules, and the benefits of exploring module code. [18:18] Leveraging .NET code in PowerShell scripts and the advantages of this approach. [20:00] Preferred methods for writing automated tests for PowerShell code. [23:39] Jeff’s current focus areas, including certifications and his upcoming “script portal” project.   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at [email protected]. Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Jeff on Twitter Jeff on LinkedIn Jeff Wouters Methos [email protected]   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

Grant Fritchey has over thirty years of experience in IT, specializing in development and database administration. He works for Red Gate Software as a Product Advocate and writes articles for SQL Server Central and Simple-Talk. He is the author of “SQL Server Execution Plans” and “SQL Server Query Performance Tuning.” He also co-authored “Query Store for SQL Server 2019,” “Expert Performance Indexing,” “SQL Server MVP Deep Dives 2,” “Beginning SQL Server 2012 Administration,” and “Pro SQL Server 2012 Practices.”   He presents at conferences and user groups worldwide and is available for part-time, short-term consulting contracts.Since 2009, he has been recognized as a Microsoft SQL Server MVP. He has received the AWS Community Builder award for the past five years. In 2014, he was honored as a Dunn & Bradstreet MVP, and in 2011, he received the Tech10 Award in Rhode Island.   Topics of Discussion: [:35] Introduction of Grant Fritchey and his career in IT and database administration. [3:23] Grant’s journey from software development to becoming a DBA. [5:13] The importance of database selection and how different types of databases serve different needs. [11:27] Grant’s view on the addition of document support to major database platforms. [13:29] Database hygiene basics and the importance of regular backups and restore practices. [19:26] The business side of database recovery and balancing cost with recovery objectives (RPO/RTO). [25:03] Grant’s recommendations for testing database restores. [28:08] Automation in DevOps and the importance of human training in recovery processes. [31:53] Managing data warehouses and recovery strategies for large databases. [35:12] Resources for developers without dedicated DBAs to ensure good database hygiene.   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at [email protected]. Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! SimpleTalk by Redgate ScaryDBA.com Grant Fritchey on X   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

Dave was a developer or development manager on each of the major operating systems from MS-DOS 6.2 through Server 2003 while at Microsoft from 1993 to 2003.   He’s worked on MS-DOS products, OLE objects, Win95, Windows NT, and the NT Pinball game. He also wrote and helped design the initial prototype of Windows Media Center. Dave also added Product Activation to the Windows platform including various anti-tampering mechanisms to prevent illegal copying of the product. He’s also worked on Task Manager, Zip Folders, and Calculator as he focused on the Windows Shell. He currently runs a very popular online show called Dave’s Garage on YouTube, where he demystifies various software engineering topics.   Topics of Discussion: [:35] Introduction of Dave, his background, and his career at Microsoft. [3:47] Dave’s experience at Microsoft in the 1990s: the environment, culture, and working with some of the best developers in the world. [5:19] What led Dave to work on the Windows shell and user interface development. [7:38] The challenges of porting code from Windows 95 to Windows NT and working with operating system differences. [9:25] Dave’s work on Task Manager, Zip Folders, and Windows Media Center. [13:23] The state of software engineering today: Dave’s take on modern systems, embedded programming, and the rise of AI. [14:34] Embedded systems programming: Dave’s work with ESP32 chips, their features, and applications. [19:16] Thoughts on AI and its impact on software development: Will AI eventually write all the code? [21:14] The future of software engineering: How AI will change the role of developers and the need for debugging and architectural understanding. [22:47] Dave’s advice for young programmers: Learning C++, Python, and the importance of understanding system architecture.   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at [email protected]. Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Github Dave Plummer Dave Plummer on X Dave’s Garage You Can Learn the ESP32 World! Source Level Debugging NEW LED Project Programming the ESP32 From Scratch   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

Jeff is the co-creator of Scrum and a leading expert on how the framework has evolved to meet the needs of today’s business. The framework he developed in 1993 and formalized in 1995 with Ken Schwaber has since been adopted by the vast majority of software development companies around the world. However, Jeff realized that the benefits of Scrum are not limited to software and product development. He has adapted this successful strategy for several other industries, including finance, healthcare, higher education, and telecom.   As the CEO of Scrum Inc., Jeff sets the vision for success with Scrum. He continues to share best practices with organizations around the globe and has written extensively on Scrum rules and methods. With a deep understanding of business processes — gleaned from years as CTO/CEO of eleven different software companies — Jeff is able to describe the high-level organizational benefits of Scrum and what it takes to create hyperproductive teams.   Topics of Discussion: [:35] Introduction of Jeff Sutherland, co-creator of Scrum. [3:47] Jeff Sutherland’s background: His experience at West Point and lessons in making work visible. [5:19] Fighter pilot experiences that influenced the operational side of Scrum. [6:02] Transition to the Air Force Academy and work in AI at Stanford. [7:38] Learning complex adaptive systems and the origin of Agile from complex systems theory. [8:30] How complex systems theory impacts Scrum and Agile teams today. [9:25] Jeff’s first experiences applying Scrum in the banking industry. [11:25] The development of Scrum and the 2001 Agile Manifesto. [12:57] Making work visible and organizing teams, from West Point to Toyota to the Agile Manifesto. [13:23] Fast forward to 2024: Issues in Scrum and Agile practices, including sprint lengths and backlog grooming. [14:34] Jeff’s new book: First Principles in Scrum and its relation to Scrum technology stacks. [16:23] Building autonomous systems: Lessons from radiation physics, AI, and complex adaptive systems. [19:16] The influence of autonomous robots on the creation of Scrum. [21:14] Discussion of Scrum and AI, leading to “Extreme Agile.” [22:47] Predictions for the future of Scrum and Agile: Teams becoming 30 to 100 times faster by 2030. [23:37] Example of AI in action: Developing a system to handle expense reports using Scrum principles. [29:37] Challenges with AI-generated code and the need for strong software architecture knowledge. [33:24] The importance of following Scrum “by the book” to achieve hyperproductivity. [35:30] Jeff’s closing advice on adapting to extreme agile to stay competitive by 2030.   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at [email protected]. Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! How the Agile Manifesto Came To Be   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

Ryan Riley is a Principal Software Engineer at Wise Rock in Houston, TX. He enjoys learning and collaborating on simple, creative solutions to problems, and implementing those solutions with others through teamwork, training, and mentoring. He has worked as a Solution Architect and Team Lead for local and remote teams, focusing on front-end UX and back-end, distributed applications and APIs to delight customers across many industries.   Topics of Discussion: [:36] Intro to Ryan and his experience in software engineering leadership. [4:10] Ryan’s early career journey and transition from the .com bubble to software development. [6:17] How Ryan stepped into leadership roles through initiative and team collaboration. [8:40] Balancing hands-on coding with team leadership in a long-term software engineering career. [12:10] The importance of experience and technical knowledge for effective leadership in development teams. [14:27] Empowering team members to lead projects and grow their skill sets. [18:15] Key non-negotiables for young developers, including pull requests, testing, and small commits. [21:28] Architectural patterns Ryan favors, like JSON APIs and balancing between monoliths and microservices. [28:55] Key strategies for supporting software in production and ensuring stability. [34:41] Challenges of cloud costs and performance and the importance of managing resources efficiently.   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at [email protected]. Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Panes of Glass Wizards of Smart James Riley   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

Erik Darling makes your database faster in exchange for money. He is a DBA, developer, and architect with a track record of tackling even the most challenging technical issues. He runs a SQL Server Consulting and Coaching practice. In addition to his consulting services, he is also passionate about blogging, training, and contributing to open-source projects that help with SQL Server troubleshooting. He's given many public speaking engagements on the topic at conferences and events around the world, like PASS Summit and SQLBits.   Topics of Discussion: [2:57] Eric's journey into SQL Server and database performance tuning. [4:25] Challenges faced in early SQL Server work and evolving technical debt. [7:47] The standard problems with databases over time. [11:14] How technical debt shows up in SQL Server databases. [15:20] How abstraction layers like ORMs contribute to technical debt. [22:38] Performance issues as a result of technical debt in databases. [25:19] Key advice on database schema design to improve performance. [30:46] Key differences between Azure SQL DB and managed instances. [37:23] Staffing challenges and solutions for managing SQL Server environments.   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at [email protected]. Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Darling Data Darling Data on X Erik Darling Darling Data on LinkedIn Darling Data on TikTok   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

Kent Beck is an original signer of the Agile Manifesto, author of the Extreme Programming book series, rediscoverer of Test-Driven Development, and an inspiring Keynote Speaker. I read his TDD book 20 years ago.   Topics of Discussion: [3:46] What led Kent to extreme programming? [7:52] What critical practices have stood the test of time? [10:58] The role of software design in Agile Development. [13:11] The inspiration behind Tidy First? [16:16] Why software design is both a critical skill and an exercise in human relationships. [22:05] What is “normalizing symmetry”? [25:04] Empirical design. [28:09] Design changes tend to be reversible. [30:41] Experimentation with the GPT phase of AI on publications. [35:13] Advice for young developers and programmers.   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at [email protected]. Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! KentBeck.com Tidy First? Test-Driven Development Extreme Programming Explained Implementation Patterns   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

Matt is a Microsoft Data Platform MVP and has worked with SQL Server since 2000. He is the leader of the Lexington, KY Data Technology Group and a frequent domestic and international community speaker. He's an IDERA ACE alumnus and Redgate Community Ambassador. His original data professional role was in database development, which quickly evolved into query tuning work that further evolved into being a DBA in the healthcare realm. He has supported several critical systems utilizing SQL Server and managed dozens of live site SQL Server implementations. As a Microsoft Lead Data Architect at Centric Consulting, he works with customers large, medium, and small to migrate to the cloud, make their data estate operate efficiently, and find the right tools and solutions within the Microsoft Data Platform.   Topics of Discussion: [3:08] Matt’s career journey and overcoming a fear of public speaking. [5:42] Changes and consistencies in working with SQL Server over the years. [7:18] Advice on the process and tools for database change management and DevOps. [12:29] Recommendations for database monitoring and observability. [19:30] Specific monitoring tool recommendations and their pros and cons. [24:04] The role of ORMs and their impact on database performance. [30:59] Thoughts on the evolution of microservices and database architecture patterns. [36:55] Considerations for working with small versus large database sizes.   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at [email protected]. Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! SQLBITS Author Matt Gordon Matt Gordon Microsoft Page Matt Gordon on LinkedIn Racing FivecoRacing IG   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.