AI Infrastructure

To get to the benefits that AI offers, organizations have to address their technology infrastructure in ways that are much broader than historical approaches. Senior analyst Greg Macatee joins host Eric Hanselman to delve into what’s required and what enterprises are identifying in the recent Voice of the Enterprise AI and Machine Learning study. Enterprises are struggling with raising the success levels of AI projects. Over 60% report moderate to severe challenges in achieving AI success. Bringing together the computational power and the right quality data in the right locations can be complicated in the hybrid environments that more are operating. It’s not just a matter of being more selective with use cases, AI requires a set of organizational skills that have to be honed. Starting small and iterating can reduce risk while building competency.  Infrastructure has to shift in new ways, as well. Data management processes that can build the necessary data pipelines to feed AI applications bring together a broader set of tech disciplines. There are new wrinkles in AI infrastructure ecosystems, with new providers looking to address supply chain constraints, like the Neocloud or GPU as a Service  (GPUaaS) providers. Even hyperscalers are looking to them to meet surging demand in a tight market. Those new options offer new choices, but enterprises need to match them with their AI goals. More S&P Global Content: Navigating the AI infrastructure landscape The path from LLMs to agentic AI Next in Tech | Ep. 225: Security for MCP For S&P Global Subscribers: AI infrastructure strategies evolve amid widespread data challenges – Highlights from VotE: AI & Machine Learning Generative AI Market Monitor & Forecast AI infrastructure: Trends, thoughts and a 2025 research agenda Credits: Host/Author: Eric Hanselman Guest: Greg Macatee Producer/Editor: Adam Kovalsky Published With Assistance From: Sophie Carr, Feranmi Adeoshun, Kyra Smith

The annual gathering on infrastructure virtualization that is the VMware by Broadcom Explore conference has wrapped up and there are important takeaways from both the formal program and informal discussions. Analysts Jean Atelsek, Henry Baltazar and William Fellows join host Eric Hanselman to talk about their takes on the event. The newly integrated VMware Cloud Foundation 9.0 (VCF) suite has shipped and along with it a new approach to the product portfolio. AI-focused capabilities have been added as VMware aims to create a private cloud portfolio to rival the public cloud offerings. Higher level data services are the first service abstractions available, with the promise of more to come. In the new organizational structure, the Tanzu product offering is now in its own division in Broadcom. While that offers it independence, it’s also meant that in areas like AI functionality, there is some overlap between it and AI capabilities being built into VCF 9. The larger challenge for Broadcom is to motivate customers to fully implement VCF 9 and put all of its capabilities to work. More S&P Global Content: Next in Tech | Ep. 222: FinOps – Managing Cloud and AI Costs Next in Tech | Ep. 214: KubeCon and Cloud Native Next in Tech | Ep. 183: Exploring Broadcom VMware For S&P Global Subscribers: VMware Cloud Foundation 9.0 manifests Broadcom's vision for modern private cloud VMware Tanzu enhances support for generative AI and agents with Tanzu AI Solutions VMware remains dominant as organizations evaluate alternative virtualization technologies Credits: Host/Author: Eric Hanselman Guest: Jean Atelsek, Henry Baltazar, William Fellows Producer/Editor: Adam Kovalsky Published With Assistance From: Sophie Carr, Feranmi Adeoshun, Kyra Smith

Can you have too much data for an AI application? In the mad dash to collect the raw material for AI applications, it can be tempting to pull in as much as you can. Product manager Emily Jasper returns to the podcast with a set of recommendations for more strategic use of data with host Eric Hanselman. Just as it might not be wise to load up on everything on a buffet, being strategic about using the data that best suits the goals of your project can improve outcomes and help to manage risk. By understanding the data that you’re putting to work, you can bound the universe of outcomes and simplify the process of bringing it into the AI application pipeline. At the same time, the process of data governance becomes clearer when the sources are better understood.  Bringing an understanding of the set of data resources that an enterprise has is critical and has to be accompanied by knowledge of the quality of that data. The principles of library sciences are back in focus in AI, as organizations work to curate data characteristics and provenance. As in so much of AI, matching the ecosystem of tools, data providers, and capabilities to the use cases being built is fundamental to project success. Managing risk in AI has become a process of bringing the right data to the right problem. More S&P Global Content: The path from LLMs to agentic AI Next in Tech | Ep. 224: Context Around MCP Next in Tech | Ep. 225: Security for MCP For S&P Global Subscribers: Data Management Market Monitor & Forecast Automation pervades data management practices – Highlights from VotE: Data & Analytics Technology Primer: Model Context Protocol explained The evolution of agentic process automation: Midyear market and technology update Pace of AI agent advancement could spur M&A in the sales automation market Credits: Host/Author: Eric Hanselman Guest: Emily Jasper Producer/Editor: Adam Kovalsky Published With Assistance From: Sophie Carr, Feranmi Adeoshun, Kyra Smith

The typical process of deploying technology has been one of enterprises designing infrastructure around vendor capabilities. The Open Networking Users Group (ONUG) was founded to reverse that equation and define enterprise requirements for technology and work with vendors to achieve them. Co-founder Nick Lippis joins host Eric Hanselman to talk about the approach that ONUG takes, the nature of its community and the work that they’re doing today. While their roots are in the networking world, they’ve expanded to address a wide range of enterprise concerns. The current collaborations include security related work in cloud and security operations automation, WAN connectivity and a reference architecture for AI infrastructure. The ONUG fall conference takes place in New York on October 22-23. More S&P Global Content: The ONUG fall conference The path from LLMs to agentic AI Next in Tech | Ep. 225: Security for MCP For S&P Global Subscribers: The evolution of agentic process automation: Midyear market and technology update Pace of AI agent advancement could spur M&A in the sales automation market 2025 will be pivotal for network APIs – Highlights from Communication and Network APIs Global Survey 2024 Use of open-source software driven by reliability, low cost – Highlights from VotE: DevOps Glimpses of cybersecurity talent development: Industry and community Credits: Host/Author: Eric Hanselman Guest: Nick Lippis, ONUG co-founder Producer/Editor: Adam Kovalsky Published With Assistance From: Sophie Carr, Feranmi Adeoshun, Kyra Smith

The annual “security summer camp” that is made up of the Black Hat and DefCon conferences is just past and the security analyst team, Scott Crawford, Dan Kennedy, Justin Lam and Mark Ehr, join host Eric Hanselman to examine what they saw and discuss the implications. Despite the heat of a Las Vegas summer, it’s become bigger than the two main conferences, with a number of side events, like B-Sides, there’s a lot going on. AI conversations are evolving and maturing. We’ve mostly moved beyond blaming user foibles for breaches, but AI is expanding the attack surface with new and more complex tactics for user manipulation. AI is lowering the barriers for attackers. The days of script kiddies have morphed into Claude Code-fueled attack development. The larger question is how security vendors are responding to AI risks. Claims that tier 1 security analysts should start looking for another job just seem irresponsible in the current environment. AI augmentation can reduce toil and digest the masses of events that security teams struggle to deal with today. At the same time, AI is scaling attack volumes. It’s the constant hegemony that’s always played out at the core of security. More S&P Global Content: RSAC Conference 2025: Breaking records at the threshold of uncertainty AI for security: Agentic AI will be a focus for security operations in 2025 Next in Tech | Ep. 215: RSA Conference Preview Deep Pocket Inspection: RSAC Innovation Sandbox Retrospective & Perspective Next in Tech | Ep. 227: Managed Security Services Next in Tech | Ep. 225: Security for MCP For S&P Global Subscribers: Use of GenAI security solutions has spiked, continued uptake projected – Highlights from VotE: Information Security Infosec spending projected to rise 27% on average in 2025 – Highlights from VotE: Information Security CNAPP in focus after large infosec acquisition – Highlights from VotE: Information Security Data Insight: Data security market to top $26B in 2029 Data Security Market Monitor & Forecast CNAPP matures into full-spectrum security solution Credits: Host/Author: Eric Hanselman Guests: Scott Crawford, Dan Kennedy, Justin Lam, Mark Ehr Producer/Editor: Adam Kovalsky Published With Assistance From: Sophie Carr, Feranmi Adeoshun, Kyra Smith

The FinTech market has seen considerable upheaval in activity and valuations. But spring may be coming to the funding winter that FinTech has seen and Jordan McKee and Sampath Sharma return to examine the green shoots with host Eric Hanselman. Data platforms, payment rails and insurance tech are seeing renewed interest, while riskier areas, like lending, are not seeing the same focus. FinTech companies are looking at addressing infrastructure and process challenges faced by the banking sector as they transition to the world of instant payments.  Interest in cryptocurrency is roaring back, particularly in stablecoins. The U.S. GENIUS Act has delivered a framework for their use and opened the door to new experimentation. It’s another area where FinTech’s have an infrastructure opportunity, as a number of FinTech companies already have stablecoin experience and can put it to work for their banking partners. All of this and more will also be on the agenda for the upcoming Banking Infrastructure Modernization webinar at the link below. More S&P Global Content: Upcoming FinTech Webinar: Banking Infrastructure Modernization: Building for Instant Payments Money20/20 Europe 2025: Key trends and developments National Retail Federation looks to revitalize the modern commerce experience Fintech funding falls 42% to $35B in 2023, but downturn may be nearing end For S&P Global Subscribers: Tech Trend in Focus: Payment orchestration Cross-border payments, stablecoins generate buzz at a low-key Money20/20 Asia Real-time payments, stablecoins draw VC attention in Q3 2024 fintech funding 2025 Trends in Fintech Credits: Host/Author: Eric Hanselman Guests: Jordan McKee, Sampath Sharma Producer/Editor: Adam Kovalsky Published With Assistance From: Sophie Carr, Feranmi Adeoshun, Kyra Smith

While advertising is a fundamental part of business, the creator economy has become a fundamental part of advertising. Analyst Zach Ciampa joins host Eric Hanselman to explore the many facets of which it’s composed and look at the market impacts. Businesses are working to balance the mix of paid, earned and owned content that they’re putting to work to establish, guide and strengthen their brands. The process of influencing buying behavior and brand loyalty and the media mix as part of it continues to evolve. While TikTok may be the view that many have of user generated content (UGC), it’s a much richer palette that businesses can use. Social media has become a large part of advertising, in no small part because of the allure of virality. But is this just gambling on an outcome? The human connection of social media and its people-first nature can have great power, but can be challenging to manage. Technology is being thrown at it in various forms, from influencer management platforms, to agency-driven tech M&A. AI has a role to play, but the human aspect is often the most powerful.  More S&P Global Content: Next in Tech | Ep. 228: Advertising and Tech National Retail Federation looks to revitalize the modern commerce experience Kagan Media and Telecom Summit For S&P Global Subscribers: Payments composability, optimization and resilience are top merchant priorities – Highlights from VotE: Customer Experience & Commerce Technology Primer: Building the digital foundation for retail transformation Convenience, flexibility, speed drive consumer behavior – Highlights from VoCUL: Connected Customer Key takeaways from Shoptalk Spring 2025 Credits:  Host/Author: Eric Hanselman Guests: Zach Ciampa Producer/Editor: Adam Kovalsky Published With Assistance From: Sophie Carr, Feranmi Adeoshun, Kyra Smith

Advertising is fundamental part of business and it’s one that has been buffeted by the impacts of technology in both the path to markets and the management of its delivery. Creating a brand reputation and influencing consumers is the core function and analyst Natalie Colakides and Ian Whittaker, managing director of Liberty Sky Advisors, join host Eric Hanselman to discuss the nuances of advertising and technology’s evolution around it. Shifts in media have had a profound effect - the reach of linear television media has decreased significantly, while digital advertising options have expanded. Businesses are looking to blend linear and streaming advertising, but it can be complex to make an effective distinction. There is significant global variation in media consumption and advertising potential. While the UK was the first market where digital spending overtook traditional, the European market is diverging from patterns in the U.S.. Many businesses are looking to AdTech to make the process more efficient, but there are limits its capabilities. Agencies still have a significant role to play, but the advertising buying and planning that has been a big part of their business could be under threat from advances delivered by AI. Enterprises have a lot to wrestle with, but they need to keep focused on the fundamental task of winning hearts and minds.   More S&P Global Content: Kagan Media and Telecom Summit event link   For S&P Global subscribers: Big Four ad agencies see mixed results due to macro uncertainty A sneak preview of the Kagan Media & Telecom Summit 2025 See it in charts: TV Networks, June 2025   Credits: Host/Author: Eric Hanselman Guests: Natalie Colakides, Ian Whittaker Producer/Editor: Adam Kovalsky Published With Assistance From: Sophie Carr, Feranmi Adeoshun, Kyra Smith

Effective security management has never been simple and the expanded threat landscape enhanced by AI has only widened the gap between defenders and attackers. Scott Crawford and Greg Zwakman return to discuss the managed security services market with host Eric Hanselman. Security services have been an option for enterprises since the earliest days of IT, but the need for more depth and breadth in security operations has changed market dynamics and the enterprise security calculus. Part of this shift is driven by the scope and scale of security operations. Expanded attack surfaces with more devices, more SaaS applications and hybrid infrastructure can be all the more difficult to secure. Integrated security operations patterns, like Managed Detection and Response (MDR) can provide more comprehensive services and ones that are targeted at delivering improved security outcomes, rather than just operational support. Changing security requirements are driving M&A activity, as well. Where services had been an augmentation to vendor products, some vendors now see them as a critical part of their portfolio and a key to platform aspirations. Zscaler’s acquisition of Red Canary and Sophos’ pick up of SecureWorks are some of the more notable transactions in this trend. Security management has shifted front of security markets. More S&P Global Content: AI for security: Agentic AI will be a focus for security operations in 2025 The evolution of security platforms – 6 centers of gravity shaping the market For S&P Global subscribers: Managed Security Services Market Monitor & Forecast For sale: MDR vendors 2025 Trends in Information Security Ending SecureWorks' search for a suitor, Sophos takes it off Dell's hands Zscaler expands its platform play into a new market by reaching for Red Canary Credits: Host/Author: Eric Hanselman Guests: Scott Crawford, Greg Zwakman Producer/Editor: Adam Kovalsky Published With Assistance From: Sophie Carr, Feranmi Adeoshun, Kyra Smith

The annual Kagan Media and Telecom Summit in New York is in the books and it not only covered a lot of market activity, but it was also surrounded by a number of media and sports rights headlines. Justin Nielson, Eric Keith, Scott Robson and Seth Shafer joined host Eric Hanselman to look at what was covered in the expansive event and the time around it. There were big shifts in media rights and a couple of sports team sales that led to lively discussions. Networks are balking at some of the lofty prices for sports media rights in the face of streaming services’ higher demand. The realignment of regional sports coverage is still shaking out, as well. Media consolidation keeps hovering, but will it always be next year’s prospect? Macroeconomic uncertainty seems to be playing a role and the pendulum on cord cutting seems to be swinging back around. In broadband, the reset of the BEAD program has states scrambling to reapply under the new, much tighter deadline. Will this drive fixed wireless access (FWA)? Satellite is still a possibility in remote regions, but costs may hold it back. Private equity activity in fiber networks could be reaching a tipping point, as their investments mature and operators’ partners shift strategies. There was a lot in store and much more to come. More S&P Global Content: Kagan Media and Telecom Summit event link For S&P Global subscribers: A sneak preview of the Kagan Media & Telecom Summit 2025 See it in charts: TV Networks, June 2025 Comcast strikes sports network deal; Streaming services expand sports viewing New media rights deal a slam dunk for the NBA Kagan Media & Telecom Summit 2025: Broadband panel discussion Credits: Host/Author: Eric Hanselman Guests: Justin Nielson, Erik Keith, Scott Robson, Seth Shafer Producer/Editor: Adam Kovalsky Published With Assistance From: Sophie Carr, Feranmi Adeoshun, Kyra Smith