The Cloudcast #852 - Slow Data, Fast Data and Adapting AI models for your business

Jay Madheswaran (Founder & CEO @ Eve) talks about bringing AI to the legal vertical and the intersection of AI/ML of increased efficiency for legal firms.SHOW: 857SHOW TRANSCRIPT: The Cloudcast #857 TranscriptSHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwNEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS"SHOW NOTES:Eve HomepageTopic 1 - Welcome to the show. Before we jump into the legal industry and AI, let’s talk a little bit about your background. Give everyone a brief introduction.Topic 2 - What made you focus on the legal industry? When I think of forward leaning industries that quickly adopt new technologies, I don’t think of legal. What are the most common use cases?Topic 3 - Tell us a little bit about the tech behind the scenes. Do you use foundational models and then fine-tune them? Do you have your own custom models? What are your thoughts on the current state and future of models for specific industries or verticals?Topic 4 - Legal is a highly regulated space; how do your customers (law firms) think about data security and compliance? Tell everyone a bit about how all of this works.Topic 5 - Do your clients use RAG for custom information that needs to be brought into the models? How does all of that work for customer data?Topic 6 - When I think about legal, I think about two big areas. We covered compliance and the financial side of this, but what about the billing and financial side? How is ROI on legal AI calculated? Where and how does a legal AI help? Is this measured in hours saved, which translates into dollars saved?Topic 7 - Let’s close by discussing the people aspect. We keep hearing AI is going to take everyone’s jobs away. What are your thoughts on how this supplements vs. replace staff?FEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod

Back from some recent travel, we look at why it’s important to listen to people from around the world to understand the differences between how global regions adopt technology. SHOW: 856SHOW TRANSCRIPT: The Cloudcast #856 TranscriptSHOW VIDEO:  https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK:  http://bit.ly/cloudcast-cnotwCHECK OUT OUR NEW PODCAST:  "CLOUDCAST BASICS"SHOW SPONSOR:Access Gartner cloud research come to life with the “The Future of Cloud in 2028: From Technology to Business Necessity,” webinar.Secure your seat for Gartner IT Infrastructure, Operations & Cloud Strategies Conference 2024 with our early bird savings of $400 off standard rates now.  SHOW NOTES:LARGER FACTORS PLAY A SIGNIFICANT ROLE IN TECHNOLOGY OUTSIDE THE USDiffusion of informationCurrency exchangeGovernment laws, embargoes, tariffsLanguage and timezone differencesLocal culture, norms, expectationsFEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod

Brian Gracely (@bgracely)and Brandon Whichard (@bwhichard) discuss the top stories in Cloud and AI from August 2024.SHOW: 855SHOW TRANSCRIPT: The Cloudcast #855 TranscriptSHOW VIDEO: https://youtube.com/@TheCloudcastNETCLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwNEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS"SHOW NOTES:Link to August 2024 news and articlesSubscribe to Cote's newsletter. SEGMENTS COVERED IN THE SHOW:Good Old Fashioned Cloud NewsThe AI Innovation Continues Trend 1 - What will be the ripple effects of Intel’s struggles?Trend 2 - Is this a bump or a bubble for NVIDIA?Trend 3 - Why do companies have such a hard time with a 2nd act?Trend 4 - Why you should always take the big job if it’s offered to you.  FEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod

The future of search advertising, the future of chips, the future of open source, AI monetization and government regulation of tech are all uncertain. What does that mean for the future?SHOW: 854SHOW TRANSCRIPT: The Cloudcast #854 TranscriptSHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK: http://bit.ly/cloudcast-cnotwCHECK OUT OUR NEW PODCAST:  "CLOUDCAST BASICS"SHOW SPONSOR:Access Gartner cloud research come to life with the “The Future of Cloud in 2028: From Technology to Business Necessity,” webinar.Secure your seat for Gartner IT Infrastructure, Operations & Cloud Strategies Conference 2024 with our early bird savings of $400 off standard rates now.  SHOW NOTES:ARE CORE PILLARS OF THE TECH INDUSTRY UNCERTAIN FOR THE FUTURE?Google and antitrustIntel and chipsOpen source and licensingAI and monetizationGovernments and regulationFEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod

Paul Delory (@pacdelory, Research VP @Gartner_Inc for Technical Professionals) shares insights about cloud computing, cloud costs, VMware, Platform engineering and IaC.SHOW: 853CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwNEW TO CLOUD? CHECK OUT OUR OTHER PODCAST: "CLOUDCAST BASICS" SHOW NOTES:On The CUBE discussing VMware in April: https://www.youtube.com/watch?v=-wIClYI6bDQSoftware Development Times discussion Platform Engineering: https://sdtimes.com/softwaredev/analyst-view-whats-new-whats-now-and-whats-next-in-platform-engineering/Topic 1 - Welcome to the show. Before we jump into a broad set of topics today, give us a little bit about your background and what you focus on today.Topic 2 - The hyperscalers have grown quite large over the last decade, but as we came out of COVID, many of their customers were concerned about the cost of cloud. Are we seeing a new rationalization coming around cloud costs and accountability of costs? Topic 3 - We’ve all read the headlines regarding changes to VMware by Broadcom. Alternatives to VMware would be big decisions for many companies. As a neutral independent, how are you framing your thinking about the VMware ecosystem and the decisions being made about the future of virtualization? Topic 4 - Over the last decade, we’ve seen so many new technologies. To get value from them, they require more cross-functional collaboration. These days we tend to call that Platform Engineering. How well do you see the evolution of people and processes being adopted, and how much more needs to happen?Topic 5 - Behind the scenes of every transition over the past decade (Cloud, AI, Cloud-native) is the adoption of automation. This seems like a no-brainer, but actual adoption is lumpy across companies. What are some of the hard parts of automation that aren’t discussed enough? FEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod

With so much rapid change happening around AI models, is there a framework for when to build models, train models, fine-tune models, use RAG or something else? Let’s explore…SHOW: 852SHOW TRANSCRIPT: The Cloudcast #852 TranscriptSHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK:  http://bit.ly/cloudcast-cnotwCHECK OUT OUR NEW PODCAST:  "CLOUDCAST BASICS"SHOW SPONSOR:Access Gartner cloud research come to life with the “The Future of Cloud in 2028: From Technology to Business Necessity,” webinar.Secure your seat for Gartner IT Infrastructure, Operations & Cloud Strategies Conference 2024 with our early bird savings of $400 off standard rates now.  Upgrade to the next generation of the cloud.  Oracle Cloud InfrastructureSHOW NOTES:What is Retrieval Augmented Generation (RAG)?Fine-Tuning vs. RAGPredictive AI vs. Generative AIAndrew Ng (always worth a watch IMO) https://youtu.be/sal78ACtGTc?si=dCoKXb5o4KB2XSerHarrison Chase (LangChain) https://youtu.be/pBBe1pk8hf4?si=lAit69_pDeRKcBGqhttps://blog.langchain.dev/what-is-a-cognitive-architecture/https://thenewstack.io/lets-get-agentic-langchain-and-llamaindex-talk-ai-agents/https://www.youtube.com/watch?v=N-IYzyi86yYhttps://blog.langchain.dev/what-is-an-agent/https://www.microsoft.com/en-us/research/project/autogen/https://www.crewai.com/ HOW SHOULD WE DECIDE WHICH AI MODEL TO USE FOR OUR APPLICATION?Build, buy, use open source, augment with your own data - so many decisionsHow often do you update models with new data? HOW DO WE BRING OUR COMPANY DATA / KNOWLEDGE TO OUR AI MODELS?Large Static Models - Predictive AILLMs + Slow-Changing Data - Align the ModelLLMs + Fast-Changing Data - RAGLLMs + Agent-Learned Data - Agentic AIFEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod

Emrul Islam (Head of Platform Innovation @TwingateHQ) talks about the evolution of remote access, application security, and enabling DevOps teams to drive security transformation.  SHOW: 851SHOW TRANSCRIPT: The Cloudcast #851 TranscriptCLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwNEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS" SHOW NOTES:How Twingate WorksTwingate vs. VPNsArchitecting Network Connectivity for a Zero Trust FutureSolving the usability problem to unlock Zero Trust adoptionReddit link: https://www.reddit.com/r/twingate/ Signup for Twingate for freeTopic 1 - Welcome to the show. Topic 2 - To properly solve cloud access & security pain points, companies need a tool that works for IT, DevOps, & Security teamsWhat are the challenges when trying to secure cloud access today?What role do each of the stakeholders play in addressing these?How much can technology really help address these challenges?Topic 3 - How is Twingate architected differently to address these new challenges?How do existing systems work?What sort of architecture is required?Topic 4 - Why is it a struggle to get these teams aligned on the right solutionIs there a disconnect between competing requirements and security?Topic 5 - What is the opportunity for Devops teams to influence remote access and security architecture?Why automate security?How much can be automated?FEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod

Is the market shifting from evaluating software as an economic driver to re-evaluating the cost of software in the context of how AI can improve, augment or replace developers? SHOW: 850SHOW TRANSCRIPT: The Cloudcast #850 TranscriptSHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwCHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"SHOW NOTES:AWS CEO says developers might stop coding soon (Business Insider)Amazon CEO highlights the impacts of co-pilots on code (Andy Jassy)I’m tired of fixing customer’s AI-generated codeThe New Kingmakers (Stephen O’Grady)Exploring Generative AI (Martin Fowler)The Death of the Junior DeveloperSalary Pressures, Not AI, Vex Developers (The New Stack)THE CLOUD WAS BUILT UPON ENABLING DEVELOPERS (“BUILDERS”)The value of the developer exploded over the last decadeSoftware has reshaped most industries over the last decadeWE’RE MOVING FROM THE ECONOMICS OF SOFTWARE TO THE ECONOMICS OF DEVELOPERSCode assistants for AI are the early leader in driving AI revenueDo we have developer “productivity” or “creativity”?Does AI have more impact on legacy code or new code?How does the role of Junior vs. Senior developer change?What happens to System Integrators? FEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod

Vinay Tripathi (Senior Member of IEEE,  Production Network Engineer @Google) talks about the evolution of backbone networks for the Cloud and Internet, future technologies and career opportunities. SHOW: 849SHOW TRANSCRIPT: The Cloudcast #849 TranscriptSHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwNEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS"SHOW NOTES:Topic 1 - Welcome to the show. Before we jump into cloud networking, let’s talk a little bit about your background and some of the areas you focus on today. Topic 2 - Let’s start with something big - the anatomy of cloud backbone networks. What is the makeup of a typical cloud backbone network?Topic 3 - What are some of the unique challenges and solutions that you need to think about in terms of scaling, reliability, securing, and maintaining these massive networks, along with the innovative solutions being implementedTopic 4 - Looking forward, what are some of the emerging trends like intent driven networks, software defined global WAN, and the impact of AI/ML on cloud backbone infrastructure.Topic 5 - Some people in the networking industry are concerned about the future of network engineers. Career Paths in Cloud Networking: skills and knowledge required for a successful career in this field, along with potential career paths.FEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod

The summer lull has us reflecting on how the evolution of cloud computing has shaped the existing era that’s trying to figure out AI. With a special guest introduction. SHOW: 848SHOW TRANSCRIPT: The Cloudcast #848 TranscriptSHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwCHECK OUT OUR NEW PODCAST:  "CLOUDCAST BASICS"SHOW NOTES:WE HAVE A SPECIAL GUEST LEADING OFF THE SHOW - AFTER 13 YEARSWHAT PARTS OF THE CLOUD EVOLUTION HAVE LAID THE FOUNDATION FOR TODAY?[BAD] Shadow IT set Enterprise IT back 5-10 years, with the same responsibilities[GOOD] Technology experimentation has become the norm, from technologists to business leaders. [BAD] We still don’t really know how to measure the cost or return (ROI) of technology spending.[GOOD] We have a new appreciation for the power of software and software development to change businesses and markets.[BAD] But we still haven’t figured how to normalize great software development[GOOD] Open source communities (e.g. CNCF, etc.) provided a blueprint for bringing new innovation to the marketplace[BAD] We saw how long it took for Cloud to be disruptive, but now that valuations are so high, we haven’t learned patience for new disruptions.[GOOD] The “cloud” way of doing things has laid the foundation for what might/will come next. FEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod