Ronen Dar on GPU Orchestration for Building ML Models

In today’s episode of the Data Driven podcast, we delve into the intricate dance of the human brain with uncertainty, guided by the insightful and optimistic Dr. Julia DiGangi. Dr. DiGangi’s work transcends traditional academic boundaries, focusing on the neuropsychological underpinnings that shape our responses to the ever-shifting sands of our times. With a blend of deep scientific knowledge and a hopeful outlook, she sheds light on how understanding our brain's mechanics can enhance our navigation through life's complexities. Join us as Dr. DiGangi illuminates the pathways of our cognitive landscapes, offering clarity and guidance through the fog of uncertainty.Show Notes00:00 Neuropsychologist studies brain domains, human vs. machines.05:06 Technology layoffs causing career uncertainty, sparking concern.08:54 Brain is allergic to uncertainty, scientific study.10:24 People choose painful shocks over uncertainty in lab.15:44 Lead life wisely, brain is most powerful.19:21 Jordan Belfort, inspiration for Wolf of Wall Street.20:09 Theory powerful across contexts, emotional intelligence vs. artificial intelligence.25:30 Leadership is about influential emotional signals.29:22 Emotion sets human consciousness energy, fixing pain.31:43 Questioning our connection to somatic intelligence.35:26 Questions about recovery, healing, and enduring patterns.38:22 Challenges are inevitable, despite our circumstances.42:38 Emotions are a richer carrier of meaning.44:07 Transition from academic to public mental health advocacy.46:30 Talk therapy integrates thinking and emotions in the brain.52:17 Tired of politics, focused on substance and policy.55:45 Engaging podcast featuring AI and human mind.

In this landmark 360th episode of Data Driven, we take a full-circle journey back through the past seven seasons, exploring the highs, lows, and everything in-between. Frank and Andy, in their signature style, veer off the beaten path, offering listeners not just a trip down memory lane, but an off-road adventure filled with insights, laughter, and a few unexpected detours. Join us as we reflect on where we’ve been and, more importantly, where we’re headed next in the ever-evolving landscape of data and technology. It’s an episode you won’t want to miss, complete with the wisdom and whimsy that only Frank and Andy can provide.Moments00:00 Simpsons celebrates 360 episodes, announces new shows.06:48 Struggling with impostor syndrome, sibling dynamics, and survival.14:37 Experiments with AI feedback, brief show intros.20:19 Challenging start, surprised by success in audio.25:17 Uneven distribution; learned from former Microsoft colleague.29:47 Struggle with communication, engineer writes terse responses.35:47 Detective describes transit system in detail.38:25 Relieved when Amazon took over sci-fi series.43:28 Discussing latest blog post on OpenAI's capabilities.52:15 Obfuscation and difficulty in accessing information persist.56:41 Equal time for Democrats and Republicans in media.01:02:36 December is a mad time due to birthdays.01:05:06 Originally planned as a video podcast, logistics issues.01:09:44 360-degree journey concludes with data-driven discussions.

In this episode Frank and Andy welcome Jennifer Swanson explains how businesses can reinvent themselves for the data driven age of AI. From recognizing the importance of defining clear strategies and outcomes to the struggles of change management, Jennifer reveals that the heart of digital transformation lies in aligning individuals to the company's objectives, and significantly, that it's less about the technology itself and more about the people and processes. Whether you're a leader in your organization, part of a cross-functional team, or simply intrigued by the intersections of technology and business, this episode is a rich exploration of what it really means to be digitally transformed.Show Notes05:31 Technology now integral to every business operation.07:07 Offline businesses integrating technology for improved experience.10:04 First wave of digital transformation: applying technology.14:09 Data governance key to organization's predictable success.16:54 Organizational governance ensures strategy, priorities, and outcomes.21:47 Training, support, and focus key for empowerment.25:57 Selecting narrow slices drives model implementation success.28:49 "Positive experiences with scrum and DevOps"32:22 Leadership defines market, customer, and problems.36:12 In cross functional teams, sticking to lanes.38:53 Embrace collaboration and diplomacy for success.40:26 Smart professionals promoted to leadership roles, questioning suitability.44:15 Found work through family influence and adaptability.47:23 Experimenting with tech is now very accessible.50:28 Family loves Audible, enjoys romance novel series.55:23 Jennifer, thanks for the great digital transformation explanation.

In this episode, Danny Maloney is going to lead you on a journey to explore how artificial intelligence is not just a fleeting novelty but a tool of immense utility that's changing the playing field for individuals and small businesses alike. Danny brings his passion for algorithmic innovation from his experiences as a data-loving youth to his leadership role at Tailwind, where they leverage AI to level the marketing playing field for small businesses.Show Notes06:16 Early days of prevalent AI models, feedback loop.08:37 Small businesses struggle with limited resources for marketing.12:31 AI guides marketing decisions for faster success.16:34 AI leader initiating internal discussions on AI's impact.19:18 Experts experimenting, varying responses to AI capabilities.23:43 Early phase of tech development and impact.26:35 Tool Dingo ported from C# to Python.29:47 Making prompt engineering unnecessary for average users.31:39 Requested a specific image prompt and tested.35:03 OpenAI developing GPT-5, creating internet frenzy.38:58 Helping users personalize and develop voice technology.43:24 Retro tech culture and its work ethic.45:47 Chat GPT upsets media writers, AI creativity.48:57 Digital journey ends with gratitude and encouragement.

Welcome to show 357 of the Data Driven podcast! This week, we welcome Luke Diaz to the show.Luke has an impressive track record of scaling startups to staggering annual recurring revenues, and today, he's here to shed light on the pivotal role of customer success in growing a business. We'll dive deep into the intricacies of customer success management, its impact on subscription models, and the measurements that underpin it. Luke also shares personal insights into his daily habit tracking and the data-driven approach to setting quarterly goals.But that's not all – Luke opens up about his journey from being a hedge fund manager to making a name in the software industry, cultivating unyielding ambition, and the significance of customer feedback in lieu of venture capital insights.Show Moments05:27 Marketing function has evolved, delivering value.09:15 Companies need high retention to be successful.13:34 Emphasizing the challenge of defining success in startups.17:07 Analyze customer success, product strength, usage frequency.20:01 Companies hesitant to invest in customer success.24:38 VC interviews, cautionary tales, and relationship importance.26:12 Caution to look at numbers in term sheets.32:32 Entrepreneur achieves $100 million sale in 7 years.34:13 Machine learning hype outweighs business value currently.36:40 CSMs can upload public filings to chat GPT 4 for efficient reading.39:47 Screenshots are simple, stable, and pervasively used.43:34 Star Trek technology influencing modern innovations.48:10 Recent recommended books on leadership and strategy.50:22 Thank you to guest Luke Diaz, feedback appreciated.

Today, we're thrilled to welcome a special guest, Jeremy Utley, an academic marvel from Stanford, whose work on AI and idea flows is altering the landscape of business and innovation. In this episode, titled “Jeremy Utley on Getting the Most out of LLMs”, we dive into Jeremy's FIXIT approach for leveraging Large Language Models (LLMs) such as ChatGPT.Jeremy will unpack the nuances of FIXIT, showing us the importance of providing context, iterative interaction, and team incubation while using AI. We'll reminisce about how technology has evolved from cell phone minutes to AI, which is becoming as ubiquitous as smartphones once were.Frank will voice concerns about the technical aspects, like token length, while agreeing with Jeremy's method. We'll examine why AI needs to be seen as a collaborative partner rather than a magical solution. Jeremy will shine a light on his book "IdeaFlow" and share his insights on the psychological barriers hindering the effective use of AI in practice.Expect to hear anecdotal wisdom about the transformative impact of ChatGPT, the importance of prompt engineering, and the potential of AI to refine negotiation skills. Jeremy will even offer examples of how generative AI can offer fresh perspectives on personal and emotional decisions.Don’t forget Frank’s experiments with creating custom GPTs, such as for our character Bailey. Our lively discussion promises to leave you with a wealth of knowledge on interacting with and extracting maximum value from AI.For all this and much more, stay tuned in as we journey through the possibilities and realities of AI as a tool for amplifying human capacity.And before we kick things off, a quick reminder to check out Audible for the best in audiobooks, and please take a moment to rate and review Data Driven to help us grow and bring you content you love.Now, without further ado, let's get data driven.Show Notes00:00 "Idea flows: the only business metric that matters."05:35 Striving for the best is essential.06:46 Expert hesitations on using AI for knowledge.11:27 Asking for help, ended up with an image.14:41 Convince family to take job offer role-play.16:08 Learning new skills and fostering imagination through technology.19:54 Seek understanding from personal experiences and examples.25:48 Keanu Reeves movie sparks philosophical wonder.28:42 AI prompts emotional epiphanies for life decisions.32:11 Accidental query on creating GPU prompts explanations.36:08 Instructions for using voice mode during coaching.39:50 Ease of use and utility in busy life.43:18 Key to AI success: Team collaboration is essential.47:07 Kids don't care about data plans.50:45 Released groundbreaking technology; implications for all industries.53:18 Excited to buy internet access for chat.54:54 Jeremy Utley wows with innovation and wisdom.

In this episode, we delve into the profound enablement of large language models like ChatCPT and how they stand to revolutionize personalized learning. Rene gives us a glimpse of a future where robots and AI can liberate us from mundane chores and reshape the workforce, as seen with robots now flipping burgers at McDonald's.Imagine the world of quantum computing, where current strategies are reimagined to solve gargantuan optimization problems, a realm of technological advancement that Rene is no stranger to, and one which he assures holds the keys to the future, especially with security.The conversation takes a personal turn as Rene reflects on his origins in former East Germany and how peaceful protests carved the path to a united nation and consequently, his journey into AI. Show Notes06:05 Digital humans are embodied AI in a digital realm, replicating human appearance and emotion.09:51 AI approximating language and emotions' impact debated.13:14 Warning about irresponsible use of deepfake technology.16:06 Rapid evolution of bank heist and technology.19:20 Create 3D scenes from mine interior.21:43 Excitement for AI courses evolving into practical use.26:42 Labeling dangerous AI, balancing regulation and innovation.28:12 Automation impacts taxes, privacy, and human creativity.32:11 Language models can help, but verify outcomes.36:54 Tech companies develop own silicon for efficiency.38:09 Excitement over open weight AI models release.42:40 War and pandemic showed weak supply chains.46:26 Quantum computing holds untapped potential, significant savings.47:54 Data encryption is essential for online security.52:05 GPT chat provides effective personal information summaries.55:55 Audible sponsors podcast; free audio book offer.58:23 Digital podcast journey with Rene Scholter. Subscribe!

In this episode, our Andy Leonard and Frank La Vigne sit down with Ronen Dar, the co-founder and CTO of Run AI, to explore the world of artificial intelligence and GPU orchestration for machine learning models.Ronen shares insights into the challenges of utilizing GPUs in AI research and how Run AI's platform addresses these issues by optimizing GPU usage and providing tools for easier and faster model training and deployment. The conversation delves into the concept of fractional GPU usage, allowing multiple workloads to run on a single GPU, making expensive GPUs more accessible and cost-effective for organizations.LinksRun AI https://www.run.ai/Acquired Podcast Episode on Nvidia https://www.acquired.fm/episodes/nvidia-the-machine-learning-company-2006-2022Show Notes04:40 GPU technology enabled for cloud AI workloads.07:00 RunAI enables sharing expensive GPU resources for all.11:59 As enterprise AI matures, organizations become more savvy.15:35 Deep learning, GPUs for speed, CPUs backup.16:54 LLMs running on GPU's, exploding in market.23:29 NVIDIA created CUDA to simplify GPU use.26:21 NVIDIA's success lies in accessible technology.28:25 Solve GPU hugging with quotas and sharing.31:15 Team lead manages GPU quotas for researchers.35:51 Rapid changes in business and innovation.40:34 Passionate problem-solver with diverse tech background.43:38 Thanks for tuning in, subscribe and review.

In this episode, Frank sits down and talks with Devvret Rishi on powering real-world AI projects with declarative ML and the importance of open source.Andy was not able to attend this recording, but will be back next week!Show Notes04:36 Build, train, serve, deploy; critical data engineering link.07:24 Model configuration for input output prediction summaries.11:05 Saw spike and heavy churn after rollout.16:21 Advancements in AI: use pre-trained deep learning models.19:38 Trends for Gen AI: creative use cases, specialized APIs.21:31 Questioning a sales tactic and legal concerns.25:58 People can introspect, edit, and change models.30:02 Early data science projects led to passion.31:24 Cybersecurity and AI partnership driving industry innovation.33:58 Understanding randomness as a valuable model feature.39:39 Technology provides accessible, shared experiences in AI.41:51 Technology as a companion for psychological support.44:06 Immigration experience from India to Silicon Valley.47:59 Unexpected culture shock from Bay Area to Boston.50:40 Easily learn with hands-on prediabase.com access.Speaker BioDevvret Rishi is a co-founder of Prediabase, a platform that helps engineers and developers productionize open source AI. The idea for Prediabase came from Rishi's co-founder Piero's experience at Uber, where he noticed that he was constantly reinventing the wheel with each new machine learning project. To streamline the process, he created a tool called Ludwig, which eventually became popular at Uber and was open sourced. Rishi's work with Prediabase has revolutionized the way AI is developed and implemented in engineering teams around the world.

In this episode, the Frank and Andy are joined by special guest Blake Reichenbach, a product manager at HubSpot and the owner of Howdy Curiosity, an online nonfiction bookstore and learning community. The conversation dives into the intersection of data, AI, and the love of books, as they discuss the next steps in managing and mitigating the hallucination part of AI technology, the importance of human interaction with AI tools, and finding the right balance in user experience. Blake shares his insights on integrating AI into HubSpot's platform, emphasizing the need for a balanced approach, and the pitfalls of solely relying on generative AI tools in marketing. Stay tuned as they also touch on personal matters, career transitions, and the rapid evolution of technology. This episode is packed with valuable insights and engaging conversations - you won't want to miss it!Show Notes00:00 HubSpot is a leading CRM platform.05:44 New AI features for CMS and websites.09:33 Gen AI tools need to prioritize meaningful data.11:34 Summary: Suggesting blending human and AI for success.15:34 ML models need precise training on nuanced datasets.17:13 Content marketing: human connection, AI balance, user experience.21:24 Approach content marketing like a multi-bandit test.26:56 Selling nonfiction books online and sharing recommendations.27:54 Rapid tech evolution creating excitement and challenges.30:56 Balancing work and entrepreneurship for personal growth.35:24 Thanks Frank, Andy, and Blake for amazing show.Speaker BioBlake Reichenbach is a proud employee of HubSpot, a leading customer relationship management platform for scaling companies. With a focus on the CMS aspect of the platform, Blake is passionate about helping businesses with their front office needs, including marketing, sales, service, and data operations. With a bias towards HubSpot, Blake believes in the product and the company, and recommends it highly for businesses looking to streamline their operations.