The MLOps Podcast

In this live episode, I'm speaking with Jinen Setpal, ML Engineer at DagsHub about actually building, deploying, and monitoring large language model applications. We discuss DPT, a chatbot project that is live in production on the DagsHub Discord server and helps answer support questions and the process and challenges involved in building it. We dive into evaluation methods, ways to reduce hallucinations and much more. We also answer the audience's great questions.

Join now to take part in our first live MLOps Podcast episode. I'll be chatting with Jinen Setpal, ML Engineer at DagsHub about his work building LLM applications and getting LLMs into production. Sign up for the event at the link here: https://www.linkedin.com/events/7098968036782596096/comments/

In this episode, I had the pleasure of speaking with Yuval Gabay, MLOps Engineer at WSC Sports. Yuval builds better infrastructure and automation for developing, training, and deploying machine learning models at scale, with a focus on video data. We talk about MLOps methodologies, standardizing deployment in the organization, and closing the loop back from production into training. Watch the video: https://youtu.be/3m__nRuifsQ Join our Discord community: https://discord.gg/tEYvqxwhah ➡️ Yuval Gabbay on LinkedIn – https://www.linkedin.com/in/yuval-gabay-68963253/ ➡️ WSC Sports – https://wsc-sports.com/ 🌐 Check Out Our Website! https://dagshub.com Social Links: ➡️ LinkedIn: https://www.linkedin.com/company/dagshub ➡️ Twitter: https://twitter.com/TheRealDAGsHub ➡️ Dean Pleban: https://twitter.com/DeanPlbn

In this episode, I had the pleasure of speaking with Hamel Husain. Hamel is a machine learning and MLOps extraordinaire, he was one of the core maintainers of Fast.ai and has worked on ML and MLOps in places like Data Robot, Airbnb, and GitHub. We talk about Large Language Models, the future role of data scientists in the world of LLMs, and Hamel's approach to solving MLOps problems. Watch the video: https://www.youtube.com/watch?v=3oElMXPkaVs Relevant Links: 🐦 Hamel's Twitter – https://twitter.com/HamelHusain 🟦 Hamel's Linkedin – https://www.linkedin.com/in/hamelhusain/ ✍️ Hamel's amazing blog: https://hamel.dev/blog/posts/nbdev/ 🌐 Check Out Our Website! https://dagshub.com Social Links: ➡️ LinkedIn: https://www.linkedin.com/company/dagshub ➡️ Twitter: https://twitter.com/TheRealDAGsHub ➡️ Dean Pleban: https://twitter.com/DeanPlbn

In this episode, I had the pleasure of speaking with Almog Baku, a serial entrepreneur, consultant in Cloud, AI Infrastructure and Foundational models. We talk about Kubernetes, Large Language Models (LLMs), how to get them into production, and how data is becoming a more central piece of the ML landscape. We also Discuss Almog's newest project, Raptor ML, which helps ML teams productionize ML pipelines. Watch the video: https://www.youtube.com/watch?v=DCApRXhXD_w&feature=youtu.be Join our Discord community: https://discord.gg/tEYvqxwhah Relevant Links: 🦅 Check out Raptor for ML productionization – https://github.com/raptor-ml/raptor 👫 Join the Open AI & Gen AI TLV meetup group – https://www.meetup.com/openai-genai-tlv/ 📄 Read a very cool LLM paper – https://react-lm.github.io/ ➡️ Almog Baku on LinkedIn – https://www.linkedin.com/in/almogbaku/ ➡️ Almog Baku on Twitter – https://twitter.com/almogbaku Recommendation Links: Watch "Foundation" – https://tv.apple.com/us/show/foundation/umc.cmc.5983fipzqbicvrve6jdfep4x3 🌐 Check Out Our Website! https://dagshub.com Social Links: ➡️ LinkedIn: https://www.linkedin.com/company/dagshub ➡️ Twitter: https://twitter.com/TheRealDAGsHub ➡️ Dean Pleban: https://twitter.com/DeanPlbn

In this episode, I had the pleasure of speaking with Shreya Shankar, Ph.D. student at Berkeley RISELab. We chat about auto data validation and MLOps. Shreya shares her insights on several interesting topics, including the challenges of automating the data validation process and how to overcome them. We also discuss what makes organizations able to iterate faster in machine learning, and some predictions about the future of machine learning and MLOps. Watch the video: https://youtu.be/_hi6--H2Hug Join our Discord community: https://discord.gg/tEYvqxwhah Relevant Links: 📃 Moving Fast with Broken Data – https://arxiv.org/abs/2303.06094v1 🤖 Operationalizing machine learning https://arxiv.org/pdf/2209.09125.pdf 📒 Operationalizing notebooks https://smacke.net/papers/nbslicer.pdf ➡️ Shreya Shankar on LinkedIn – https://www.linkedin.com/in/shrshnk/ ➡️ Shreya Shankar on Twitter – https://twitter.com/sh_reya Recommendation Links: 📺 The Glory – A Korean Revenge Drama – https://www.netflix.com/title/81519223 ⛷️ Go Skiing! 🌐 Check Out Our Website! https://dagshub.com Social Links: ➡️ LinkedIn: https://www.linkedin.com/company/dagshub ➡️ Twitter: https://twitter.com/TheRealDAGsHub ➡️ Dean Pleban: https://twitter.com/DeanPlbn

In this episode, Dean speaks with Noa Weiss, the wonderful AI & ML consultant. They dive into Deep Learning research for marine mammal sounds, abstractions for machine learning projects and some of the unspoken challenges she's seen in the ML development process. Also prediction markets and Harry Potter.  Watch the video: https://www.youtube.com/watch?v=uQrR0KPq3RQ  Join our Discord community: https://discord.gg/tEYvqxwhah  Relevant Links:   Noa's talks:  🎥 The Quick & Dirty AI Startup: https://www.youtube.com/watch?v=HZ_LRxP3ep0 🎥 Choosing the Right Machine Learning Abstraction for your Business Needs – https://www.youtube.com/watch?v=C0gN47H91HM  ➡️ Noa Weiss on LinkedIn – https://www.linkedin.com/in/noa-weiss/ ➡️ Noa Weiss on Twitter – https://twitter.com/NWeiss   🌐 Noa's website: https://www.weissnoa.com  Recommendation Links:  - Unsong – https://unsongbook.com/ - Harry Potter & The Methods of Rationality – https://www.hpmor.com/  🌐 Check Out Our Website! https://dagshub.com    Social Links:   ➡️ LinkedIn: https://www.linkedin.com/company/dagshub   ➡️ Twitter: https://twitter.com/TheRealDAGsHub   ➡️ Dean Pleban: https://twitter.com/DeanPlbn

In this episode, I speak with Assaf Pinhasi, ML engineering and MLOps consultant extraordinaire! Assaf was the VP R&D at Zebra Medical Vision, and built the PayPal Risk organization's Big Data Platform. We dive into building ML infrastructure from scratch 10 years ago vs. today, best practices involved in building teams to support machine learning models in production, and the future of generative models.   Watch the video: https://youtu.be/tSbuDA5tMxQ Join our Discord community: https://discord.gg/tEYvqxwhah ➡️ Assaf Pinhasi on LinkedIn – https://www.linkedin.com/in/assafpinhasi/  🌐 Check Out Our Website! https://dagshub.com    Social Links:   ➡️ LinkedIn: https://www.linkedin.com/company/dagshub   ➡️ Twitter: https://twitter.com/TheRealDAGsHub   ➡️ Dean Pleban: https://twitter.com/DeanPlbn

In this episode, I speak with David Marx, Distinguished Engineer at Stability AI. This talk dives into how David got into machine learning, open-source software, and Stability AI.   We discuss following your curiosity, and what it takes to deploy a model like Stable Diffusion to production.   Watch the video: https://youtu.be/49dsoDK1KCA Join our Discord community: https://discord.gg/tEYvqxwhah Relevant Links:   🛌 Big Sleep by Ryan Murdock – https://colab.research.google.com/drive/1NCceX2mbiKOSlAd_o7IU7nA9UskKN5WR?usp=sharing (Author – https://sigmoid.social/@Adverb)   ➡️ David Marx on LinkedIn – https://www.linkedin.com/in/david-marx-b0a5bb14/ ➡️ David Marx on Twitter – https://twitter.com/DigThatData  Recommendation Links:  📚 Guerrilla Analytics – https://guerrilla-analytics.net/ 💿 Contribute to open source!  🧱 Build lego! It's awesome   🌐 Check Out Our Website! https://dagshub.com    Social Links:   ➡️ LinkedIn: https://www.linkedin.com/company/dagshub   ➡️ Twitter: https://twitter.com/TheRealDAGsHub   ➡️ Dean Pleban: https://twitter.com/DeanPlbn

In this episode, I speak with Logan Kilpatrick, Julia Language Developer Community Advocate. We talk about machine learning at NASA and how he discovered Julia as a student, the age-old Julia vs. Python debate, and how to get into a new scientific and technical field.  It was absolutely awesome! Check it out.   Watch the video: https://www.youtube.com/watch?v=3kgRN8hJIro Join our Discord community: https://discord.gg/tEYvqxwhah Relevant Links:   ➡️ Logan Kilpatrick on LinkedIn – https://www.linkedin.com/in/logankilpatrick/ ➡️ Logan Kilpatrick on Twitter – https://twitter.com/OfficialLoganK ➡️ Julia Language on Twitter – https://twitter.com/JuliaLanguage  Recommendation Links:  📚 Three-Body Problem Series: https://www.amazon.com/Three-Body-Problem-Cixin-Liu/dp/0765382032 📹 13 Lives on IMDB: https://www.imdb.com/title/tt12262116/    🌐 Check Out Our Website! https://dagshub.com    Social Links:   ➡️ LinkedIn: https://www.linkedin.com/company/dagshub   ➡️ Twitter: https://twitter.com/TheRealDAGsHub   ➡️ Dean Pleban: https://twitter.com/DeanPlbn