The MLOps Podcast podcast

👏 A Practical Approach to Building LLM Applications with Liron Itzhaki Allerhand

0:00
52:02
Spol 15 sekunder tilbage
Spol 15 sekunder frem

Dean Pleban and Liron Itzhakhi Allerhand explore what it really takes to move LLMs into production. They cover how to define clear requirements, prep data for RAG, engineer effective prompts, and evaluate model performance using concrete metrics. The conversation dives into managing sensitive data, avoiding leakage, and why crisp outputs and clear user intent matter. Plus: future trends like in-context learning and the decoupling of foundation models from vertical apps.

Join our Discord community:

https://discord.gg/tEYvqxwhah

---

Timestamps:

  • 00:00 Introduction
  • 01:48 Phases of LLM Project Development
  • 03:32 Defining the Problem
  • 09:35 Data Preparation and Understanding
  • 23:59 Multimodal RAG
  • 26:28 Prompt Engineering & Model Selection
  • 27:58 Model Fine-tuning & Customization
  • 33:18 LLM as a Judge
  • 38:58 Evaluating Model Performance and Handling Hallucinations
  • 41:02 Using LLMs with sensitive data
  • 45:24 Other ideas for model evaluation and guardrails
  • 49:28 Recommendations for the audience


➡️ Liron Itzhaki Allerhand on LinkedIn – https://www.linkedin.com/in/liron-izhaki-allerhand-16579b4/

🌐 Check Out Our Website! https://dagshub.com Social

Links:

➡️ LinkedIn: https://www.linkedin.com/company/dagshub

➡️ Twitter: https://x.com/TheRealDAGsHub

➡️ Dean Pleban: https://x.com/DeanPlbn

Flere episoder fra "The MLOps Podcast"