
VIDEO SHORT | MIT 6.036: Why Step Functions Break AI Optimization
Why do modern AI models output smooth probabilities instead of plain yes-or-no decisions? Because step functions break calculus! Discover why $0\text{--}1$ loss results in zero gradients everywhere, and how the Sigmoid function allows gradient-based algorithms to learn smoothly in under 60 seconds.
Key Topics:
The mathematical flaw of $0\text{--}1$ step loss.
Smooth gradients via the Sigmoid curve $\sigma(z)$.
Probability output bounds $(0, 1)$.
Disclaimer: Note: This is an AI-generated discussion created using Google's NotebookLM, Gemini, and other AI tools, based on the freely and publicly available MIT 6.036 - Introduction to Machine Learning course material and personal study notes.
More episodes from "AI Bites: The Academic Series"



Don't miss an episode of “AI Bites: The Academic Series” and subscribe to it in the GetPodcast app.








