The AI Kubernetes Show podcast

LLM Inference on Kubernetes: New Primitives, Real Challenges

0:00
43:33
Reculer de 15 secondes
Avancer de 15 secondes

Running LLM inference on Kubernetes requires new primitives for routing, autoscaling, and GPU scheduling. Here's what platform engineers need to know.

D'autres épisodes de "The AI Kubernetes Show"