
S2 E18 — Design a Video Generation Service: GPU Scheduling and Job Recovery
A video-generation job is preempted, canceled, and then completed by an obsolete worker. Daniel and Maya design the lifecycle that keeps this late result from becoming the customer's published output.
Durable jobs, GPU placement, fair admission, checkpointing, and resumption establish the baseline. Scarce compute makes wasted work and queue policy visible costs. The interview separates producing output bytes from holding current authority to publish them, then follows cancellation and recovery through that boundary.
Chapters
00:00:00 Welcome and an obsolete video result
00:03:07 Inputs, budgets, and durable job state
00:07:04 Prompt-to-download baseline
00:10:57 GPU placement, admission, and fairness
00:15:23 Preemption, checkpoints, and resumption
00:19:29 Cancellation and result-publication fencing
00:23:38 Monitoring and protecting scarce compute
00:30:48 Final job and publication guarantees
Daniel is the interviewer, voiced by Liam. Maya is the engineer, voiced by Bella. AI narration at a calm pace, with three thinking pauses.
Opening music: Stealth Groover by Kevin MacLeod (incompetech.com). Licensed under Creative Commons Attribution 4.0: https://creativecommons.org/licenses/by/4.0/ . Edited excerpt with EQ, volume automation, a smooth fade, and narration.
Więcej odcinków z kanału "System Design on the Road"



Nie przegap odcinka z kanału “System Design on the Road”! Subskrybuj bezpłatnie w aplikacji GetPodcast.








