System Design on the Road podkast

S2 E18 — Design a Video Generation Service: GPU Scheduling and Job Recovery

0:00
34:05
Do tyłu o 15 sekund
Do przodu o 15 sekund

A video-generation job is preempted, canceled, and then completed by an obsolete worker. Daniel and Maya design the lifecycle that keeps this late result from becoming the customer's published output.


Durable jobs, GPU placement, fair admission, checkpointing, and resumption establish the baseline. Scarce compute makes wasted work and queue policy visible costs. The interview separates producing output bytes from holding current authority to publish them, then follows cancellation and recovery through that boundary.


Chapters

00:00:00 Welcome and an obsolete video result

00:03:07 Inputs, budgets, and durable job state

00:07:04 Prompt-to-download baseline

00:10:57 GPU placement, admission, and fairness

00:15:23 Preemption, checkpoints, and resumption

00:19:29 Cancellation and result-publication fencing

00:23:38 Monitoring and protecting scarce compute

00:30:48 Final job and publication guarantees


Daniel is the interviewer, voiced by Liam. Maya is the engineer, voiced by Bella. AI narration at a calm pace, with three thinking pauses.


Opening music: Stealth Groover by Kevin MacLeod (incompetech.com). Licensed under Creative Commons Attribution 4.0: https://creativecommons.org/licenses/by/4.0/ . Edited excerpt with EQ, volume automation, a smooth fade, and narration.

Więcej odcinków z kanału "System Design on the Road"