PyTorch Developer Podcast podcast

Compiler collectives

0:00
16:33
Spola tillbaka 15 sekunder
Spola framåt 15 sekunder

Compiler collectives are a PT2 feature where by compiler instances across multiple ranks use NCCL collectives to communicate information to other instances. This is used to ensure we consistently decide if inputs or static or dynamic across all ranks. See also PR at https://github.com/pytorch/pytorch/pull/130935

Fler avsnitt från "PyTorch Developer Podcast"