Marginalia podcast

Unsupervised Learning for Physical Interaction through Video Prediction (Chelsea Finn, Ian Goodfellow & Sergey Levine)

9.11.2026
0:00
34:32
Spol 15 sekunder tilbage
Spol 15 sekunder frem

Chelsea Finn, Ian Goodfellow and Sergey Levine investigate how robots can learn the effects of physical interactions from unlabeled video.

Their action-conditioned models predict how pixels move between frames, reusing visual appearance rather than reconstructing every future image from scratch.

The paper introduces a dataset of 59,000 robot-pushing interactions and tests predictions on previously unseen objects.

Its experiments compare alternative motion-prediction architectures and examine their ability to produce plausible futures conditioned on a robot's actions.

This 2016 work provides an early foundation for robotic world models and connects visual prediction with the longer-term goal of planning through learned models.

Author: Chelsea Finn, Ian Goodfellow and Sergey Levine

Source: Unsupervised Learning for Physical Interaction through Video Prediction · Chelsea Finn, Ian Goodfellow and Sergey Levine

Series: Weekly AI Papers · Historical classic

Explore: AI & Computer Science · AI Papers

Related episodes: Backpropagation: Learning Representations by Back-Propagating Errors (Rumelhart, Hinton & Williams) · Robotics, Vision and Control (Peter Corke) — Part 3 of 5: Robot Manipulators

Got something to say to this podcast? Send a voicemail, and you might hear yourself on the next episode!

Flere episoder fra "Marginalia"